Input Statistics and Hebbian Cross-Talk Effects

DOI10.1162/NECO_A_00565MaRDI QIDQ5378338zbMATH OpenOpenAlexWikidataFDO

Authors Anca Rǎdulescu

Publication date 12 June 2019

Published in Neural Computation (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1208.2100

zbMATH Keywords

Hebbian learningcross-talk effectsinput statisticsOja model

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10) Neural biology (92C20) Memory and learning in psychology (91E40)

Abstract: As an extension of prior work, we study inspecific Hebbian learning using the classical Oja model. We use a combination of analytical tools and numerical simulations to investigate how the effects of inspecificity (or synaptic "cross-talk") depend on the input statistics. We investigated a variety of patterns that appear in dimensions higher than 2 (and classified them based on covariance type and input bias). The effects of inspecificity on the learning outcome were found to depend very strongly on the nature of the input, and in some cases were very dramatic, making unlikely the existence of a generic neural algorithm to correct learning inaccuracy due to cross-talk. We discuss the possibility that sophisticated learning, such as presumably occurs in the neocortex, is enabled as much by special proofreading machinery for enhancing specificity, as by special algorithms.

Recommendations

• Hebbian crosstalk and input segregation
• Synaptic input statistics tune the variability and reproducibility of neuronal responses
• Higher-Order Statistics of Input Ensembles and the Response of Simple Model Neurons
• Theory of Input Spike Auto- and Cross-Correlations and Their Effect on the Response of Spiking Neurons
• On a stochastic neuronal model integrating correlated inputs
• Impact of correlated inputs to neurons: modeling observations from \textit{in vivo} intracellular recordings
• Neuronal computation using high-order statistics

Cites work

• scientific article; zbMATH DE number 1183304 (Why is no real title available?)
• scientific article; zbMATH DE number 1096979 (Why is no real title available?)
• A learning rule with generalized Hebbian synapses
• A simplified neuron model as a principal component analyzer
• An Analysis of Synaptic Normalization in a General Class of Hebbian Models
• Cross-talk induces bifurcations in nonlinear models of synaptic plasticity
• Hebbian crosstalk and input segregation
• Hebbian errors in learning: an analysis using the Oja model
• Mathematical formulations of Hebbian learning
• Multiplicative Synaptic Normalization and a Nonlinear Hebb Rule Underlie a Neurotrophic Model of Competitive Synaptic Plasticity
• Natural image statistics. A probabilistic approach to early computational vision.
• Nonlinear Extraction of Independent Components of Natural Images Using Radial Gaussianization
• On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix
• Qualitative behavior of differential equations associated with artificial neural networks
• Spatiotemporal specificity of synaptic plasticity: cellular rules and mechanisms
• Temporal Dynamics of Rate-Based Synaptic Plasticity Rules in a Stochastic Model of Spike-Timing-Dependent Plasticity
• The neuronal replicator hypothesis

Cited in

(3)

• Hebbian errors in learning: an analysis using the Oja model
• Hebbian crosstalk and input segregation
• Cross-talk induces bifurcations in nonlinear models of synaptic plasticity

Describes a project that uses

Uses Software

• avida

This page was built for publication: Input Statistics and Hebbian Cross-Talk Effects

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5378338)