Input Statistics and Hebbian Cross-Talk Effects

DOI10.1162/NECO_A_00565zbMATH Open1415.92056arXiv1208.2100OpenAlexW2041199538WikidataQ50692248 ScholiaQ50692248MaRDI QIDQ5378338FDOQ5378338

Anca Rǎdulescu

Publication date: 12 June 2019

Published in: Neural Computation (Search for Journal in Brave)

Abstract: As an extension of prior work, we study inspecific Hebbian learning using the classical Oja model. We use a combination of analytical tools and numerical simulations to investigate how the effects of inspecificity (or synaptic "cross-talk") depend on the input statistics. We investigated a variety of patterns that appear in dimensions higher than 2 (and classified them based on covariance type and input bias). The effects of inspecificity on the learning outcome were found to depend very strongly on the nature of the input, and in some cases were very dramatic, making unlikely the existence of a generic neural algorithm to correct learning inaccuracy due to cross-talk. We discuss the possibility that sophisticated learning, such as presumably occurs in the neocortex, is enabled as much by special proofreading machinery for enhancing specificity, as by special algorithms.

Full work available at URL: https://arxiv.org/abs/1208.2100

Recommendations

• Hebbian crosstalk and input segregation
• Synaptic input statistics tune the variability and reproducibility of neuronal responses
• Higher-Order Statistics of Input Ensembles and the Response of Simple Model Neurons
• Theory of Input Spike Auto- and Cross-Correlations and Their Effect on the Response of Spiking Neurons
• On a stochastic neuronal model integrating correlated inputs
• Impact of correlated inputs to neurons: modeling observations from \textit{in vivo} intracellular recordings
• Neuronal computation using high-order statistics

zbMATH Keywords

Hebbian learningcross-talk effectsinput statisticsOja model

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10) Neural biology (92C20) Memory and learning in psychology (91E40)

Cites Work

• A simplified neuron model as a principal component analyzer
• Mathematical formulations of Hebbian learning
• On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix
• Natural image statistics. A probabilistic approach to early computational vision.
• Title not available (Why is that?)
• A learning rule with generalized Hebbian synapses
• Qualitative behavior of differential equations associated with artificial neural networks
• Title not available (Why is that?)
• Multiplicative Synaptic Normalization and a Nonlinear Hebb Rule Underlie a Neurotrophic Model of Competitive Synaptic Plasticity
• The neuronal replicator hypothesis
• An Analysis of Synaptic Normalization in a General Class of Hebbian Models
• Temporal Dynamics of Rate-Based Synaptic Plasticity Rules in a Stochastic Model of Spike-Timing-Dependent Plasticity
• Hebbian errors in learning: an analysis using the Oja model
• Spatiotemporal specificity of synaptic plasticity: cellular rules and mechanisms
• Nonlinear Extraction of Independent Components of Natural Images Using Radial Gaussianization
• Cross-talk induces bifurcations in nonlinear models of synaptic plasticity
• Hebbian crosstalk and input segregation

Cited In (1)

• Hebbian crosstalk and input segregation

Uses Software

• avida

This page was built for publication: Input Statistics and Hebbian Cross-Talk Effects

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5378338)