Precise capacity analysis in binary networks with multiple coding level inputs

DOI10.1162/NECO.2009.02-09-967MaRDI QIDQ3556799zbMATH OpenOpenAlexWikidataFDO

Authors Yali Amit, Yibi Huang

Publication date 26 April 2010

Published in Neural Computation (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1162/neco.2009.02-09-967

Mathematics Subject Classification ID

Applications of Markov chains and discrete-time Markov processes on general state spaces (social mobility, learning theory, industrial processes, etc.) (60J20) Learning and adaptive systems in artificial intelligence (68T05) Neural biology (92C20) Neural networks for/in biological studies, artificial life and related topics (92B20)

Recommendations

• Capacity analysis in multi-state synaptic models: a retrieval probability perspective
• What determines the capacity of autoassociative memories in the brain?
• Dynamical properties of a randomly diluted neural network with variable activity
• Lower bounds on the capacities of binary and ternary networks storing sparse random vectors
• On the capacity of neural networks with binary weights

Cites work

• Associative memory: on the (puzzling) sparse coding limit
• Optimizing One-Shot Learning with Binary Synapses
• Slow stochastic Hebbian learning of classes of stimuli in a recurrent neural network
• Spike-Driven Synaptic Dynamics Generating Working Memory States

Cited in

(16)

• The total capacity of two-user multiple-access channel with binary output
• Inhibition enhances memory capacity: optimal feedback, transient replay and oscillations
• Variations on the Theme of Synaptic Filtering: A Comparison of Integrate-and-Express Models of Synaptic Plasticity for Memory Lifetimes
• Memory Nearly on a Spring: A Mean First Passage Time Approach to Memory Lifetimes
• Optimizing One-Shot Learning with Binary Synapses
• Inhomogeneous sparseness leads to dynamic instability during sequence memory recall in a recurrent neural network model
• Capacity analysis in multi-state synaptic models: a retrieval probability perspective
• Encoding binary neural codes in networks of threshold-linear neurons
• The enhanced rise and delayed fall of memory in a model of synaptic integration: extension to discrete state synapses
• Mean first passage memory lifetimes by reducing complex synapses to simple synapses
• First passage time memory lifetimes for simple, multistate synapses
• First passage time memory lifetimes for multistate, filter-based synapses
• The impact of sparse coding on memory lifetimes in simple and complex models of synaptic plasticity
• A mathematical analysis of memory lifetime in a simple network model of memory
• First Passage Time Memory Lifetimes for Simple, Multistate Synapses: Beyond the Eigenvector Requirement
• Dynamic Integrative Synaptic Plasticity Explains the Spacing Effect in the Transition from Short- to Long-Term Memory

This page was built for publication: Precise capacity analysis in binary networks with multiple coding level inputs

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3556799)