Mathematical studies of the dynamics of finite-size binary neural networks: a review of recent progress

DOI10.3934/MBE.2019404MaRDI QIDQ2045583zbMATH OpenOpenAlexWikidataFDO

Authors Stefano Panzeri, Diego Fasoli

Publication date 13 August 2021

Published in Mathematical Biosciences and Engineering (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/1904.12798

zbMATH Keywords

bifurcation theorybinary rate networkscross-neuron correlationsdiscontinuous mapslearning rulespatterns storagequenched disorderthreshold units

Mathematics Subject Classification ID

Research exposition (monographs, survey articles) pertaining to biology (92-02) Neural networks for/in biological studies, artificial life and related topics (92B20)

Abstract: Traditional mathematical approaches to studying analytically the dynamics of neural networks rely on the mean-field approximation, which is rigorously applicable only to networks of infinite size. However, all existing real biological networks have finite size, and many of them, such as microscopic circuits in invertebrates, are composed only of a few tens of neurons. Thus, it is important to be able to extend to small-size networks our ability to study analytically neural dynamics. Analytical solutions of the dynamics of finite-size neural networks have remained elusive for many decades, because the powerful methods of statistical analysis, such as the central limit theorem and the law of large numbers, do not apply to small networks. In this article, we critically review recent progress on the study of the dynamics of small networks composed of binary neurons. In particular, we review the mathematical techniques we developed for studying the bifurcations of the network dynamics, the dualism between neural activity and membrane potentials, cross-neuron correlations, and pattern storage in stochastic networks. Finally, we highlight key challenges that remain open, future directions for further progress, and possible implications of our results for neuroscience.

Review text

The survey critically review recent progress on the study of the dynamics of small networks composed of binary neurons. Authors proposing an alternative theory to describe the dynamics of finite-size neural networks composed of binary threshold units, which are critically review in the study. Mainly focusing on the zero-noise limit of small networks, and characterising mathematically the bifurcation point of the network dynamics in single network realizations. The work is mainly focusing on review of the mathematical techniques for studying the bifurcation of the network dynamics, the dualism between neural activity and membrane potentials, cross-neuron correlations, and pattern storage in stochastic networks. In addition highlighting key challenges that remain open, as well as future directions for further progress in the mathematical study of binary networks, and possible simplifications of introduce theory and results for neuroscience. Survey having recent, reach, and lengthy list of references and interesting numerical results.

Recommendations

• scientific article; zbMATH DE number 1124669
• scientific article; zbMATH DE number 2212150
• A Mathematical Analysis of the Effects of Hebbian Learning Rules on the Dynamics and Structure of Discrete-Time Random Recurrent Neural Networks
• Limits and dynamics of stochastic neuronal networks with random heterogeneous delays
• Attractive periodic sets in discrete-time recurrent networks (with emphasis on fixed-point stability and bifurcations in two-neuron networks)

Cites work

• Bifurcation and Chaos in Nonsmooth Mechanical Systems
• Bifurcation phenomena in non-smooth dynamical systems
• Bifurcations in nonlinear discontinuous systems
• Bifurcations in the Wilson-Cowan equations with nonsmooth firing rate
• Border collision bifurcations at the change of state-space dimension
• Characteristics of Random Nets of Analog Neuron-Like Elements
• Collective properties of neural networks: A statistical physics approach
• Complex dynamics and the structure of small neural networks
• Dynamics of pattern formation in lateral-inhibition type neural fields
• Elements of applied bifurcation theory.
• Homogeneous nets of neuron-like elements
• scientific article; zbMATH DE number 4100422 (Why is no real title available?)
• scientific article; zbMATH DE number 3793772 (Why is no real title available?)
• scientific article; zbMATH DE number 846008 (Why is no real title available?)
• scientific article; zbMATH DE number 3380017 (Why is no real title available?)
• Influence of noise on the function of a physiological neural network
• Large deviations, dynamics and phase transitions in large stochastic and disordered neural networks
• Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements
• Mathematical frameworks for oscillatory network dynamics in neuroscience
• Modeling Brain Function
• Multi-parametric bifurcations in a piecewise–linear discontinuous map
• Neural networks and physical systems with emergent collective computational abilities
• Pattern storage, bifurcations, and groupwise correlation structure of an exactly solvable asymmetric neural network model
• Permanents in probability and statistics
• Replica symmetry breaking and the nature of the spin glass phase
• The existence of persistent states in the brain
• The permanent of a square matrix
• Time-Dependent Statistics of the Ising Model
• Transitions between asynchronous and synchronous states: a theory of correlations in small neural circuits

Cited in

(2)

• Multiscale modeling, stochastic and asymptotic approaches for analyzing neural networks based on synaptic dynamics
• Binary associative memory networks: a review of mathematical framework and capacity analysis

This page was built for publication: Mathematical studies of the dynamics of finite-size binary neural networks: a review of recent progress

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2045583)