Mathematical studies of the dynamics of finite-size binary neural networks: a review of recent progress

DOI10.3934/MBE.2019404zbMATH Open1475.92013arXiv1904.12798OpenAlexW2971857739WikidataQ91168102 ScholiaQ91168102MaRDI QIDQ2045583FDOQ2045583

Authors: Stefano Panzeri, Diego Fasoli 

Publication date: 13 August 2021

Published in: Mathematical Biosciences and Engineering (Search for Journal in Brave)

Abstract: Traditional mathematical approaches to studying analytically the dynamics of neural networks rely on the mean-field approximation, which is rigorously applicable only to networks of infinite size. However, all existing real biological networks have finite size, and many of them, such as microscopic circuits in invertebrates, are composed only of a few tens of neurons. Thus, it is important to be able to extend to small-size networks our ability to study analytically neural dynamics. Analytical solutions of the dynamics of finite-size neural networks have remained elusive for many decades, because the powerful methods of statistical analysis, such as the central limit theorem and the law of large numbers, do not apply to small networks. In this article, we critically review recent progress on the study of the dynamics of small networks composed of binary neurons. In particular, we review the mathematical techniques we developed for studying the bifurcations of the network dynamics, the dualism between neural activity and membrane potentials, cross-neuron correlations, and pattern storage in stochastic networks. Finally, we highlight key challenges that remain open, future directions for further progress, and possible implications of our results for neuroscience.

Full work available at URL: https://arxiv.org/abs/1904.12798

Recommendations

• scientific article; zbMATH DE number 1124669
• scientific article; zbMATH DE number 2212150
• A Mathematical Analysis of the Effects of Hebbian Learning Rules on the Dynamics and Structure of Discrete-Time Random Recurrent Neural Networks
• Limits and dynamics of stochastic neuronal networks with random heterogeneous delays
• Attractive periodic sets in discrete-time recurrent networks (with emphasis on fixed-point stability and bifurcations in two-neuron networks)

zbMATH Keywords

bifurcation theoryquenched disorderdiscontinuous mapslearning rulesbinary rate networkscross-neuron correlationspatterns storagethreshold units

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20) Research exposition (monographs, survey articles) pertaining to biology (92-02)

Cites Work

• Elements of applied bifurcation theory.
• Title not available (Why is that?)
• Neural networks and physical systems with emergent collective computational abilities
• Dynamics of pattern formation in lateral-inhibition type neural fields
• Time-Dependent Statistics of the Ising Model
• Characteristics of Random Nets of Analog Neuron-Like Elements
• Bifurcations in nonlinear discontinuous systems
• Mathematical frameworks for oscillatory network dynamics in neuroscience
• Title not available (Why is that?)
• Multi-parametric bifurcations in a piecewise–linear discontinuous map
• The permanent of a square matrix
• Bifurcation phenomena in non-smooth dynamical systems
• Title not available (Why is that?)
• The existence of persistent states in the brain
• Bifurcation and Chaos in Nonsmooth Mechanical Systems
• Collective properties of neural networks: A statistical physics approach
• Modeling Brain Function
• Border collision bifurcations at the change of state-space dimension
• Homogeneous nets of neuron-like elements
• Replica symmetry breaking and the nature of the spin glass phase
• Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements
• Large deviations, dynamics and phase transitions in large stochastic and disordered neural networks
• Bifurcations in the Wilson-Cowan equations with nonsmooth firing rate
• Influence of noise on the function of a physiological neural network
• Permanents in probability and statistics
• Complex dynamics and the structure of small neural networks
• Title not available (Why is that?)
• Transitions between asynchronous and synchronous states: a theory of correlations in small neural circuits
• Pattern storage, bifurcations, and groupwise correlation structure of an exactly solvable asymmetric neural network model

Cited In (1)

• Multiscale modeling, stochastic and asymptotic approaches for analyzing neural networks based on synaptic dynamics

This page was built for publication: Mathematical studies of the dynamics of finite-size binary neural networks: a review of recent progress

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2045583)