Statistical mechanics of complex neural systems and high dimensional data
From MaRDI portal
Publication:3301560
Abstract: Recent experimental advances in neuroscience have opened new vistas into the immense complexity of neuronal networks. This proliferation of data challenges us on two parallel fronts. First, how can we form adequate theoretical frameworks for understanding how dynamical network processes cooperate across widely disparate spatiotemporal scales to solve important computational problems? And second, how can we extract meaningful models of neuronal systems from high dimensional datasets? To aid in these challenges, we give a pedagogical review of a collection of ideas and theoretical methods arising at the intersection of statistical physics, computer science and neurobiology. We introduce the interrelated replica and cavity methods, which originated in statistical physics as powerful ways to quantitatively analyze large highly heterogeneous systems of many interacting degrees of freedom. We also introduce the closely related notion of message passing in graphical models, which originated in computer science as a distributed algorithm capable of solving large inference and optimization problems involving many coupled variables. We then show how both the statistical physics and computer science perspectives can be applied in a wide diversity of contexts to problems arising in theoretical neuroscience and data analysis. Along the way we discuss spin glasses, learning theory, illusions of structure in noise, random matrices, dimensionality reduction, and compressed sensing, all within the unified formalism of the replica method. Moreover, we review recent conceptual connections between message passing in graphical models, and neural computation and learning. Overall, these ideas illustrate how statistical physics and computer science might provide a lens through which we can uncover emergent computational functions buried deep within the dynamical complexities of neuronal networks.
Recommendations
- Mean-field inference methods for neural networks
- Collective properties of neural networks: A statistical physics approach
- scientific article; zbMATH DE number 125396
- Mean field asymptotics in high-dimensional statistics: from exact results to efficient algorithms
- Statistical field theory for neural networks
Cites work
- scientific article; zbMATH DE number 5943539 (Why is no real title available?)
- scientific article; zbMATH DE number 1273988 (Why is no real title available?)
- scientific article; zbMATH DE number 1168332 (Why is no real title available?)
- scientific article; zbMATH DE number 1983334 (Why is no real title available?)
- scientific article; zbMATH DE number 1775450 (Why is no real title available?)
- scientific article; zbMATH DE number 2174437 (Why is no real title available?)
- scientific article; zbMATH DE number 3244317 (Why is no real title available?)
- A Brownian-Motion Model for the Eigenvalues of a Random Matrix
- A simple proof of the restricted isometry property for random matrices
- An elementary proof of a theorem of Johnson and Lindenstrauss
- An introduction to statistical modeling of extreme values
- Compressed and Privacy-Sensitive Sparse Regression
- Constructing Free-Energy Approximations and Generalized Belief Propagation Algorithms
- Decoding by Linear Programming
- Dynamics of sparsely connected networks of excitatory and inhibitory spiking neurons.
- Exact distribution of the maximal height of \(p\) vicious walkers
- Extensions of Lipschitz mappings into a Hilbert space
- From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images
- Gibbs states and the set of solutions of random constraint satisfaction problems
- Graphical models, exponential families, and variational inference
- Information, Physics, and Computation
- Large deviations of the maximum eigenvalue in Wishart random matrices
- Learning a rule in a multilayer neural network
- Level-spacing distributions and the Airy kernel
- Neighborliness of randomly projected simplices in high dimensions
- Neural networks and physical systems with emergent collective computational abilities
- Nonintersecting Brownian excursions
- Observation of a hexatic vortex glass in flux lattices of the high-<mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" display="inline"><mml:mrow><mml:msub><mml:mrow><mml:mi mathvariant="italic">T</mml:mi></mml:mrow><mml:mrow><mml:mi mathvariant="ita
- On the distribution of the roots of certain symmetric matrices
- Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ 1 minimization
- Probabilistic graphical models.
- Random matrix theory
- Random projections of smooth manifolds
- Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information
- Role of homeostasis in learning sparse representations
- Sparse nonnegative solution of underdetermined linear equations by linear programming
- Statistical Physics of Spin Glasses and Information Processing
- Statistical mechanics of learning
- Statistical mechanics of unsupervised structure recognition
- Statistical theory of superlattices
- Survey propagation: An algorithm for satisfiability
- The Perceptron: A Model for Brain Functioning. I
- The space of interactions in neural network models
Cited in
(9)- Statistical physics of community ecology: a cavity solution to MacArthur’s consumer resource model
- High-dimensional dynamics of generalization error in neural networks
- New statistical models of nonergodic cognitive systems and their pathologies
- Mean-field inference methods for neural networks
- Triple descent and the two kinds of overfitting: where and why do they appear?*
- Statistical mechanics of low-rank tensor decomposition
- Statistical physics and representations in real and artificial neural networks
- \(p\)-adic statistical field theory and deep belief networks
- Generalisation error in learning with random features and the hidden manifold model*
This page was built for publication: Statistical mechanics of complex neural systems and high dimensional data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3301560)
