The replica symmetric approximation of the analogical neural network

DOI10.1007/S10955-010-0020-YzbMATH Open1201.82038arXiv0911.3096OpenAlexW3100464551MaRDI QIDQ5961874FDOQ5961874

Adriano Barra, Giuseppe Genovese, Francesco Guerra

Publication date: 16 September 2010

Published in: Journal of Statistical Physics (Search for Journal in Brave)

Abstract: In this paper we continue our investigation of the analogical neural network, paying interest to its replica symmetric behavior in the absence of external fields of any type. Bridging the neural network to a bipartite spin-glass, we introduce and apply a new interpolation scheme to its free energy that naturally extends the interpolation via cavity fields or stochastic perturbations to these models. As a result we obtain the free energy of the system as a sum rule, which, at least at the replica symmetric level, can be solved exactly. As a next step we study its related self-consistent equations for the order parameters and their rescaled fluctuations, found to diverge on the same critical line of the standard Amit-Gutfreund-Sompolinsky theory.

Full work available at URL: https://arxiv.org/abs/0911.3096

zbMATH Keywords

neural networksspin-glassreplica symmetry

Mathematics Subject Classification ID

Statistical mechanics of random media, disordered materials (including liquid crystals and spin glasses) (82D30) Neural nets applied to problems in time-dependent statistical mechanics (82C32)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Neural networks and physical systems with emergent collective computational abilities.
• Stochastic symmetry-breaking in a Gaussian Hopfield model
• Rigorous results for the Hopfield model with many patterns
• The thermodynamic limit in mean field spin glass models
• Broken replica symmetry bounds in the mean field spin glass model
• A mechanical approach to mean field spin models
• On the replica symmetric equations for the Hopfield model
• ABOUT THE OVERLAP DISTRIBUTION IN MEAN FIELD SPIN GLASS MODELS
• The mean field Ising model trough interpolating techniques
• Course 5 An introduction to mean field spin glas theory: Methods and results
• The replica-symmetric solution without replica trick for the Hopfield model
• Mathematical aspects of spin classes and neural networks
• Exponential inequalities and convergence of moments in the replica-symmetric regime of the Hopfield model.
• About the ergodic regime in the analogical Hopfield neural networks: Moments of the partition function

Cited In (27)

• Generalized Guerra's interpolation schemes for dense associative neural networks
• On the Marchenko–Pastur law in analog bipartite spin-glasses
• Non-convex multi-species Hopfield models
• Parallel learning by multitasking neural networks
• Equilibrium statistical mechanics on correlated random graphs
• Replica symmetry breaking in neural networks: a few steps toward rigorous results
• Replica symmetry breaking in multi-species Sherrington-Kirkpatrick model
• Hebbian learning from first principles
• Hierarchical neural networks perform both serial and parallel processing
• Dense Hebbian neural networks: a replica symmetric picture of supervised learning
• Minimax formula for the replica symmetric free energy of deep restricted Boltzmann machines
• A remark on the spherical bipartite spin glass
• Interpolation and Comparison Methods in the Mean Field Spin Glass Model
• Universality in bipartite mean field spin glasses
• Dreaming neural networks: rigorous results
• Replica-symmetric theory of nonlinear analogue neural networks
• Neural networks retrieving Boolean patterns in a sea of Gaussian ones
• The relativistic Hopfield network: Rigorous results
• A thermodynamic perspective of immune capabilities
• On the equivalence of Hopfield networks and Boltzmann machines
• Storing, learning and retrieving biased patterns
• Statistical mechanics of learning via reverberation in bidirectional associative memories
• Multi-species mean field spin glasses. Rigorous results
• Spontaneous Replica Symmetry Breaking and Interpolation Methods for Complex Statistical Mechanics Systems
• Legendre equivalences of spherical Boltzmann machines
• Free energies of Boltzmann machines: self-averaging, annealed and replica symmetric approximations in the thermodynamic limit
• Interpolating between boolean and extremely high noisy patterns through minimal dense associative memories

This page was built for publication: The replica symmetric approximation of the analogical neural network

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5961874)