The replica symmetric approximation of the analogical neural network
From MaRDI portal
(Redirected from Publication:5961874)
Abstract: In this paper we continue our investigation of the analogical neural network, paying interest to its replica symmetric behavior in the absence of external fields of any type. Bridging the neural network to a bipartite spin-glass, we introduce and apply a new interpolation scheme to its free energy that naturally extends the interpolation via cavity fields or stochastic perturbations to these models. As a result we obtain the free energy of the system as a sum rule, which, at least at the replica symmetric level, can be solved exactly. As a next step we study its related self-consistent equations for the order parameters and their rescaled fluctuations, found to diverge on the same critical line of the standard Amit-Gutfreund-Sompolinsky theory.
Recommendations
- Replica-symmetric theory of nonlinear analogue neural networks
- Analogue neural networks on correlated random graphs
- Replica symmetry breaking in neural networks: a few steps toward rigorous results
- About the ergodic regime in the analogical Hopfield neural networks: Moments of the partition function
- THE INVESTIGATION OF THE SPIN GLASS PROPERTIES OF THE HOPFIELD NEURAL NETWORK MODEL
Cites work
- scientific article; zbMATH DE number 1952026 (Why is no real title available?)
- scientific article; zbMATH DE number 1998876 (Why is no real title available?)
- scientific article; zbMATH DE number 1751767 (Why is no real title available?)
- scientific article; zbMATH DE number 2211481 (Why is no real title available?)
- A mechanical approach to mean field spin models
- About the ergodic regime in the analogical Hopfield neural networks: Moments of the partition function
- About the overlap distribution in mean field spin glass models
- An introduction to mean field spin glass theory: methods and results
- Broken replica symmetry bounds in the mean field spin glass model
- Exponential inequalities and convergence of moments in the replica-symmetric regime of the Hopfield model.
- Mathematical aspects of spin classes and neural networks
- Neural networks and physical systems with emergent collective computational abilities
- On the replica symmetric equations for the Hopfield model
- Rigorous results for the Hopfield model with many patterns
- Stochastic symmetry-breaking in a Gaussian Hopfield model
- The mean field Ising model trough interpolating techniques
- The replica-symmetric solution without replica trick for the Hopfield model
- The thermodynamic limit in mean field spin glass models
Cited in
(37)- Free energies of Boltzmann machines: self-averaging, annealed and replica symmetric approximations in the thermodynamic limit
- Interpolating between boolean and extremely high noisy patterns through minimal dense associative memories
- Generalized Guerra's interpolation schemes for dense associative neural networks
- The relativistic Hopfield network: rigorous results
- On the Marchenko–Pastur law in analog bipartite spin-glasses
- Non-convex multi-species Hopfield models
- Parallel learning by multitasking neural networks
- Equilibrium statistical mechanics on correlated random graphs
- Analytical methods for continuous attractor neural networks
- Replica symmetry breaking in multi-species Sherrington-Kirkpatrick model
- Replica symmetry breaking in neural networks: a few steps toward rigorous results
- Interpolation and comparison methods in the mean field spin glass model
- Hierarchical neural networks perform both serial and parallel processing
- Free energy fluctuations of the bipartite spherical SK model at critical temperature
- Hebbian learning from first principles
- Dense Hebbian neural networks: a replica symmetric picture of supervised learning
- Minimax formula for the replica symmetric free energy of deep restricted Boltzmann machines
- A remark on the spherical bipartite spin glass
- Generalized hetero-associative neural networks
- Serial vs parallel recall in the Blume-Emery-Griffiths neural networks
- Some remarks on replicated simulated annealing
- Strong topological trivialization of multi-species spherical spin glasses
- Spontaneous replica symmetry breaking and interpolation methods for complex statistical mechanics systems
- Universality in bipartite mean field spin glasses
- Neural networks retrieving Boolean patterns in a sea of Gaussian ones
- Replica-symmetric theory of nonlinear analogue neural networks
- Dreaming neural networks: rigorous results
- Guerra interpolation for inverse freezing
- Replica symmetry breaking in dense Hebbian neural networks
- A thermodynamic perspective of immune capabilities
- On the equivalence of Hopfield networks and Boltzmann machines
- Storing, learning and retrieving biased patterns
- Multi-species mean field spin glasses. Rigorous results
- Statistical mechanics of learning via reverberation in bidirectional associative memories
- Supervised and unsupervised protocols for hetero-associative neural networks
- Legendre equivalences of spherical Boltzmann machines
- A replica approach to the state-dependent synapses neural network
This page was built for publication: The replica symmetric approximation of the analogical neural network
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5961874)