Non-convex multi-species Hopfield models
From MaRDI portal
Publication:1990104
Learning and adaptive systems in artificial intelligence (68T05) Neural networks for/in biological studies, artificial life and related topics (92B20) Kinetic theory of gases in time-dependent statistical mechanics (82C40) Neural nets applied to problems in time-dependent statistical mechanics (82C32)
Abstract: In this work we introduce a multi-species generalization of the Hopfield model for associative memory, where neurons are divided into groups and both inter-groups and intra-groups pair-wise interactions are considered, with different intensities. Thus, this system contains two of the main ingredients of modern Deep neural network architectures: Hebbian interactions to store patterns of information and multiple layers coding different levels of correlations. The model is completely solvable in the low-load regime with a suitable generalization of the Hamilton-Jacobi technique, despite the Hamiltonian can be a non-definite quadratic form of the magnetizations. The family of multi-species Hopfield model includes, as special cases, the 3-layers Restricted Boltzmann Machine (RBM) with Gaussian hidden layer and the Bidirectional Associative Memory (BAM) model.
Recommendations
- scientific article; zbMATH DE number 1121933
- Stochastic Hopfield networks with multiplicative noise and jump Markov parameters
- Rigorous results for the Hopfield model with many patterns
- On the Hopfield neural networks and mean field theory
- Multistability in a class of stochastic delayed Hopfield neural networks
- scientific article; zbMATH DE number 837115
- Some rigorous results on the Hopfield neural network model
- Markovian jump delayed Hopfield networks with multiplicative noise
- Complex dynamics in simple Hopfield neural networks
Cites work
- scientific article; zbMATH DE number 1273988 (Why is no real title available?)
- scientific article; zbMATH DE number 1121933 (Why is no real title available?)
- scientific article; zbMATH DE number 1181255 (Why is no real title available?)
- scientific article; zbMATH DE number 1751767 (Why is no real title available?)
- scientific article; zbMATH DE number 6276131 (Why is no real title available?)
- scientific article; zbMATH DE number 2211481 (Why is no real title available?)
- A Fast Learning Algorithm for Deep Belief Nets
- A logical calculus of the ideas immanent in nervous activity
- A mechanical approach to mean field spin models
- A new stability criterion for bidirectional associative memory neural networks of neutral-type
- About a solvable mean field model of a Gaussian spin glass
- About the ergodic regime in the analogical Hopfield neural networks: Moments of the partition function
- An Introduction to the Modeling of Neutral Networks
- Anergy in self-directed B lymphocytes: a statistical mechanics perspective
- Deep learning
- Equilibrium statistical mechanics of bipartite spin systems
- Exponential inequalities and convergence of moments in the replica-symmetric regime of the Hopfield model.
- Finite connectivity attractor neural networks
- Fluctuation of the free energy in the Hopfield model
- Gibbs states of the Hopfield model with extensively many patterns.
- Global asymptotic stability of delayed bi-directional associative memory neural networks
- Hierarchical neural networks perform both serial and parallel processing
- High storage capacity in the Hopfield model with auto-interactions -- stability analysis
- Immune networks: multi-tasking capabilities at medium load
- Immune networks: multitasking capabilities near saturation
- Inverse problem robustness for multi-species mean-field spin models
- Legendre duality of spherical and Gaussian spin glasses
- Matrix measure strategies for stability and synchronization of inertial BAM neural network with time delays
- Metastable states in the hierarchical Dyson model drive parallel processing in the hierarchical Hopfield network
- Multi-species mean field spin glasses. Rigorous results
- Multitasking attractor networks with neuronal threshold noise
- Non-convex multipartite ferromagnets
- On the equivalence of Hopfield networks and Boltzmann machines
- Overlap synchronisation in multipartite random energy models
- Parallel retrieval of correlated patterns: from Hopfield networks to Boltzmann machines
- Phase Transitions and Sample Complexity in Bayes-Optimal Matrix Factorization
- Qualitative analysis of Bi-directional Associative Memory with time delay
- Replica symmetry breaking in mean-field spin glasses through the Hamilton-Jacobi technique
- Rigorous results for the Hopfield model with many patterns
- Rigorous results for the free energy in the Hopfield model
- Role of zero synapses in unsupervised feature learning
- Semiconcave functions, Hamilton-Jacobi equations, and optimal control
- Statistical mechanics of unsupervised feature learning in a restricted Boltzmann machine with binary synapses
- The free energy in a multi-species Sherrington-Kirkpatrick model
- The mean field Ising model trough interpolating techniques
- The replica symmetric approximation of the analogical neural network
- The replica-symmetric solution without replica trick for the Hopfield model
- The retrieval phase of the Hopfield model: A rigorous analysis of the overlap distribution
Cited in
(14)- Free energies of Boltzmann machines: self-averaging, annealed and replica symmetric approximations in the thermodynamic limit
- The relativistic Hopfield network: rigorous results
- A new mechanical approach to handle generalized Hopfield neural networks
- Nonlinear PDEs approach to statistical mechanics of dense associative memories
- Replica symmetry breaking in neural networks: a few steps toward rigorous results
- A transport equation approach for deep neural networks with quenched random weights
- Annealing and replica-symmetry in deep Boltzmann machines
- scientific article; zbMATH DE number 2109970 (Why is no real title available?)
- Dense Hopfield networks in the teacher-student setting
- Memory effects of the multi-charge network model
- Propagation of chaos and large deviations in mean-field models with jumps on block-structured networks
- Learning and retrieval operational modes for three-layer restricted Boltzmann machines
- Hopfield model with planted patterns: a teacher-student self-supervised learning model
- Statistical mechanics of learning via reverberation in bidirectional associative memories
This page was built for publication: Non-convex multi-species Hopfield models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1990104)
