The storage capacity of the Hopfield model and moderate deviations

DOI10.1016/J.SPL.2005.06.001MaRDI QIDQ2489850zbMATH OpenOpenAlexFDO

Authors Franck Vermet, M. Löwe

Publication date 28 April 2006

Published in Statistics \& Probability Letters (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/j.spl.2005.06.001

zbMATH Keywords

Hopfiel modelmoderate deviationsneural Networksstorage capacity

Mathematics Subject Classification ID

Interacting random processes; statistical mechanics type models; percolation theory (60K35) Disordered systems (random Ising models, random Schrödinger operators, etc.) in equilibrium statistical mechanics (82B44) Neural nets applied to problems in time-dependent statistical mechanics (82C32)

Review text

In previous papers [cf. \textit{M. Löwe}, Ann. Appl. Probab. 8, No.~4, 1216--1250 (1999; Zbl 0941.60090)], it has been proved that the storage capacity of the Hopfield model is related to a moderate deviation upper bound for an empirical correlation function. The article gives an improvement of this result showing that moderate deviation upper bound for the empirical correlation function implies a bound on the storage capacity. Some examples are shown, among them are the cases of independent Ising-type patterns and independent Curie-Weiss type patterns.

Recommendations

• On the storage capacity of Hopfield models with correlated patterns
• scientific article; zbMATH DE number 1121927
• scientific article; zbMATH DE number 563663
• scientific article; zbMATH DE number 1275406
• On the storage capacity of generalized Hopfield models

Cites work

• scientific article; zbMATH DE number 3903723 (Why is no real title available?)
• scientific article; zbMATH DE number 1121933 (Why is no real title available?)
• scientific article; zbMATH DE number 1158743 (Why is no real title available?)
• scientific article; zbMATH DE number 1163210 (Why is no real title available?)
• scientific article; zbMATH DE number 1952026 (Why is no real title available?)
• Lower bounds on the restitution error in the Hopfield model
• Moderate deviations of dependent random variables related to CLT
• Neural networks and physical systems with emergent collective computational abilities
• Nondirect convergence radius and number of iterations of the Hopfield associative memory
• On the storage capacity of Hopfield models with correlated patterns
• On the storage capacity of the Hopfield model with biased patterns
• Rigorous results for the Hopfield model with many patterns
• Sharp upper bounds on perfect retrieval in the Hopfield model
• The capacity of the Hopfield associative memory

Cited in

(11)

• On a model of associative memory with huge storage capacity
• Capacity of an associative memory model on random graph architectures
• Effect of spatial correlations on Hopfield neural network and dense associative memories
• scientific article; zbMATH DE number 1275406 (Why is no real title available?)
• Comment on `The capacity of the Hopfield model'
• scientific article; zbMATH DE number 1121927 (Why is no real title available?)
• scientific article; zbMATH DE number 919589 (Why is no real title available?)
• Sharp upper bounds on perfect retrieval in the Hopfield model
• Capacity bounds for the CDMA system and a neural network: a moderate deviations approach
• The swapping algorithm for the Hopfield model with two patterns
• On the capacity of an associative memory model based on neural cliques

This page was built for publication: The storage capacity of the Hopfield model and moderate deviations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2489850)