Effect of spatial correlations on Hopfield neural network and dense associative memories (Q2685098)

The article is devoted to an investigation on the storage capacity of a Hopfield Neural Network system. One analysis the behavior of the HNN in the presence of patterns generated by a one-dimensional Ising model at inverse temperature \(\beta\) and by using a signal-to-noise technique. In the second section of the paper the signal to noise technique is introduced and is applied to Hopfield neural networks as well as DAMs (Dense Associative Memory) fed with uncorrelated Rademacher Patterns. One defines the mathematical model of the neural network, the Hamiltonian of the system and the Mattis magnetization. One shows for instance, that the neural network can store in a DAM with $p$-bodies interaction, up to O(\(N^{p-1} \)), where $N$ is the number of neurons, patterns. In the third section one investigates the behavior of a HNN in case it is fed with correlated patterns which actually mostly model real data. The Signal to noise technique is applied and analytical results are compared with numerical simulations. The results obtained in this section for Hopfield neural networks are generalized, in the fourth section, to Dense Associative Memories fed with correlated patterns. In the fifth section, some Conclusions are presented. Detailed computations for HNN are to be found in Appendix A, detailed computations for the dense associative memories can be found in Appendix B and detailed finite size scaling analysis along the transition curve for $p=2$ are presented in Appendix C.