Phase diagram and storage capacity of sequence processing neural networks

DOI10.1088/0305-4470/31/43/005MaRDI QIDQ4486352zbMATH OpenOpenAlexFDO

Authors Alexander Düring, A. C. C. Coolen, David Sherrington

Publication date 18 June 2001

Published in Journal of Physics A: Mathematical and General (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/cond-mat/9805073

zbMATH Keywords

dynamics of Hopfield-type neural networks

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20) Neural nets applied to problems in time-dependent statistical mechanics (82C32)

Abstract: We solve the dynamics of Hopfield-type neural networks which store sequences of patterns, close to saturation. The asymmetry of the interaction matrix in such models leads to violation of detailed balance, ruling out an equilibrium statistical mechanical analysis. Using generating functional methods we derive exact closed equations for dynamical order parameters, viz. the sequence overlap and correlation- and response functions, in the thermodynamic limit. We calculate the time translation invariant solutions of these equations, describing stationary limit-cycles, which leads to a phase diagram. The effective retarded self-interaction usually appearing in symmetric models is here found to vanish, which causes a significantly enlarged storage capacity of $alph{a}_{c}sim0.269$, compared to $alph{a}_{c}sim0.139$ for Hopfield networks storing static patterns. Our results are tested against extensive computer simulations and excellent agreement is found.

Recommendations

• Cycles in symmetric sequence processing
• Storage capacity of a neural network with state-dependent synapses
• Mean-field dynamics of sequence processing neural networks with finite connectivity
• scientific article; zbMATH DE number 1121927
• Competition between pattern reconstruction and sequence processing in nonsymmetric neural networks

Cited in

(15)

• Exponentially long orbits in Hopfield neural networks
• Information storage matrices in neural networks
• Spatial distribution of patterns and the Hopfield network phase space geometry
• Increased storage capacity for hierarchically structured information in a neural network of Ising type
• Symmetric sequence processing in a recurrent neural network model with a synchronous dynamics
• Memory Capacity for Sequences in a Recurrent Network with Biological Constraints
• STORING LIMIT CYCLES USING DELAYED FEEDBACK NEURAL NETWORKS
• Transient dynamics for sequence processing neural networks
• Dynamics of Sequence-Associative Memory for Discrete Maps in XY Spin Systems
• scientific article; zbMATH DE number 2226648 (Why is no real title available?)
• Onset of 'super retrieval phase' and enhancement of the storage capacity in neural networks of nonmonotonic neurons
• Sequence Memory Based on Coherent Spin-Interaction Neural Networks
• Cycles in symmetric sequence processing
• Mean-field dynamics of sequence processing neural networks with finite connectivity
• Associative memory by recurrent neural networks with delay elements

This page was built for publication: Phase diagram and storage capacity of sequence processing neural networks

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4486352)