The Thouless–Anderson–Palmer equation for an analogue neural network with temporally fluctuating white synaptic noise

DOI10.1088/1751-8113/40/31/002MaRDI QIDQ5757586zbMATH OpenOpenAlexFDO

Authors Akihisa Ichiki, Masatoshi Shiino

Publication date 7 September 2007

Published in Journal of Physics A: Mathematical and Theoretical (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/0706.2048

zbMATH Keywords

analog neural networkcavity methodFokker-Planck equationsself-consistent signal-to-noise analysisTAP equation

Mathematics Subject Classification ID

Stochastic methods (Fokker-Planck, Langevin, etc.) applied to problems in time-dependent statistical mechanics (82C31) Neural nets applied to problems in time-dependent statistical mechanics (82C32)

Abstract: Effects of synaptic noise on the retrieval process of associative memory neural networks are studied from the viewpoint of neurobiological and biophysical understanding of information processing in the brain. We investigate the statistical mechanical properties of stochastic analog neural networks with temporally fluctuating synaptic noise, which is assumed to be white noise. Such networks, in general, defy the use of the replica method, since they have no energy concept. The self-consistent signal-to-noise analysis (SCSNA), which is an alternative to the replica method for deriving a set of order parameter equations, requires no energy concept and thus becomes available in studying networks without energy functions. Applying the SCSNA to stochastic network requires the knowledge of the Thouless-Anderson-Palmer (TAP) equation which defines the deterministic networks equivalent to the original stochastic ones. The study of the TAP equation which is of particular interest for the case without energy concept is very few, while it is closely related to the SCSNA in the case with energy concept. This paper aims to derive the TAP equation for networks with synaptic noise together with a set of order parameter equations by a hybrid use of the cavity method and the SCSNA.

Recommendations

• Neural networks in which synaptic patterns fluctuate with time
• scientific article; zbMATH DE number 1254453
• Stochastic analyses of the dynamics of generalized Little-Hopfield-Hemmen type neural networks
• Thouless-Anderson-Palmer equations for the Ghatak-Sherrington mean field spin glass model
• Dynamical mean-field equations for a neural network with spike timing dependent plasticity

This page was built for publication: The Thouless–Anderson–Palmer equation for an analogue neural network with temporally fluctuating white synaptic noise

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5757586)