Multitasking attractor networks with neuronal threshold noise

DOI10.1016/J.NEUNET.2013.09.008zbMATH Open1296.82046arXiv1304.4488OpenAlexW2088147511WikidataQ44798361 ScholiaQ44798361MaRDI QIDQ461183FDOQ461183

Authors: Elena Agliari, Adriano Barra, Andrea Galluzzi, Marco Isopi 

Publication date: 10 October 2014

Published in: Neural Networks (Search for Journal in Brave)

Abstract: We consider the multitasking associative network in the low-storage limit and we study its phase diagram with respect to the noise level $T$ and the degree $d$ of dilution in pattern entries. We find that the system is characterized by a rich variety of stable states, among which pure states, parallel retrieval states, hierarchically organized states and symmetric mixtures (remarkably, both even and odd), whose complexity increases as the number of patterns $P$ grows. The analysis is performed both analytically and numerically: Exploiting techniques based on partial differential equations, allows us to get the self-consistencies for the order parameters. Such self-consistence equations are then solved and the solutions are further checked through stability theory to catalog their organizations into the phase diagram, which is completely outlined at the end. This is a further step toward the understanding of spontaneous parallel processing in associative networks.

Full work available at URL: https://arxiv.org/abs/1304.4488

Recommendations

• Associative networks with diluted patterns: dynamical analysis at low and medium load
• Retrieval properties of diluted attractor neural networks
• An associative network with spatially organized connectivity
• scientific article; zbMATH DE number 1164156
• Parallel retrieval of correlated patterns: from Hopfield networks to Boltzmann machines

zbMATH Keywords

Hopfield modelstatistical mechanicsmultitasking networks

Mathematics Subject Classification ID

Neural nets applied to problems in time-dependent statistical mechanics (82C32)

Cites Work

• Title not available (Why is that?)
• Neural networks and physical systems with emergent collective computational abilities
• Neural networks: A review from a statistical perspective. With comments and a rejoinder by the authors
• A mechanical approach to mean field spin models
• A thermodynamic perspective of immune capabilities
• On the equivalence of Hopfield networks and Boltzmann machines
• Title not available (Why is that?)
• Modeling Brain Function
• Replicated transfer matrix analysis of Ising spin models on  small world  lattices
• Finite connectivity attractor neural networks
• Parallel retrieval of correlated patterns: from Hopfield networks to Boltzmann machines

Cited In (7)

• A new mechanical approach to handle generalized Hopfield neural networks
• Non-convex multi-species Hopfield models
• Parallel learning by multitasking neural networks
• Associative networks with diluted patterns: dynamical analysis at low and medium load
• Asynchronous threshold networks with multisorted signals
• Dreaming neural networks: rigorous results
• Immune networks: multi-tasking capabilities at medium load

This page was built for publication: Multitasking attractor networks with neuronal threshold noise

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q461183)