The storage capacity of Potts models for semantic memory retrieval

DOI10.1088/1742-5468/2005/08/P08010zbMATH Open1456.82853arXivcond-mat/0507111OpenAlexW3100753476MaRDI QIDQ4968872FDOQ4968872

E. Kropff, Alessandro Treves

Publication date: 9 July 2019

Published in: Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Abstract: We introduce and analyze a minimal network model of semantic memory in the human brain. The model is a global associative memory structured as a collection of N local modules, each coding a feature, which can take S possible values, with a global sparseness a (the average fraction of features describing a concept). We show that, under optimal conditions, the number c of modules connected on average to a module can range widely between very sparse connectivity (c/N -> 0) and full connectivity (c = N), maintaining a global network storage capacity (the maximum number p of stored and retrievable concepts) that scales like c*S^2/a, with logarithmic corrections consistent with the constraint that each synapse may store up to a fraction of a bit.

Full work available at URL: https://arxiv.org/abs/cond-mat/0507111

Recommendations

• Reducing a cortical network to a Potts model yields storage capacity estimates
• Short- and long-range connections in autoassociative memory
• What determines the capacity of autoassociative memories in the brain?
• The capacity of \(q\)-state Potts neural networks with parallel retrieval dynamics
• Vector associative memory models

zbMATH Keywords

neuronal networks (theory)spin glasses (theory)

Mathematics Subject Classification ID

Neural networks for/in biological studies, artificial life and related topics (92B20) Statistical mechanics of random media, disordered materials (including liquid crystals and spin glasses) (82D30) Dynamics of disordered systems (random Ising systems, etc.) in time-dependent statistical mechanics (82C44) Neural nets applied to problems in time-dependent statistical mechanics (82C32)

Cites Work

• An associative network with spatially organized connectivity
• Modeling Brain Function
• Short- and long-range connections in autoassociative memory
• Mean-field theory for the Q-state Potts-glass neural network with biased patterns

Cited In (5)

• How Much Is Worth to Remember? A Taxonomy Based on Petri Nets Unfoldings
• Reducing a cortical network to a Potts model yields storage capacity estimates
• The complexity of latching transitions in large scale cortical networks
• Storing structured sparse memories in a multi-modular cortical network model
• Gibbs measures of Potts model on Cayley trees: A survey and applications

This page was built for publication: The storage capacity of Potts models for semantic memory retrieval

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4968872)