Information integration from distributed threshold-based interactions

DOI10.1155/2017/7046359MaRDI QIDQ2012827zbMATH OpenOpenAlexWikidataFDO

Authors Valmir C. Barbosa

Publication date 3 August 2017

Published in Complexity (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/1606.08232

zbMATH Keywords

information integrationartificial intelligence systemsbrain biological systemsdistributed threshold-based interactions

Mathematics Subject Classification ID

Signal theory (characterization, reconstruction, filtering, etc.) (94A12) Stochastic systems in control theory (general) (93E03)

Abstract: We consider a collection of distributed units that interact with one another through the sending of messages. Each message carries a positive ($+1$) or negative ($-1$) tag and causes the receiving unit to send out messages as a function of the tags it has received and a threshold. This simple model abstracts some of the essential characteristics of several systems used in the field of artificial intelligence, and also of biological systems epitomized by the brain. We study the integration of information inside a temporal window as the model's dynamics unfolds. We quantify information integration by the total correlation, relative to the window's duration ($w$), of a set of random variables valued as a function of message arrival. Total correlation refers to the rise of information gain above and beyond that which the units already achieve individually, being therefore related to consciousness studies in some models. We report on extensive computational experiments that explore the interrelations of the model's parameters (two probabilities and the threshold), highlighting relevant scenarios of message traffic and how they impact the behavior of total correlation as a function of $w$. We find that total correlation can occur at significant fractions of the maximum possible value and provide semi-analytical results on the message-traffic characteristics associated with values of $w$ for which it peaks. We then reinterpret the model's parameters in terms of the current best estimates of some quantities pertaining to cortical structure and dynamics. We find the resulting possibilities for best values of $w$ to be well aligned with the time frames within which percepts are thought to be processed and eventually rendered conscious.

Recommendations

• Information integration in elementary cellular automata
• Geometry of information integration
• The Local Information Dynamics of Distributed Computation in Complex Systems
• Distributed synchrony
• Consciousness is an information state

Cites work

• scientific article; zbMATH DE number 3150484 (Why is no real title available?)
• scientific article; zbMATH DE number 1961236 (Why is no real title available?)
• scientific article; zbMATH DE number 784365 (Why is no real title available?)
• scientific article; zbMATH DE number 3249395 (Why is no real title available?)
• A logical calculus of the ideas immanent in nervous activity
• Averaging entropy
• Cellular automata. A discrete universe
• Gibbs sampling in Bayesian networks
• Information Theoretical Analysis of Multivariate Correlation
• Information integration in elementary cellular automata
• Markov random fields and their applications
• Multiple mutual informations and multiple interactions in frequency data
• Neural networks and physical systems with emergent collective computational abilities
• Neurons with graded response have collective computational properties like those of two-state neurons
• Probabilistic graphical models.
• Random Geometric Graphs
• Random points associated with rectangles
• Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
• The transitive closure of a random digraph
• Threshold nets and cell-assemblies
• Training restricted Boltzmann machines: an introduction

Cited in

(2)

• The Decentralization of Information Processing in the Presence of Interactions
• Information integration in elementary cellular automata

This page was built for publication: Information integration from distributed threshold-based interactions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2012827)