Computational mechanics of input-output processes: structured transformations and the -transducer

DOI10.1007/S10955-015-1327-5zbMATH Open1327.82002arXiv1412.2690OpenAlexW3105627797MaRDI QIDQ892410FDOQ892410

Authors: Nix Barnett, James P. Crutchfield 

Publication date: 19 November 2015

Published in: Journal of Statistical Physics (Search for Journal in Brave)

Abstract: Computational mechanics quantifies structure in a stochastic process via its causal states, leading to the process's minimal, optimal predictor---the $epsilon$-machine. We extend computational mechanics to communication channels between two processes, obtaining an analogous optimal model---the $epsilon$-transducer---of the stochastic mapping between them. Here, we lay the foundation of a structural analysis of communication channels, treating joint processes and processes with input. The result is a principled structural analysis of mechanisms that support information flow between processes. It is the first in a series on the structural information theory of memoryful channels, channel composition, and allied conditional information measures.

Full work available at URL: https://arxiv.org/abs/1412.2690

Recommendations

• Computational mechanics: pattern and prediction, structure and simplicity.
• Reductions of hidden information sources
• Predictive models and generative complexity
• INFORMATION BOTTLENECKS, CAUSAL STATES, AND STATISTICAL RELEVANCE BASES: HOW TO REPRESENT RELEVANT INFORMATION IN MEMORYLESS TRANSDUCTION
• On the definition of stochastic λ-transducers

zbMATH Keywords

communication channelminimalitystatistical complexityoptimal predictionfinite-state transducersequential machinecausal statesubshift endomorphism

Mathematics Subject Classification ID

Statistical mechanics of random media, disordered materials (including liquid crystals and spin glasses) (82D30)

Cites Work

• The elements of statistical learning. Data mining, inference, and prediction
• Elements of Information Theory
• A Mathematical Theory of Communication
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• An Introduction to Symbolic Dynamics and Coding
• Neural networks and physical systems with emergent collective computational abilities
• Title not available (Why is that?)
• Title not available (Why is that?)
• A note on the Entscheidungsproblem
• Title not available (Why is that?)
• Predictability, complexity, and learning
• Title not available (Why is that?)
• On Computable Numbers, with an Application to the Entscheidungsproblem
• Title not available (Why is that?)
• Statistical Methods in Markov Chains
• Prediction, retrodiction, and the amount of information stored in the present
• Information theory and network coding
• Feedback systems: an introduction for scientists and engineers.
• Synchronization and control in intrinsic and designed computation: An information-theoretic analysis of competing models of stochastic computation
• \(\epsilon\)-machine spectral reconstruction theory: a direct method for inferring planar disorder and structure from X-ray diffraction studies
• Computational mechanics: pattern and prediction, structure and simplicity.
• The calculi of emergence: Computation, dynamics and induction
• Exact complexity: the spectral decomposition of intrinsic computation
• INFORMATION BOTTLENECKS, CAUSAL STATES, AND STATISTICAL RELEVANCE BASES: HOW TO REPRESENT RELEVANT INFORMATION IN MEMORYLESS TRANSDUCTION
• Optimal causal inference: estimating stored information and approximating causal architecture
• Title not available (Why is that?)
• Probability, Random Processes, and Ergodic Properties
• Title not available (Why is that?)
• Title not available (Why is that?)
• Symbolic Dynamics
• On a connection between information and group lattices
• Appendix: On Common Information and Related Characteristics of Correlated Information Sources
• The lattice theory of information
• The attractor-basin portrait of a cellular automaton
• Computational mechanics of cellular automata: an example
• Title not available (Why is that?)
• Turbulent pattern bases for cellular automata
• Causation entropy identifies indirect influences, dominance of neighbors and anticipatory couplings
• Automated pattern detection -- an algorithm for constructing optimally synchronizing multi-regular language filters
• Notes on information-lossless finite-state automata
• Proof of Shannon's Transmission Theorem for Finite-State Indecomposable Channels
• Title not available (Why is that?)
• The ergodic decomposition of stationary discrete random processes
• Identifying functional thermodynamics in autonomous Maxwellian ratchets
• Optimum design 2000. Papers at the conference optimum design 2000: prospects for the new millenium, Cardiff, GB, April 12--14, 2000. Dedicated to Valeri Fedorov on the occasion of his 60th birthday

Cited In (11)

• The fundamental thermodynamic bounds on finite models
• The stochastic thermodynamics of computation
• Surveying structural complexity in quantum many-body systems
• Non-Markovian quantum control as coherent stochastic trajectories
• INFORMATION BOTTLENECKS, CAUSAL STATES, AND STATISTICAL RELEVANCE BASES: HOW TO REPRESENT RELEVANT INFORMATION IN MEMORYLESS TRANSDUCTION
• Computational mechanics: pattern and prediction, structure and simplicity.
• Identifying functional thermodynamics in autonomous Maxwellian ratchets
• On the thermodynamical cost of some interpretations of quantum theory
• Memory cost for simulating all quantum correlations from the Peres-Mermin scenario
• Classical invasive description of informationally-complete quantum processes
• Leveraging environmental correlations: the thermodynamics of requisite variety

Uses Software

• ElemStatLearn

This page was built for publication: Computational mechanics of input-output processes: structured transformations and the \(\epsilon\)-transducer

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q892410)