Anatomy of a bit: information in a time series observation
From MaRDI portal
(Redirected from Publication:5264346)
Abstract: Appealing to several multivariate information measures---some familiar, some new here---we analyze the information embedded in discrete-valued stochastic time series. We dissect the uncertainty of a single observation to demonstrate how the measures' asymptotic behavior sheds structural and semantic light on the generating process's internal information dynamics. The measures scale with the length of time window, which captures both intensive (rates of growth) and subextensive components. We provide interpretations for the components, developing explicit relationships between them. We also identify the informational component shared between the past and the future that is not contained in a single observation. The existence of this component directly motivates the notion of a process's effective (internal) states and indicates why one must build models.
Recommendations
- Predictability, complexity, and learning
- A geometric analysis of time series leading to information encoding and a new entropy measure
- scientific article; zbMATH DE number 1544062
- On Information/Entropy Flow in Stochastic Dynamical Systems
- Information measures, effective complexity, and total information
Cites work
- A new outlook on Shannon's information measures
- Computational mechanics: pattern and prediction, structure and simplicity.
- Elements of Information Theory
- Information Theoretical Analysis of Multivariate Correlation
- Multi-information in the thermodynamic limit
- Multiple mutual informations and multiple interactions in frequency data
- Prediction, retrodiction, and the amount of information stored in the present
- Predictive information in Gaussian processes with application to music analysis
- Quantifying emergence in terms of persistent mutual information
- Regularities unseen, randomness observed: Levels of entropy convergence
- Structural Information in Self-Organizing Systems
- Synchronization and control in intrinsic and designed computation: An information-theoretic analysis of competing models of stochastic computation
Cited in
(19)- Synergy, redundancy, and multivariate information measures: an experimentalist's perspective
- Uncertainty in epidemic models based on a three-sided coin
- Assessing pandemic uncertainty on conditions of vaccination and self-isolation
- Prediction and dissipation in nonequilibrium molecular sensors: conditionally Markovian channels driven by memoryful environments
- Exact complexity: the spectral decomposition of intrinsic computation
- Informational and causal architecture of continuous-time renewal processes
- Five years of phase space dynamics of the Standard \& Poor's 500
- A statistical approach to the global structure of John Cage's Number Piece \({\mathit Five}^5\)
- Information anatomy of stochastic equilibria
- Information accessibility and cryptic processes
- Spectral simplicity of apparent complexity. I: The nondiagonalizable metadynamics of prediction
- The fundamental thermodynamic bounds on finite models
- Information symmetries in irreversible processes
- How hidden are hidden processes? A primer on crypticity and entropy convergence
- A Pandemic Three-Sided Coin
- On principles of emergent organization
- Evolving higher-order synergies reveals a trade-off between stability and information-integration capacity in complex systems
- Information theory for complex systems scientists: what, why, and how
- Simple physical systems as a reference for multivariate information dynamics
This page was built for publication: Anatomy of a bit: information in a time series observation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5264346)
