On hidden Markov processes with infinite excess entropy

DOI10.1007/s10959-012-0468-6zbMath1296.60187arXiv1211.0834WikidataQ59397816 ScholiaQ59397816MaRDI QIDQ2248935

Łukasz Dębowski

Publication date: 27 June 2014

Published in: Journal of Theoretical Probability (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1211.0834

zbMATH Keywords

mutual information; ergodic processes; hidden Markov processes

Mathematics Subject Classification ID

60J10: Markov chains (discrete-time Markov processes on discrete state spaces)

37A25: Ergodicity, mixing, rates of mixing

94A17: Measures of information, entropy

Related Items

Generalised Partial Autocorrelations and the Mutual Information Between Past and Future

Uses Software

• ITIP

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Properties of the statistical complexity functional and partially deterministic HMMs
• Variable-length coding of two-sided asymptotically mean stationary measures
• A general definition of conditional information and its application to ergodic decomposition
• Prediction, retrodiction, and the amount of information stored in the present
• Prediction and entropy of nonlinear dynamical systems and symbolic sequences with LRO
• Entropy of the symbolic sequence for critical circle maps
• On the covariance determinants of moving-average and autoregressive models
• Information accessibility and cryptic processes
• On the strong mixing and weak Bernoulli conditions
• Hidden Markov processes
• Excess entropy in natural language: Present state and perspectives
• Mixing, Ergodic, and Nonergodic Processes With Rapidly Growing Information Between Blocks
• On the Vocabulary of Grammar-Based Codes and the Logical Consistency of Texts
• Regularities unseen, randomness observed: Levels of entropy convergence
• Computational mechanics: pattern and prediction, structure and simplicity.
• Complexity through nonextensivity