A sandwich proof of the Shannon-McMillan-Breiman theorem

DOI10.1214/AOP/1176991794zbMATH Open0653.28013OpenAlexW2033672007MaRDI QIDQ1107656FDOQ1107656

Authors: Paul H. Algoet, Thomas M. Cover 

Publication date: 1988

Published in: The Annals of Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aop/1176991794

Recommendations

• The strong ergodic theorem for densities: Generalized Shannon-McMillan- Breiman theorem
• Generalizations of Shannon-McMillan theorem
• A note on generalizations of Shannon-McMillan theorem
• Un théorème ergodique presque sous-additif. (An almost subadditive ergodic theorem)
• scientific article; zbMATH DE number 1234984

zbMATH Keywords

marginal distributionreference measurestationary ergodic processergodic theorem of information theorygeneralization of the Shannon-McMillan-Breiman theoremPolish state spacerelative entropy ratesandwiching

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Strong limit theorems (60F15) Measure-preserving transformations (28D05)

Cited In (62)

• Strong laws of large numbers for the \(m\)th-order asymptotic odd-even Markov chains indexed by an \(m\)-rooted Cayley tree
• Strong Law of Large Numbers for Countable Asymptotic Circular Markov Chains
• The asymptotic equipartition property of Markov chains in single infinite Markovian environment on countable state space
• The Markov approximation of the sequences of \(N\)-valued random variables and a class of small deviation theorems.
• Kullback-Leibler Approach to CUSUM Quickest Detection Rule for Markovian Time Series
• Sup-sums principles for \(F\)-divergence and a new definition for \(t\)-entropy
• Shannon's theorem for locally compact groups
• Cooperation evolution in random multiplicative environments
• Bounds on Data Compression Ratio with a Given Tolerable Error Probability
• A maximal entropy stochastic process for a timed automaton
• Generalizations of Shannon-McMillan theorem
• Optimal data compression algorithm
• The strong law of large numbers and the Shannon-McMillan theorem for the \(m\)th-order nonhomogeneous Markov chains indexed by an \(m\) rooted Cayley tree
• Ergodic theorems for extended real-valued random variables
• Some research on Shannon-McMillan theorem for \(m\)th-order nonhomogeneous Markov information source
• Convergence in the Cesàro sense and strong law of large numbers for nonhomogeneous Markov chains
• Entropy and compression: a simple proof of an inequality of Khinchin-Ornstein-Shields
• Shannon entropy: a rigorous notion at the crossroads between probability, information theory, dynamical systems and statistical physics
• THE SHANNON–MCMILLAN THEOREM FOR MARKOV CHAINS INDEXED BY A CAYLEY TREE IN RANDOM ENVIRONMENT
• A general threshold stress hybrid hazard model for lifetime data
• Tree-indexed Markov chains in random environment and some of their strong limit properties
• A class of small deviation theorems for the random variables associated withmth-order asymptotic circular Markov chains
• Measures of full dimension on affine-invariant sets
• Embolic aspects of black hole entropy
• Universal coding and prediction on ergodic random points
• Asymptotic reversibility of thermal operations for interacting quantum spin systems via generalized quantum Stein's lemma
• Title not available (Why is that?)
• Concentration of the information in data with log-concave distributions
• On strong limit theorems concerning delayed sums of a random sequence
• Dynamics of Bayesian updating with dependent data and misspecified models
• The generalized entropy ergodic theorem for nonhomogeneous bifurcating Markov chains indexed by a binary tree
• The generalized entropy ergodic theorem for nonhomogeneous Markov chains
• Universal Data Compression Algorithm Based on Approximate String Matching
• A class of strong deviation theorems for the random fields associated with nonhomogeneous Markov chains indexed by a Bethe tree
• Rates of convergence for empirical processes of stationary mixing sequences
• The strong law of large numbers and Shannon-McMillan theorem for Markov chains indexed by an infinite tree with uniformly bounded degree in random environment
• Entropy statistic theorem and variational principle for \(t\)-entropy are equivalent
• On moving averages and asymptotic equipartition of information
• A strong limit theorem for functions of continuous random variables and an extension of the Shannon-McMillan theorem
• The strong ergodic theorem for densities: Generalized Shannon-McMillan- Breiman theorem
• Markov approximation and the generalized entropy ergodic theorem for non-null stationary process
• Non-parametric change-point estimation using string matching algorithms
• A class of strong deviation theorems for the random fields associated with bifurcating Markov chains indexed by a binary tree
• Strong deviation theorems for general information sources
• Variational principle for weighted topological pressure
• Some generalized strong limit theorems for Markov chains in bi-infinite random environments
• A confidence-set approach to signal denoising
• From information scaling of natural images to regimes of statistical models
• THE STRONG LIMIT THEOREM FOR RELATIVE ENTROPY DENSITY RATES BETWEEN TWO ASYMPTOTICALLY CIRCULAR MARKOV CHAINS
• Strong law of large numbers for countable nonhomogeneous Markov chains
• Bayesian estimation of dynamic finite mixtures
• Mixture estimation with state-space components and Markov model of switching
• A local convergence theorem for partial sums of stochastic adapted sequences
• Some limit properties for the \(m\)th-order nonhomogeneous Markov chains indexed by an m rooted Cayley tree
• Asymptotic entropy of random walks on Fuchsian buildings and Kac-Moody groups
• Pressure at infinity and strong positive recurrence in negative curvature
• A Short Note on Almost Sure Convergence of Bayes Factors in the General Set-Up
• Strong Shannon–McMillan–Breiman’s theorem for locally compact groups
• On a functional of the number of nonoverlapping chains appearing in the polynomial scheme and its connection with entropy
• The asymptotic equipartition property for a special Markov random field
• The generalized entropy ergodic theorem with two types of convergence for \(m\)-th-order nonhomogeneous hidden Markov models
• On strong deviation theorems concerning array of dependent random sequence

This page was built for publication: A sandwich proof of the Shannon-McMillan-Breiman theorem

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1107656)