A Note on the Ergodic Theorem of Information Theory

From MaRDI portal
Publication:5724260

DOI10.1214/aoms/1177705069zbMath0115.35503OpenAlexW2061539524MaRDI QIDQ5724260

Kai Lai Chung

Publication date: 1961

Published in: The Annals of Mathematical Statistics (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aoms/1177705069



Related Items

Entropy Rate and Maximum Entropy Methods for Countable Semi-Markov Chains, On convergence of information in spaces with infinite invariant measure, The Markov approximation of the sequences of \(N\)-valued random variables and a class of small deviation theorems., On the ergodic theory of Tanaka-Ito type \(\alpha \)-continued fractions, UNIVERSAL CODING AND PREDICTION ON ERGODIC RANDOM POINTS, An entropy problem of the \(\alpha \)-continued fraction maps, THE SHANNON–MCMILLAN THEOREM FOR MARKOV CHAINS INDEXED BY A CAYLEY TREE IN RANDOM ENVIRONMENT, Entrance time and Rényi entropy, A limit theorem for the entropy density of nonhomogeneous Markov information source, THE STRONG LIMIT THEOREM FOR RELATIVE ENTROPY DENSITY RATES BETWEEN TWO ASYMPTOTICALLY CIRCULAR MARKOV CHAINS, The generalized entropy ergodic theorem for nonhomogeneous Markov chains, Some ergodic properties of multi-dimensional f-expansions, The strong law of large numbers and Shannon-McMillan theorem for Markov chains indexed by an infinite tree with uniformly bounded degree in random environment, Some generalized strong limit theorems for Markov chains in bi-infinite random environments, An extension of Shannon-McMillan theorem and some limit properties for nonhomogeneous Markov chains, Markov approximation and the generalized entropy ergodic theorem for non-null stationary process, The asymptotic equipartition property of Markov chains in single infinite Markovian environment on countable state space, The generalized entropy ergodic theorem for nonhomogeneous bifurcating Markov chains indexed by a binary tree, Entropy and compression: a simple proof of an inequality of Khinchin-Ornstein-Shields, The Comparison between Arbitrary Information Sources and Memoryless Information Sources and its Limit Properties, Strong laws of large numbers for the mth-order asymptotic odd–even Markov chains indexed by an m-rooted Cayley tree, A strong limit theorem for functions of continuous random variables and an extension of the Shannon-McMillan theorem, Unnamed Item, THE ASYMPTOTIC EQUIPARTITION PROPERTY FOR ASYMPTOTIC CIRCULAR MARKOV CHAINS, Prediction for discrete time series, Some limit properties for the \(m\)th-order nonhomogeneous Markov chains indexed by an m rooted Cayley tree, Estimation of the Entropy Rate of a Countable Markov Chain, Variational principle for weighted topological pressure, The Asymptotic Equipartition Property for a Nonhomogeneous Markov Information Source, A class of strong limit theorems for countable nonhomogeneous Markov chains on the generalized gambling system, The information cocycle and \(\varepsilon\)-bounded codes, The strong law of large numbers and the Shannon-McMillan theorem for the mth-order nonhomogeneous Markov chains indexed by an m rooted Cayley tree, Generalized degrees of automorphism and entropy, Unnamed Item, A class of small deviation theorems for the random variables associated withmth-order asymptotic circular Markov chains, Some Research on Shannon–McMillan Theorem formth-Order Nonhomogeneous Markov Information Source, Tree-indexed Markov chains in random environment and some of their strong limit properties, Some remarks concerning the individual ergodic theorem of information theory, Entropy and dimension of disintegrations of stationary measures, The dimension of some sets defined in terms of f-expansions, THE CENTRAL LIMIT THEOREM FOR UNIFORMLY STRONG MIXING MEASURES, Hausdorff dimension of some continued-fraction sets