On the Entropy Rate of Pattern Processes

DOI10.1109/TIT.2006.880044MaRDI QIDQ3547946zbMATH OpenFDO

Authors George M. Gemelos, Tsachy Weissman

Publication date 21 December 2008

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/cs/0504046

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Coding theorems (Shannon theory) (94A24)

Abstract: We study the entropy rate of pattern sequences of stochastic processes, and its relationship to the entropy rate of the original process. We give a complete characterization of this relationship for i.i.d. processes over arbitrary alphabets, stationary ergodic processes over discrete alphabets, and a broad family of stationary ergodic processes over uncountable alphabets. For cases where the entropy rate of the pattern process is infinite, we characterize the possible growth rate of the block entropy.

Recommendations

• On entropy rates of dynamical systems and Gaussian processes
• Entropy and recurrence rates for stationary random fields
• scientific article; zbMATH DE number 1396396
• On the spectral entropy behavior of self-organizing processes
• Pattern formations and spatial entropy for spatially discrete diffusion equations
• On a scaling entropy sequence of a dynamical system
• The entropy of Markov trajectories
• scientific article; zbMATH DE number 4020184
• Entropy of stochastic flows
• Patterns generation and spatial entropy in two-dimensional lattice models

Cited in

(12)

• The positive-divergence and blowing-up properties
• Entropy rate of product of independent processes
• Predictive rate-distortion for infinite-order Markov processes
• Relative entropy via non-sequential recursive pair substitution
• scientific article; zbMATH DE number 3876640 (Why is no real title available?)
• Limit results on pattern entropy
• Entropy of Patterns of i.i.d. Sequences—Part I: General Bounds
• Ergodic behavior of graph entropy
• Fluctuations of the Empirical Entropies of a Chain of Infinite Order
• scientific article; zbMATH DE number 934437 (Why is no real title available?)
• An Entropy Estimator for a Class of Infinite Alphabet Processes
• Entropy of a bit-shift channel

This page was built for publication: On the Entropy Rate of Pattern Processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3547946)