Renyi's divergence and entropy rates for finite alphabet Markov sources

DOI10.1109/18.923736MaRDI QIDQ4544589zbMATH OpenOpenAlexFDO

Authors Ziad Rached, Fady Alajaji, L. Lorne Campbell

Publication date 4 August 2002

Published in IEEE Transactions on Information Theory (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1109/18.923736

zbMATH Keywords

Kullback-Leibler divergence ratePerron-Frobenius theoryRényi divergence rateRényi's entropy ratessource codingtime-invariant Markov sources

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Measures of information, entropy (94A17) Source coding (94A29)

Recommendations

• The Kullback–Leibler Divergence Rate Between Markov Sources
• Some properties of Rényi entropy and Rényi entropy rate
• scientific article; zbMATH DE number 6990779
• A NOTE ON RÉNYI'S ENTROPY RATE FOR TIME-INHOMOGENEOUS MARKOV CHAINS
• The comparison between an arbitrary information source and Markov chains and its limit properties

Cited in

(16)

• Weighted closed form expressions based on escort distributions for Rényi entropy rates of Markov chains
• Different closed-form expressions for generalized entropy rates of Markov chains
• Some properties of Rényi entropy and Rényi entropy rate
• Relative entropy via non-sequential recursive pair substitution
• The comparison between an arbitrary information source and Markov chains and its limit properties
• The Kullback–Leibler Divergence Rate Between Markov Sources
• Some properties of Rényi entropy over countably infinite alphabets
• scientific article; zbMATH DE number 6990779 (Why is no real title available?)
• Entropy and divergence rates for Markov chains. III: The Cressie and Read case and applications
• A NOTE ON RÉNYI'S ENTROPY RATE FOR TIME-INHOMOGENEOUS MARKOV CHAINS
• Odd-Burr generalized family of distributions with some applications
• Shannon entropy: a rigorous notion at the crossroads between probability, information theory, dynamical systems and statistical physics
• On discrete-time multiallelic evolutionary dynamics driven by selection
• Geometric reduction for identity testing of reversible Markov chains
• Symbolic transfer entropy rate is equal to transfer entropy rate for bivariate finite-alphabet stationary ergodic Markov processes
• Rényi divergence in hidden Markov models

This page was built for publication: Renyi's divergence and entropy rates for finite alphabet Markov sources

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4544589)