A Monte Carlo estimation of the entropy for Markov chains

DOI10.1007/S11009-006-9010-6MaRDI QIDQ2642483zbMATH OpenOpenAlexFDO

Authors Didier Chauveau, P. Vandekerkhove

Publication date 17 August 2007

Published in Methodology and Computing in Applied Probability (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/s11009-006-9010-6

zbMATH Keywords

Markov chainsStabilityEntropyKullback informationRate in central limit theorems

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Central limit and other weak theorems (60F05) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)

Recommendations

• Estimation of the Entropy Rate of a Countable Markov Chain
• Estimation of the entropy rate of ergodic Markov chains
• Computation and Estimation of Generalized Entropy Rates for Denumerable Markov Chains
• Monte-Carlo approximation of minimum entropy measures
• Maximum entropy estimation of transition probabilities of reversible Markov chains
• The entropy of Markov trajectories
• The Entropy of Conditional Markov Trajectories
• Maximum entropy for countable Markov chains
• scientific article; zbMATH DE number 3139241
• Entropy Rate and Maximum Entropy Methods for Countable Semi-Markov Chains

Cites work

• scientific article; zbMATH DE number 3656968 (Why is no real title available?)
• scientific article; zbMATH DE number 741240 (Why is no real title available?)
• scientific article; zbMATH DE number 1047461 (Why is no real title available?)
• scientific article; zbMATH DE number 922427 (Why is no real title available?)
• Approximation Theorems of Mathematical Statistics
• Best asymptotic normality of the kernel density entropy estimator for smooth densities
• Central limit theorem for nonlinear filtering and interacting particle systems
• Entropy expressions and their estimators for multivariate distributions
• Entropy jumps in the presence of a spectral gap
• On contraction properties of Markov kernels
• Probability Inequalities for Sums of Independent Random Variables
• When does Edgeworth beat Berry and Esséen? Numerical evaluations of Edgeworth expansions

Cited in

(10)

• Comparative construction of plug-in estimators of the entropy rate of two-state Markov chains
• Estimation of the Entropy Rate of a Countable Markov Chain
• The entropy of Markov trajectories
• Consistent and asymptotically normal parameter estimates for hidden Markov mixtures of Markov models
• On convergence rate of the Shannon entropy rate of ergodic Markov chains via sample-path simulation
• Estimation of the entropy rate of ergodic Markov chains
• ENTROPY OF RANDOM VARIABLE SEQUENCE IN A PARTICULAR MARKOV CHAIN
• Smoothness of Metropolis-Hastings algorithm and application to entropy estimation
• kth‐order Markov chain‐based approximation of the Shannon entropy of Gaussian photon‐counting processes
• Estimation using plug-in of the stationary distribution and Shannon entropy of continuous time Markov processes

This page was built for publication: A Monte Carlo estimation of the entropy for Markov chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2642483)