Scaling behaviour of entropy estimates

DOI10.1088/0305-4470/35/7/308MaRDI QIDQ4534809zbMATH OpenOpenAlexFDO

Authors Thomas Schürmann

Publication date 11 June 2002

Published in Journal of Physics A: Mathematical and General (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/cond-mat/0203409

zbMATH Keywords

logistic mapsymbolic dynamical systemscircle mapscaling behaviourFeigenbaum pointnon-probabilistic entropy estimation schemes

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Symbolic dynamics (37B10) Dynamical systems involving maps of the interval (37E05) Coding and information theory (compaction, compression, models of communication, encoding schemes, etc.) (aspects in computer science) (68P30)

Abstract: Entropy estimation of information sources is highly non trivial for symbol sequences with strong long-range correlations. The rabbit sequence, related to the symbolic dynamics of the nonlinear circle map at the critical point as well as the logistic map at the Feigenbaum point have been argued to exhibit long memory tails. For both dynamical systems the scaling behavior of the block entropy of order n has been shown to increase like as log(n). In contrast to probabilistic concepts, we investigate the scaling behavior of certain non-probabilistic entropy estimation schemes suggested by Lempel and Ziv in the context of algorithmic complexity and data compression. These are applied in a sequential manner with the scaling variable being the length N of the sequence. We determine the scaling law for the Lempel-Ziv entropy estimate applied to the case of the critical circle map and the logistic map at the Feigenbaum point in a binary partition.

Recommendations

• Rescaling Entropy and Divergence Rates
• On the estimation of entropy
• Entropy, large deviations, and scaling limits
• On the entropy estimators
• scientific article; zbMATH DE number 3954044
• scientific article; zbMATH DE number 1894367
• A note on entropy estimation
• Large sample behavior of entropy measures when parameters are estimated

Cited in

(8)

• SYMBOLIC DYNAMICS GENERATED BY A COMBINATION OF GRAPHS
• Non-sequential recursive pair substitutions and numerical entropy estimates in symbolic dynamical systems
• Entropy scaling of high resolution systems -- example from football
• Entropy estimation of symbol sequences
• scientific article; zbMATH DE number 4090422 (Why is no real title available?)
• Entropy of the symbolic sequence for critical circle maps.
• The golden mean as clock cycle of brain waves
• Large sample behavior of entropy measures when parameters are estimated

This page was built for publication: Scaling behaviour of entropy estimates

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4534809)