Complexity through nonextensivity
From MaRDI portal
Abstract: The problem of defining and studying complexity of a time series has interested people for years. In the context of dynamical systems, Grassberger has suggested that a slow approach of the entropy to its extensive asymptotic limit is a sign of complexity. We investigate this idea further by information theoretic and statistical mechanics techniques and show that these arguments can be made precise, and that they generalize many previous approaches to complexity, in particular unifying ideas from the physics literature with ideas from learning and coding theory; there are even connections of this statistical approach to algorithmic or Kolmogorov complexity. Moreover, a set of simple axioms similar to those used by Shannon in his development of information theory allows us to prove that the divergent part of the subextensive component of the entropy is a unique complexity measure. We classify time series by their complexities and demonstrate that beyond the `logarithmic' complexity classes widely anticipated in the literature there are qualitatively more complex, `power--law' classes which deserve more attention.
Recommendations
Cites work
- A Mathematical Theory of Communication
- Entropy estimation of symbol sequences
- Field Theories for Learning Probability Distributions
- Fisher information and stochastic complexity
- scientific article; zbMATH DE number 45100 (Why is no real title available?)
- scientific article; zbMATH DE number 107774 (Why is no real title available?)
- scientific article; zbMATH DE number 1332320 (Why is no real title available?)
- Predictability, complexity, and learning
- Prediction and Entropy of Printed English
- Statistical Inference, Occam's Razor, and Statistical Mechanics on the Space of Probability Distributions
- Toward a quantitative theory of self-generated complexity
Cited in
(30)- Fluctuation spectroscopy
- On the phase space approach to complexity
- Transition matrix analysis of earthquake magnitude sequences
- Putting relative complexity estimates to work: a simple and general statistical methodology
- Coarse-grained entropy rates for characterization of complex time series
- Toward the nonequilibrium thermodynamic analog of complexity and the Jarzynski identity
- Complementarity of information obtained by Kolmogorov and Aksentijevic-Gibson complexities in the analysis of binary time series
- Characterization of time series via Rényi complexity-entropy curves
- On hidden Markov processes with infinite excess entropy
- Statistical complexity and generalized number system
- Predictive information in a nonequilibrium critical model
- Predictability, complexity, and learning
- Co-evolutionary mechanisms of emotional bursts in online social dynamics and networks
- A study of complexity in Gamma Ray Burst using the Diffusion Entropy approach
- scientific article; zbMATH DE number 5298819 (Why is no real title available?)
- scientific article; zbMATH DE number 1329898 (Why is no real title available?)
- HIGHER ORDER COMPLEXITY OF TIME SERIES
- COMPLEXITY, MULTIRESOLUTION, NON-STATIONARITY AND ENTROPIC SCALING: TEEN BIRTH THERMODYNAMICS
- Excess entropy in natural language: present state and perspectives
- Natural complexity, computational complexity and depth
- Local entropy and structure in a two-dimensional frustrated system
- Complexity from thermal instability
- Entropic nonextensivity: A possible measure of complexity
- Generalized entropy and multifractality of time-series: Relationship between order and intermittency
- Complexity, scaling, and a phase transition
- Optimal guessing under nonextensive framework and associated moment bounds
- Information theory for complex systems scientists: what, why, and how
- Local entropy and nonextensivity of networks ensemble
- Entropy embedding and fluctuation analysis in genomic manifolds
- How should complexity scale with system size?
This page was built for publication: Complexity through nonextensivity
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5951423)
