Entropic nonextensivity: A possible measure of complexity
From MaRDI portal
Abstract: An updated review [1] of nonextensive statistical mechanics and thermodynamics is colloquially presented. Quite naturally the possibility emerges for using the value of q-1 (entropic nonextensivity) as a simple and efficient manner to provide, at least for some classes of systems, some characterization of the degree of what is currently referred to as complexity [2]. A few historical digressions are included as well.
The notion of entropy originated in thermodynamics, to distinguish between reversible and irreversible processes. Boltzmann's statistical physics enabled us to describe entropy in probabilistic terms, as \(-\sum p_i\cdot\log(p_i)\), where \(p_i\) are probabilities of different micro-states \(i\). Since Boltzmann, this (and related) definitions have been thoroughly experimentally confirmed -- and has led to many useful physical applications. NEWLINENEWLINENEWLINESince 1940s, the notion of entropy has also been used in information theory and data processing; in particular, a well-known maximum entropy approach enables us to reconstruct the unknown distribution from results of incomplete measurements -- as the distribution with the largest entropy among all distribution that are consistent with the given measurement results. This approach has been applied to areas ranging from image processing to physics proper. In some cases, even better results can be obtained if, instead of the traditional entropy function, we maximize a ``generalized entropy \(S_q=-\sum p_i^q\). When \(q=1+\varepsilon\) and \(\varepsilon\to 0\), then, due to \(\sum p_i=1\), we have \(S_q\approx -1-\varepsilon\cdot \sum p_i\cdot \log(p_i)\), so the results of maximizing \(S_q\) are close to the results of maximizing traditional entropy. NEWLINENEWLINENEWLINEThe author has discovered several physical situations in which maximizing generalized entropy describes the actual probabilities better than maximizing the classical entropy. The author's conclusion is that for different systems, physical entropy is indeed described by formulas with different \(q\): the more complex the system, the larger \(q\). Thus, the difference \(q-1\) can serve as a measure of the system's complexity. The author also extends several formulas from traditional statistical physics to the case of generalized entropy.
Recommendations
Cites work
- A quantitative test of Gibbs' statistical mechanics
- A simple approach to time-inhomogeneous dynamics and applications to (fast) simulated annealing
- A statistical mechanical approach to generalized statistics of quantum and classical gases
- An Introduction to Chaos in Nonequilibrium Statistical Mechanics
- Axioms and uniqueness theorem for Tsallis entropy
- Classical and quantum non-extensive statistics effects in nuclear many-body problems
- Classical spin systems with long-range interactions: universal reduction of mixing
- Convergence of simulated annealing using the generalized transition probability
- Dynamic Linear Response Theory for a Nonextensive System Based on the Tsallis Prescription
- Dynamical quasi-stationary states in a system with long-range forces
- Generalization of Shannon’s theorem for Tsallis entropy
- Generalized information functions
- scientific article; zbMATH DE number 1381973 (Why is no real title available?)
- scientific article; zbMATH DE number 51868 (Why is no real title available?)
- scientific article; zbMATH DE number 52520 (Why is no real title available?)
- scientific article; zbMATH DE number 3623432 (Why is no real title available?)
- scientific article; zbMATH DE number 1160035 (Why is no real title available?)
- scientific article; zbMATH DE number 3284914 (Why is no real title available?)
- scientific article; zbMATH DE number 3307991 (Why is no real title available?)
- scientific article; zbMATH DE number 3327849 (Why is no real title available?)
- scientific article; zbMATH DE number 3025567 (Why is no real title available?)
- scientific article; zbMATH DE number 3073200 (Why is no real title available?)
- scientific article; zbMATH DE number 3093752 (Why is no real title available?)
- Impacts of noise on a field theoretical model of the human brain.
- Itō-Langevin equations within generalized thermostatistics
- Maximum entropy versus minimum enstrophy vortices
- Non-equilibrium thermodynamics and anomalous diffusion
- Non-extensive statistics and solar neutrinos
- Nonadditive conditional entropy and its significance for local realism
- Nonuniqueness of canonical ensemble theory arising from microcanonical basis
- Optimality, entropy and complexity for nonextensive quantum scattering
- Possible generalization of Boltzmann-Gibbs statistics.
- Power-law sensitivity to initial conditions---new entropic representation
- Scale-invariant random-walks and optimization of non-extensive entropy
- The rate of entropy increase at the edge of chaos
- The renormalization group and optimization of entropy
- The thermodynamics of phase equilibrium
- Tsallis statistics and turbulence
Cited in
(68)- On some entropy functionals derived from Rényi information divergence
- Renyi entropy as a statistical entropy for complex systems
- An approach to the physics of complexity
- Parameterized entropy analysis of EEG following hypoxic-ischemic brain injury
- Possibilistic and probabilistic fuzzy clustering: Unification within the framework of the non-extensive thermostatistics
- Model-free derivations of the Tsallis factor: constant heat capacity derivation
- Compression and diffusion: a joint approach to detect complexity.
- Unnormalized nonextensive expectation value and zeroth law of thermodynamics
- On the thermodynamic stability conditions of Tsallis' entropy
- Non-extensive statistical analysis of magnetic field during the March 2012 ICME event using a multi-spacecraft approach
- Maximum Tsallis entropy with generalized Gini and Gini mean difference indices constraints
- Quantitative assessment of increasing complexity
- Advancing Shannon entropy for measuring diversity in systems
- Multiscale multifractal diffusion entropy analysis of financial time series
- Tsallis non-extensive statistics and solar wind plasma complexity
- Effects of site dilution on the one-dimensional long-range bond-percolation problem
- Statistical approaches on the apparent horizon entropy and the generalized second law of thermodynamics
- Toward the nonequilibrium thermodynamic analog of complexity and the Jarzynski identity
- Statistical analysis of geopotential height (GH) timeseries based on Tsallis non-extensive statistical mechanics
- Global regionalized seismicity in view of non-extensive statistical physics
- On the spectrum of plasma modes in a field-free pair plasma: dispersion and Landau damping in Tsallis statistics
- Statistical complexity without explicit reference to underlying probabilities
- Tsallis non-extensive statistics and multifractal analysis of the dynamics of a fully-depleted MOSFET nano-device
- Non-Gaussian thermostatistical considerations upon the Saha equation
- Fluctuation theorems in \(q\)-canonical ensembles
- On parametric evenness measures
- A box-covering Tsallis information dimension and non-extensive property of complex networks
- Approach of complexity in nature: entropic nonuniqueness
- Evolution of the entropy and Renyi difference information during self-organization of open additive systems
- GeoEntropy: a measure of complexity and similarity
- The limit distribution of evolving strategies in financial markets
- Planckian information \((I_{p})\): a new measure of order in atoms, enzymes, cells, brains, human societies, and the cosmos
- Information entropy as a basic building block of complexity theory
- Statistical mechanics and information-theoretic perspectives on complexity in the Earth system
- Co-evolutionary mechanisms of emotional bursts in online social dynamics and networks
- On entropy of a Pareto distribution in the presence of outliers
- Planckian information \((I_{P})\): a measure of the order in complex systems
- Tsallis and Kaniadakis statistics from the viewpoint of entropic gravity formalism
- A generalized statistical complexity measure: applications to quantum systems
- scientific article; zbMATH DE number 4059280 (Why is no real title available?)
- scientific article; zbMATH DE number 176035 (Why is no real title available?)
- scientific article; zbMATH DE number 1114415 (Why is no real title available?)
- COMPLEXITY, MULTIRESOLUTION, NON-STATIONARITY AND ENTROPIC SCALING: TEEN BIRTH THERMODYNAMICS
- A statistical complexity measure with nonextensive entropy and quasi-multiplicativity
- Complexity measure: a quantum information approach
- Universality of first and second order phase transition in solar activity: evidence for nonextensive Tsallis statistics
- A revision of coding theory for learning from language
- Asymptotically scale-invariant occupancy of phase space makes the entropy S q extensive
- Non-Boltzmannian entropies for complex classical systems, quantum coherent states and black holes
- TOWARDS POSSIBLE NON-EXTENSIVE THERMODYNAMICS OF ALGORITHMIC PROCESSING — STATISTICAL MECHANICS OF INSERTION SORT ALGORITHM
- Generalized conditional entropy -- determinicity of a process and Rokhlin's formula
- Complexity through nonextensivity
- Universal behaviour in the static and dynamic properties of the \(\alpha\)-\(XY\) model
- Optimality, entropy and complexity for nonextensive quantum scattering
- Fingerprints of nonextensive thermodynamics in a long-range Hamiltonian system
- Nonsymmetric entropy and maximum nonsymmetric entropy principle
- Generalized entropic structures and non-generality of Jaynes' formalism
- Dimensional measures of generalized entropy
- Nonlinear Fokker-Planck equations, H-theorem, and entropies
- Tsallis distribution as a standard maximum entropy solution with `tail' constraint
- Local entropy and nonextensivity of networks ensemble
- Sequential effect algebras dynamical systems: the generalized -Tsallis's entropy approach and it's invariance
- From modified Tsallis-Rényi entropy to a MOND-like force law, Bekenstein bound, and Landauer principle for black holes
- Bekenstein bound on black hole entropy in non-Gaussian statistics
- Generalized entropies and black hole area quantization from Landauer's principle
- Is the entropy S_q extensive or nonextensive?
- Towards a unifying approach to diversity measures: bridging the gap between the Shannon entropy and Rao's quadratic index
- \(\beta\)-entropy for Pareto-type distributions and related weighted distributions
This page was built for publication: Entropic nonextensivity: A possible measure of complexity
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5954860)
