Tsallis entropy and generalized Shannon additivity

DOI10.3390/AXIOMS6020014MaRDI QIDQ2275124zbMATH OpenOpenAlexFDO

Authors Sonja Jäckle, Karsten Keller

Publication date 2 October 2019

Published in Axioms (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/1704.08011

zbMATH Keywords

additivityaxiomaticsShannon entropyTsallis entropy

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Measures of information, entropy (94A17)

Abstract: The Tsallis entropy given for a positive parameter $alpha$ can be considered as a modification of the classical Shannon entropy. For the latter, corresponding to $alpha=1$, there exist many axiomatic characterizations. One of them based on the well-known Khinchin-Shannon axioms has been simplified several times and adapted to Tsallis entropy, where the axiom of (generalized) Shannon additivity is playing a central role. The main aim of this paper is to discuss this axiom in the context of Tsallis entropy. We show that it is sufficient for characterizing Tsallis entropy with the exceptions of cases $alpha=1,2$ discussed separately.

Review text

Summary: The Tsallis entropy given for a positive parameter \(\alpha\) can be considered as a generalization of the classical Shannon entropy. For the latter, corresponding to \(\alpha = 1\), there exist many axiomatic characterizations. One of them based on the well-known Khinchin-Shannon axioms has been simplified several times and adapted to Tsallis entropy, where the axiom of (generalized) Shannon additivity is playing a central role. The main aim of this paper is to discuss this axiom in the context of Tsallis entropy. We show that it is sufficient for characterizing Tsallis entropy, with the exceptions of cases \(\alpha = 1, 2\) discussed separately.

Recommendations

• Generalization of Shannon’s theorem for Tsallis entropy
• Generalized Shannon inequalities based on Tsallis relative operator entropy
• BOLTZMANN–SHANNON ENTROPY: GENERALIZATION AND APPLICATION
• Khinchin-Shannon generalized inequalities for ``non-additive entropy measures
• Generalized Shannon-Khinchin axioms and uniqueness theorem for pseudo-additive entropies
• Generalizations of operator Shannon inequality based on Tsallis and Rényi relative entropies
• Information theoretical properties of Tsallis entropies
• The additivity of the pseudo-additive conditional entropy for a proper Tsallis' entropic index
• A Generalization of Majorization that Characterizes Shannon Entropy

Cites work

• A Mathematical Theory of Communication
• An axiomatic definition of Shannon's entropy
• Approach of complexity in nature: entropic nonuniqueness
• Axiomatic characterizations of information measures
• Generalization of Shannon–Khinchin Axioms to Nonextensive Systems and the Uniqueness Theorem for the Nonextensive Entropy
• Generalization of Shannon’s theorem for Tsallis entropy
• scientific article; zbMATH DE number 3118807 (Why is no real title available?)
• scientific article; zbMATH DE number 3143967 (Why is no real title available?)
• scientific article; zbMATH DE number 3284914 (Why is no real title available?)
• On entropy, entropy-like quantities, and applications
• On Uniqueness Theorems for Tsallis Entropy and Tsallis Relative Entropy
• Possible generalization of Boltzmann-Gibbs statistics.
• The role of boundedness in characterizing shannon entropy
• Tsallis entropy: how unique?

Cited in

(8)

• A generalization of the Havrda-Charvat and Tsallis entropy and its axiomatic characterization
• Remarks on the pseudo-additivity in the axiomatization of Tsallis entropy
• Tsallis entropy: axiomatic characterization and application
• BOLTZMANN–SHANNON ENTROPY: GENERALIZATION AND APPLICATION
• Information theoretical properties of Tsallis entropies
• A rooted tree whose lower bound of average description length is given by Tsallis entropy
• Generalization of Shannon–Khinchin Axioms to Nonextensive Systems and the Uniqueness Theorem for the Nonextensive Entropy
• scientific article; zbMATH DE number 3970671 (Why is no real title available?)

This page was built for publication: Tsallis entropy and generalized Shannon additivity

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2275124)