A characterization of entropy in terms of information loss (Q400959)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | A characterization of entropy in terms of information loss |
scientific article |
Statements
A characterization of entropy in terms of information loss (English)
0 references
26 August 2014
0 references
There are a slew of characterizations of Shannon entropy [\textit{C. E. Shannon}, Bell Syst. Tech. J. 27, 379--423, 623--656 (1948; Zbl 1154.94303)] and Tsallis entropy [\textit{C. Tsallis}, J. Stat. Phys. 52, No. 1--2, 479--487 (1988; Zbl 1082.82501)] as measures of information pervious to certain properties. Making use of the work by \textit{D. K. Faddeev} [Usp. Mat. Nauk 11, No. 1(67), 227--231 (1956; Zbl 0071.13103)] and \textit{S. Furuichi} [IEEE Trans. Inf. Theory 51, No. 10, 3638--3645 (2005; Zbl 1298.94038)], this paper derives a pretty simple characterization. The main result is that Shannon entropy is the only concept of information loss that is functorial, convex-linear and continuous, which is to be naturally generalized to Tsallis entropy as well.
0 references
Shannon entropy
0 references
Tsallis entropy
0 references
information theory
0 references
measure-preserving function
0 references