Polynomially additive entropies
Many characterizations of the Shannon entropy, \(H_ n(p_ 1,...,p_ n)=-\sum p_ i \log p_ i\) (where \((p_ 1,...,p_ n)\in \Gamma_ n=\{(p_ 1,...,p_ n)| \quad p_ i\geq 0,\quad \sum p_ i=1\}),\) make use of the property of additivity, \[ (1)\quad I_{k\ell}(p_ 1q_ 1,...,p_ 1q_{\ell},p_ 2q_ 1,...,p_ kq_{\ell})=I_ k(p_ 1,...,p_ k)+I_{\ell}(q_ 1,...,q_{\ell}), \] and the sum property \[ (2)\quad I_ k(p_ 1,...,p_ k)=\sum g(p_ i)\quad for\quad some\quad g:[0,1]\to R. \] (The latter is called the measurable sum property if g is measurable.) Similarly, many characterizations of the entropies of degree \(\alpha\), \(H_ n\!^{\alpha}(p_ 1,...,p_ n)=(2^{1-\alpha}-1)^{-1}(\sum p_ i\!^{\alpha}-1),\) make use of the additivity of degree \(\alpha\), \[ (3)\quad I_{k\ell}(p_ 1q_ 1,...,p_ kq_{\ell})= \] \[ I_ k(p_ 1,...,p_ k)+I_{\ell}(q_ 1,...,q_{\ell})+(2^{1-\alpha}-1)I_ k(p_ 1,...,p_ k)I_{\ell}(q_ 1,...,q_{\ell}), \] instead of (1). [See \textit{J. Aczél} and \textit{Z. Daróczy}, On measures of information and their characterizations (1975; Zbl 0345.94022), for discussions of these entropies, properties and characterizations.] The paper under review introduces a new property of entropies which postulates a general kind of additivity, without prescribing a priori the value of a certain parameter \(\alpha\) as is done in (1) \((\alpha =1)\) and (3). An entropy \(\{I_ n\}\) is polynomially additive if there exists some polynomial p such that \[ I_{k\ell}(p_ 1q_ 1,...,p_ kq_{\ell})=p[I_ k(p_ 1,...,p_ k),I_{\ell}(q_ 1,...,q_{\ell})] \] for all \(k,\ell =2,3,... \). It is shown that the only polynomially additive entropies with the measurable sum property and range of infinite cardinality are linear functions of the Shannon entropy, the entropies of degree \(\alpha\), or the length of the probability distribution. A more general result is proved in case the map g in (2) is not assumed to be measurable.
- Additive and subadditive entropies for discrete \(n\)-dimensional random vectors
- Monotonically equivalent entropies and solution of additivity equation
- A unified characterization of generalized information and certainty measures
- A representation theorem for entropies with the branching property
- Additive relations in fields: an entropy approach
- Cyclic symmetry on cyclic and noncyclic sets of probability distributions and the entropies of degree
- A characterization of generalized multinomial coefficients related to the entropic chain rule
- New rational identities for entropy involving zeros and coefficients of complex polynomials
- scientific article; zbMATH DE number 4139663 (Why is no real title available?)
- scientific article; zbMATH DE number 3895972 (Why is no real title available?)
- scientific article; zbMATH DE number 3930879 (Why is no real title available?)
- scientific article; zbMATH DE number 4047586 (Why is no real title available?)
- scientific article; zbMATH DE number 4091401 (Why is no real title available?)
- scientific article; zbMATH DE number 52520 (Why is no real title available?)
- Quasicyclic Symmetry and the Shannon Entropy
- A characterization of entropy in terms of information loss
- Properties of the entropy of multiplicative-truncated approximations of eventological distributions
- Entropy and diversity. The axiomatic approach
- Symmetric polynomials in information theory: entropy and subentropy
- A stability result concerning the Shannon entropy
- Polynomial Functors and Shannon Entropy
This page was built for publication: Polynomially additive entropies
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3320265)