Polynomially additive entropies

From MaRDI portal





Many characterizations of the Shannon entropy, \(H_ n(p_ 1,...,p_ n)=-\sum p_ i \log p_ i\) (where \((p_ 1,...,p_ n)\in \Gamma_ n=\{(p_ 1,...,p_ n)| \quad p_ i\geq 0,\quad \sum p_ i=1\}),\) make use of the property of additivity, \[ (1)\quad I_{k\ell}(p_ 1q_ 1,...,p_ 1q_{\ell},p_ 2q_ 1,...,p_ kq_{\ell})=I_ k(p_ 1,...,p_ k)+I_{\ell}(q_ 1,...,q_{\ell}), \] and the sum property \[ (2)\quad I_ k(p_ 1,...,p_ k)=\sum g(p_ i)\quad for\quad some\quad g:[0,1]\to R. \] (The latter is called the measurable sum property if g is measurable.) Similarly, many characterizations of the entropies of degree \(\alpha\), \(H_ n\!^{\alpha}(p_ 1,...,p_ n)=(2^{1-\alpha}-1)^{-1}(\sum p_ i\!^{\alpha}-1),\) make use of the additivity of degree \(\alpha\), \[ (3)\quad I_{k\ell}(p_ 1q_ 1,...,p_ kq_{\ell})= \] \[ I_ k(p_ 1,...,p_ k)+I_{\ell}(q_ 1,...,q_{\ell})+(2^{1-\alpha}-1)I_ k(p_ 1,...,p_ k)I_{\ell}(q_ 1,...,q_{\ell}), \] instead of (1). [See \textit{J. Aczél} and \textit{Z. Daróczy}, On measures of information and their characterizations (1975; Zbl 0345.94022), for discussions of these entropies, properties and characterizations.] The paper under review introduces a new property of entropies which postulates a general kind of additivity, without prescribing a priori the value of a certain parameter \(\alpha\) as is done in (1) \((\alpha =1)\) and (3). An entropy \(\{I_ n\}\) is polynomially additive if there exists some polynomial p such that \[ I_{k\ell}(p_ 1q_ 1,...,p_ kq_{\ell})=p[I_ k(p_ 1,...,p_ k),I_{\ell}(q_ 1,...,q_{\ell})] \] for all \(k,\ell =2,3,... \). It is shown that the only polynomially additive entropies with the measurable sum property and range of infinite cardinality are linear functions of the Shannon entropy, the entropies of degree \(\alpha\), or the length of the probability distribution. A more general result is proved in case the map g in (2) is not assumed to be measurable.




Cited in
(21)








This page was built for publication: Polynomially additive entropies

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3320265)