Polynomially additive entropies (Q3320265)
From MaRDI portal
!
This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:
scientific article; zbMATH DE number 3850972
| Language | Label | Description | Also known as |
|---|---|---|---|
| default for all languages | No label defined |
||
| English | Polynomially additive entropies |
scientific article; zbMATH DE number 3850972 |
Statements
Polynomially additive entropies (English)
0 references
1984
0 references
additivity properties
0 references
Shannon entropy
0 references
entropy of degree alpha
0 references
sum property
0 references
measurable sum property
0 references
0.8092776536941528
0 references
Many characterizations of the Shannon entropy, \(H_ n(p_ 1,...,p_ n)=-\sum p_ i \log p_ i\) (where \((p_ 1,...,p_ n)\in \Gamma_ n=\{(p_ 1,...,p_ n)| \quad p_ i\geq 0,\quad \sum p_ i=1\}),\) make use of the property of additivity, \[ (1)\quad I_{k\ell}(p_ 1q_ 1,...,p_ 1q_{\ell},p_ 2q_ 1,...,p_ kq_{\ell})=I_ k(p_ 1,...,p_ k)+I_{\ell}(q_ 1,...,q_{\ell}), \] and the sum property \[ (2)\quad I_ k(p_ 1,...,p_ k)=\sum g(p_ i)\quad for\quad some\quad g:[0,1]\to R. \] (The latter is called the measurable sum property if g is measurable.) Similarly, many characterizations of the entropies of degree \(\alpha\), \(H_ n\!^{\alpha}(p_ 1,...,p_ n)=(2^{1-\alpha}-1)^{-1}(\sum p_ i\!^{\alpha}-1),\) make use of the additivity of degree \(\alpha\), \[ (3)\quad I_{k\ell}(p_ 1q_ 1,...,p_ kq_{\ell})= \] \[ I_ k(p_ 1,...,p_ k)+I_{\ell}(q_ 1,...,q_{\ell})+(2^{1-\alpha}-1)I_ k(p_ 1,...,p_ k)I_{\ell}(q_ 1,...,q_{\ell}), \] instead of (1). [See \textit{J. Aczél} and \textit{Z. Daróczy}, On measures of information and their characterizations (1975; Zbl 0345.94022), for discussions of these entropies, properties and characterizations.] The paper under review introduces a new property of entropies which postulates a general kind of additivity, without prescribing a priori the value of a certain parameter \(\alpha\) as is done in (1) \((\alpha =1)\) and (3). An entropy \(\{I_ n\}\) is polynomially additive if there exists some polynomial p such that \[ I_{k\ell}(p_ 1q_ 1,...,p_ kq_{\ell})=p[I_ k(p_ 1,...,p_ k),I_{\ell}(q_ 1,...,q_{\ell})] \] for all \(k,\ell =2,3,... \). It is shown that the only polynomially additive entropies with the measurable sum property and range of infinite cardinality are linear functions of the Shannon entropy, the entropies of degree \(\alpha\), or the length of the probability distribution. A more general result is proved in case the map g in (2) is not assumed to be measurable.
0 references