scientific article; zbMATH DE number 1765864
As typical we quote the first result: Let \(p_k>0, q_k>0 (k=1,\dots ,n), \sum^n p_k=\sum^n q_k=1\). Then \[ \sum^n p_k \ln(p_k/q_k)\leq \ln\Bigl[\sum^n (p_k^2/q_k)\Bigr] \leq \sum^n \Bigl[(p_k^2-q_k^2)/q_k\Bigr] \] with equality iff \(p_k=q_k (k=1,\dots ,n)\) (straightforward consequence of the concavity of \(\ln\) and of \(\ln t\leq t-1; =\) iff \(t=1\)). An application: \(\log n + \sum^n p_k \log p_k \leq \log(n\sum^n p_k^2)\) with equality iff \(p_1=\dots =p_n=1/n.\) [The expressions are slightly rearranged here. In particular, the results in the paper are formulated in terms of integrals; since, however the basic set is finite, these integrals are finite sums].
- New information inequalities in terms of chi-square divergence and its application
- Some inequalities for information divergence and related measures of discrimination
- Information Inequalities for Joint Distributions, With Interpretations and Applications
- A new information inequality and its application in establishing relation among various f-divergence measures
- scientific article; zbMATH DE number 2098546
- scientific article; zbMATH DE number 2147697
- Some Inequalities for (m, M)-Convex Mappings and Applications for the Csiszár Φ-Divergence in Information Theory
- scientific article; zbMATH DE number 1958489
- Some information inequalities for statistical inference
- On generalized Csiszár-Kullback inequalities
- Inequalities for overdamped fluctuating systems
- An involution inequality for the Kullback-Leibler divergence
- Relative log-concavity and a pair of triangle inequalities
- On differential Renyi's–Tsallis divergence measure and its applications
- On an inequality from information theory
- An application of Ky Fan inequality: on Kullback-Leibler divergence between a probability distribution and its negation
- Comparison of contraction coefficients for f-divergences
This page was built for publication:
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4539769)