A New Entropy Power Inequality for Integer-Valued Random Variables

DOI10.1109/TIT.2014.2317181zbMATH Open1360.94155arXiv1301.4185MaRDI QIDQ2986249FDOQ2986249

Authors: Saeid Haghighatshoar, Emmanuel Abbe, İ. Emre Telatar 

Publication date: 16 May 2017

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

Abstract: The entropy power inequality (EPI) provides lower bounds on the differential entropy of the sum of two independent real-valued random variables in terms of the individual entropies. Versions of the EPI for discrete random variables have been obtained for special families of distributions with the differential entropy replaced by the discrete entropy, but no universal inequality is known (beyond trivial ones). More recently, the sumset theory for the entropy function provides a sharp inequality $H(X+X^{\prime })-H(X)geq1/2-o(1)$ when $X,X^{\prime }$ are i.i.d. with high entropy. This paper provides the inequality $H(X+X^{\prime })-H(X)geqg(H(X))$, where $X,X^{\prime }$ are arbitrary i.i.d. integer-valued random variables and where $g$ is a universal strictly positive function on $m{R}_{+}$ satisfying $g(0)=0$. Extensions to non identically distributed random variables and to conditional entropies are also obtained.

Full work available at URL: https://arxiv.org/abs/1301.4185

Mathematics Subject Classification ID

Measures of information, entropy (94A17)

Cited In (8)

• Concentration functions and entropy bounds for discrete log-concave distributions
• The convexification effect of Minkowski summation
• Entropy inequalities for sums in prime cyclic groups
• Entropy-variance inequalities for discrete log-concave random variables via degree of freedom
• Approximate discrete entropy monotonicity for log-concave sums
• Majorization and Rényi entropy inequalities via Sperner theory
• Bernoulli sums and Rényi entropy inequalities
• Entropy and the discrete central limit theorem

This page was built for publication: A New Entropy Power Inequality for Integer-Valued Random Variables

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2986249)