Entropy and the Law of Small Numbers
From MaRDI portal
Publication:3547166
DOI10.1109/TIT.2004.840861zbMath1297.94016arXivmath/0211020WikidataQ60522099 ScholiaQ60522099MaRDI QIDQ3547166
Ioannis Kontoyiannis, Peter Harremoës, Oliver Johnson
Publication date: 21 December 2008
Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/math/0211020
total variation; logarithmic Sobolev inequality; Fisher information; Poisson approximation; subadditivity; law of small numbers; convergence in relative entropy
60E15: Inequalities; stochastic orderings
94A17: Measures of information, entropy
94A15: Information theory (general)
62B10: Statistical aspects of information-theoretic topics
Related Items
Entropy Inequalities for Sums in Prime Cyclic Groups, Information in Probability: Another Information-Theoretic Proof of a Finite de Finetti Theorem, Discrete versions of the transport equation and the Shepp-Olkin conjecture, Log-concavity, ultra-log-concavity, and a maximum entropy property of discrete compound Poisson measures, Log-concavity and strong log-concavity: a review, A Charlier-Parseval approach to Poisson approximation and its applications, Log-concavity and the maximum entropy property of the Poisson distribution, The entropic Erdős-Kac limit theorem, Stam inequality on \(\mathbb Z_n\), Convergence of Markov chains in information divergence, A discrete log-Sobolev inequality under a Bakry-Émery type condition, Estimation on reliability models of bearing failure data, An information-theoretic proof of a finite de Finetti theorem, Majorization and Rényi entropy inequalities via Sperner theory, Poisson approximation, Improved lower bounds on the total variation distance for the Poisson approximation, Strong Log-concavity is Preserved by Convolution
