Entropy and the central limit theorem

DOI10.1214/AOP/1176992632MaRDI QIDQ1080263zbMATH OpenOpenAlexFDO

Authors Andrew R. Barron

Publication date 1986

Published in The Annals of Probability (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1214/aop/1176992632

zbMATH Keywords

central limit theoremFisher informationrelative entropy

Mathematics Subject Classification ID

Central limit and other weak theorems (60F05) Statistical aspects of information-theoretic topics (62B10) Measures of information, entropy (94A17)

Recommendations

• Entropy inequalities and the central limit theorem.
• scientific article; zbMATH DE number 4034753
• Entropy and random vectors
• Entropy production by block variable summation and central limit theorems
• Entropy inequalities for stable densities and strengthened central limit theorems

Cited in

(only showing first 100 items - show all)

• Complete monotonicity of the entropy in the central limit theorem for gamma and inverse Gaussian distributions
• Convergence of Markov chains in information divergence
• Central limit theorems for stochastic processes under random entropy conditions
• Entropy, the central limit theorem and the algebra of the canonical commutation relation
• Strict entropy production bounds and stability of the rate of convergence to equilibrium for the Boltzmann equation
• Variational inequalities for arbitrary multivariate distributions
• Fisher information estimates for Boltzmann's collision operator
• The analogues of entropy and of Fisher's information measure in free probability theory. I
• Entropy jumps in the presence of a spectral gap
• Autour de l'inégalité de Brunn-Minkowski
• Entropy production per site in (nonreversible) spin-flip processes.
• Prohorov-type local limit theorems on abstract Wiener spaces
• Convergence in distribution norms in the CLT for non identical distributed random variables
• Rényi divergence and the central limit theorem
• The convexification effect of Minkowski summation
• Optimality and sub-optimality of PCA. I: Spiked random matrix models
• Probability interference in expected utility theory
• Entropy inequalities and the central limit theorem.
• Partial information reference priors: Derivation and interpretations
• Entropy production estimates for Boltzmann equations with physically realistic collision kernels
• An information-theoretic proof of a finite de Finetti theorem
• Sometimes size does not matter
• Entropy-based test for generalised Gaussian distributions
• Asymptotic behavior of Rényi entropy in the central limit theorem
• Larry Brown's contributions to parametric inference, decision theory and foundations: a survey
• The CLT in high dimensions: quantitative bounds via martingale embedding
• Entropy and the fourth moment phenomenon
• Limiting properties of some measures of information
• Local limit theorems for densities in Orlicz spaces
• Information functionals with applications to random walk and statistics
• An invariance principle under the total variation distance
• A stroll along the gamma
• Differential entropy and dynamics of uncertainty
• A lower bound on the relative entropy with respect to a symmetric probability
• An elementary approach to free entropy theory for convex potentials
• Tropical Gaussians: a brief survey
• Log-Hessian and deviation bounds for Markov semi-groups, and regularization effect in \(\mathbb{L}^1 \)
• Monotonic approach to central limits
• Entropy power inequalities for qudits
• Strong log-concavity is preserved by convolution
• On Shannon's formula and Hartley's rule: beyond the mathematical coincidence
• Geometric inequalities from phase space translations
• Fisher information and the fourth moment theorem
• The fractional Fisher information and the central limit theorem for stable laws
• scientific article; zbMATH DE number 2131215 (Why is no real title available?)
• Maximum smoothed likelihood density estimation
• On entropy production for controlled Markovian evolution
• Quantitative CLTs on a Gaussian space: a survey of recent developments
• From information scaling of natural images to regimes of statistical models
• Convergence of Differential Entropies
• Rate of convergence and Edgeworth-type expansion in the entropic central limit theorem
• Convergence to stable laws in relative entropy
• scientific article; zbMATH DE number 4034753 (Why is no real title available?)
• Asymptotic expansions in the CLT in free probability
• Entropic approach to E. Rio's central limit theorem for W₂ transport distance
• Log-concavity, ultra-log-concavity, and a maximum entropy property of discrete compound Poisson measures
• Fisher information and convergence to stable laws
• Berry-Esseen bounds in the entropic central limit theorem
• An integral representation of the relative entropy
• Information inequalities and a dependent Central Limit Theorem
• scientific article; zbMATH DE number 2034513 (Why is no real title available?)
• scientific article; zbMATH DE number 1465044 (Why is no real title available?)
• Local limit theorems for multiplicative free convolutions
• Gaussian optimizers for entropic inequalities in quantum information
• Centralizers and entropy
• Solution of Shannon’s problem on the monotonicity of entropy
• Log-concavity and strong log-concavity: a review
• The entropy power inequality with quantum conditioning
• Entropy inequalities for stable densities and strengthened central limit theorems
• An extension of entropy power inequality for dependent random variables
• On the equivalence of statistical distances for isotropic convex measures
• Further investigations of Rényi entropy power inequalities and an entropic characterization of s-concave densities
• Two Remarks on Generalized Entropy Power Inequalities
• Shannon's monotonicity problem for free and classical entropy
• Phase space gradient of dissipated work and information: A role of relative Fisher information
• An Information-Theoretic Central Limit Theorem for Finitely Susceptible FKG Systems
• Relations between information and estimation in the presence of feedback
• Entropy and random vectors
• A comment on rates of convergence for density function in extreme value theory and Rényi entropy
• Information in Probability: Another Information-Theoretic Proof of a Finite de Finetti Theorem
• An informatic approach to a long memory stationary process
• Entropy and the discrete central limit theorem
• A historical perspective on Schützenberger-Pinsker inequalities
• scientific article; zbMATH DE number 7796494 (Why is no real title available?)
• Information-theoretic convergence of extreme values to the Gumbel distribution
• On the entropy and information of Gaussian mixtures
• Information measures in perspective
• On the convergence of Shannon entropy of distribution functions in the max domain of attraction of max-stable laws
• An elementary proof of the inequality \(\chi \leq \chi^\ast\) for conditional free entropy
• Approximate discrete entropy monotonicity for log-concave sums
• Non-uniform bounds and Edgeworth expansions in self-normalized limit theorems
• A historical perspective on Schützenberger-Pinsker inequalities (extended version)
• Relative entropy bounds for sampling with and without replacement
• Rényi divergences in central limit theorems: old and new
• Central limit theorem for Rényi divergence of infinite order
• Esscher transform and the central limit theorem
• Zero-one laws for events with positional symmetries
• On the statistical complexity of sample amplification
• Convergence in ^2 distance to the normal distribution for sums of independent random variables
• Negentropy as a function of cumulants

This page was built for publication: Entropy and the central limit theorem

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1080263)