Entropy and the central limit theorem
From MaRDI portal
The author establishes a strengthened central limit theorem for densities showing monotone convergence in the sense of relative entropy. The relative entropy is defined by \[ D_ n=\int f(x) \log f(x)/\phi (x)dx \] where f is the density function of a random variable, X, with finite variance and \(\phi\) is the normal density with the same mean and variance as f.
Recommendations
Cited in
(only showing first 100 items - show all)- Complete monotonicity of the entropy in the central limit theorem for gamma and inverse Gaussian distributions
- Convergence of Markov chains in information divergence
- Central limit theorems for stochastic processes under random entropy conditions
- Entropy, the central limit theorem and the algebra of the canonical commutation relation
- Strict entropy production bounds and stability of the rate of convergence to equilibrium for the Boltzmann equation
- Variational inequalities for arbitrary multivariate distributions
- Fisher information estimates for Boltzmann's collision operator
- The analogues of entropy and of Fisher's information measure in free probability theory. I
- Entropy jumps in the presence of a spectral gap
- Autour de l'inégalité de Brunn-Minkowski
- Entropy production per site in (nonreversible) spin-flip processes.
- Prohorov-type local limit theorems on abstract Wiener spaces
- Convergence in distribution norms in the CLT for non identical distributed random variables
- Rényi divergence and the central limit theorem
- The convexification effect of Minkowski summation
- Optimality and sub-optimality of PCA. I: Spiked random matrix models
- Probability interference in expected utility theory
- Entropy inequalities and the central limit theorem.
- Partial information reference priors: Derivation and interpretations
- Entropy production estimates for Boltzmann equations with physically realistic collision kernels
- An information-theoretic proof of a finite de Finetti theorem
- Sometimes size does not matter
- Entropy-based test for generalised Gaussian distributions
- Asymptotic behavior of Rényi entropy in the central limit theorem
- Larry Brown's contributions to parametric inference, decision theory and foundations: a survey
- The CLT in high dimensions: quantitative bounds via martingale embedding
- Entropy and the fourth moment phenomenon
- Limiting properties of some measures of information
- Local limit theorems for densities in Orlicz spaces
- Information functionals with applications to random walk and statistics
- An invariance principle under the total variation distance
- A stroll along the gamma
- Differential entropy and dynamics of uncertainty
- A lower bound on the relative entropy with respect to a symmetric probability
- An elementary approach to free entropy theory for convex potentials
- Tropical Gaussians: a brief survey
- Log-Hessian and deviation bounds for Markov semi-groups, and regularization effect in \(\mathbb{L}^1 \)
- Monotonic approach to central limits
- Entropy power inequalities for qudits
- Strong log-concavity is preserved by convolution
- On Shannon's formula and Hartley's rule: beyond the mathematical coincidence
- Geometric inequalities from phase space translations
- Fisher information and the fourth moment theorem
- The fractional Fisher information and the central limit theorem for stable laws
- scientific article; zbMATH DE number 2131215 (Why is no real title available?)
- Maximum smoothed likelihood density estimation
- On entropy production for controlled Markovian evolution
- Quantitative CLTs on a Gaussian space: a survey of recent developments
- From information scaling of natural images to regimes of statistical models
- Convergence of Differential Entropies
- Rate of convergence and Edgeworth-type expansion in the entropic central limit theorem
- Convergence to stable laws in relative entropy
- scientific article; zbMATH DE number 4034753 (Why is no real title available?)
- Asymptotic expansions in the CLT in free probability
- Entropic approach to E. Rio's central limit theorem for W₂ transport distance
- Log-concavity, ultra-log-concavity, and a maximum entropy property of discrete compound Poisson measures
- Fisher information and convergence to stable laws
- Berry-Esseen bounds in the entropic central limit theorem
- An integral representation of the relative entropy
- Information inequalities and a dependent Central Limit Theorem
- scientific article; zbMATH DE number 2034513 (Why is no real title available?)
- scientific article; zbMATH DE number 1465044 (Why is no real title available?)
- Local limit theorems for multiplicative free convolutions
- Gaussian optimizers for entropic inequalities in quantum information
- Centralizers and entropy
- Solution of Shannon’s problem on the monotonicity of entropy
- Log-concavity and strong log-concavity: a review
- The entropy power inequality with quantum conditioning
- Entropy inequalities for stable densities and strengthened central limit theorems
- An extension of entropy power inequality for dependent random variables
- On the equivalence of statistical distances for isotropic convex measures
- Further investigations of Rényi entropy power inequalities and an entropic characterization of s-concave densities
- Two Remarks on Generalized Entropy Power Inequalities
- Shannon's monotonicity problem for free and classical entropy
- Phase space gradient of dissipated work and information: A role of relative Fisher information
- An Information-Theoretic Central Limit Theorem for Finitely Susceptible FKG Systems
- Relations between information and estimation in the presence of feedback
- Entropy and random vectors
- A comment on rates of convergence for density function in extreme value theory and Rényi entropy
- Information in Probability: Another Information-Theoretic Proof of a Finite de Finetti Theorem
- An informatic approach to a long memory stationary process
- Entropy and the discrete central limit theorem
- A historical perspective on Schützenberger-Pinsker inequalities
- scientific article; zbMATH DE number 7796494 (Why is no real title available?)
- Information-theoretic convergence of extreme values to the Gumbel distribution
- On the entropy and information of Gaussian mixtures
- Information measures in perspective
- On the convergence of Shannon entropy of distribution functions in the max domain of attraction of max-stable laws
- An elementary proof of the inequality \(\chi \leq \chi^\ast\) for conditional free entropy
- Approximate discrete entropy monotonicity for log-concave sums
- Non-uniform bounds and Edgeworth expansions in self-normalized limit theorems
- A historical perspective on Schützenberger-Pinsker inequalities (extended version)
- Relative entropy bounds for sampling with and without replacement
- Rényi divergences in central limit theorems: old and new
- Central limit theorem for Rényi divergence of infinite order
- Esscher transform and the central limit theorem
- Zero-one laws for events with positional symmetries
- On the statistical complexity of sample amplification
- Convergence in ^2 distance to the normal distribution for sums of independent random variables
- Negentropy as a function of cumulants
This page was built for publication: Entropy and the central limit theorem
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1080263)
