An integral representation of the relative entropy

DOI10.3390/E14081469MaRDI QIDQ406130zbMATH OpenOpenAlexFDO

Authors Miku Hirata, Aya Nemoto, Hiroaki Yoshida

Publication date 8 September 2014

Published in Entropy (Search for Journal in Brave)

Full work available at URL https://doi.org/10.3390/e14081469

zbMATH Keywords

relative entropylogarithmic Sobolev inequalityrelative Fisher informationde Bruijn identityStam inequality

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Measures of information, entropy (94A17)

Recommendations

• Representation formula for the entropy and functional inequalities
• Variational representations related to Tsallis relative entropy
• scientific article; zbMATH DE number 7653414
• Integral representations and asymptotic expansions for Shannon and Renyi entropies
• Remarks on the free relative entropy and the free Fisher information distance

Cites work

• scientific article; zbMATH DE number 2131215 (Why is no real title available?)
• A short proof of the "concavity of entropy power"
• Cercignani's conjecture is sometimes true and always almost true
• Entropy and the central limit theorem
• Fisher information inequalities and the central limit theorem
• Generalized Entropy Power Inequalities and Monotonicity Properties of Information
• Information theoretic inequalities
• Logarithmic Sobolev Inequalities
• Mismatched Estimation and Relative Entropy
• Mutual Information and Minimum Mean-Square Error in Gaussian Channels
• ON CONVEX SOBOLEV INEQUALITIES AND THE RATE OF CONVERGENCE TO EQUILIBRIUM FOR FOKKER-PLANCK TYPE EQUATIONS
• Some inequalities satisfied by the quantities of information of Fisher and Shannon
• Superadditivity of Fisher's information and logarithmic Sobolev inequalities
• The convolution inequality for entropy powers

Cited in

(11)

• scientific article; zbMATH DE number 1136341 (Why is no real title available?)
• Representation formula for the entropy and functional inequalities
• scientific article; zbMATH DE number 7653414 (Why is no real title available?)
• Relative entropy equals bulk relative entropy
• Affinity of the Arov entropy
• Hellmann-Feynman connection for the relative Fisher information
• Telescopic Relative Entropy
• Legendre transform structure and extremal properties of the relative Fisher information
• A characterization of the relative entropies
• Entropy pair realization
• scientific article; zbMATH DE number 431873 (Why is no real title available?)

This page was built for publication: An integral representation of the relative entropy

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q406130)