An integral representation of the relative entropy

DOI10.3390/E14081469zbMATH Open1314.94028OpenAlexW2028844795MaRDI QIDQ406130FDOQ406130

Authors: Miku Hirata, Aya Nemoto, Hiroaki Yoshida 

Publication date: 8 September 2014

Published in: Entropy (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.3390/e14081469

Recommendations

• Representation formula for the entropy and functional inequalities
• Variational representations related to Tsallis relative entropy
• scientific article; zbMATH DE number 7653414
• Integral representations and asymptotic expansions for Shannon and Renyi entropies
• Remarks on the free relative entropy and the free Fisher information distance

zbMATH Keywords

relative entropylogarithmic Sobolev inequalityrelative Fisher informationde Bruijn identityStam inequality

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Measures of information, entropy (94A17)

Cites Work

• ON CONVEX SOBOLEV INEQUALITIES AND THE RATE OF CONVERGENCE TO EQUILIBRIUM FOR FOKKER-PLANCK TYPE EQUATIONS
• Title not available (Why is that?)
• Logarithmic Sobolev Inequalities
• Cercignani's conjecture is sometimes true and always almost true
• Fisher information inequalities and the central limit theorem
• A short proof of the "concavity of entropy power"
• Information theoretic inequalities
• Superadditivity of Fisher's information and logarithmic Sobolev inequalities
• Entropy and the central limit theorem
• Some inequalities satisfied by the quantities of information of Fisher and Shannon
• Mutual Information and Minimum Mean-Square Error in Gaussian Channels
• The convolution inequality for entropy powers
• Generalized Entropy Power Inequalities and Monotonicity Properties of Information
• Mismatched Estimation and Relative Entropy

Cited In (11)

• Title not available (Why is that?)
• Representation formula for the entropy and functional inequalities
• Title not available (Why is that?)
• Relative entropy equals bulk relative entropy
• Affinity of the Arov entropy
• Hellmann-Feynman connection for the relative Fisher information
• Telescopic Relative Entropy
• Legendre transform structure and extremal properties of the relative Fisher information
• A characterization of the relative entropies
• Entropy pair realization
• Title not available (Why is that?)

This page was built for publication: An integral representation of the relative entropy

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q406130)