Entropy under disintegrations

DOI10.1007/978-3-030-80209-7_38MaRDI QIDQ2117869zbMATH OpenOpenAlexFDO

Authors Juan Pablo Vigneaux

Publication date 22 March 2022

Full work available at URL https://arxiv.org/abs/2102.09584

zbMATH Keywords

AEPdisintegrationchain rulegeneralized entropytopological groupconcentration of measureHaar measuredifferential entropy

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Entropy and other invariants, isomorphism, classification in ergodic theory (37A35)

Abstract: We consider the differential entropy of probability measures absolutely continuous with respect to a given $sigma$-finite reference measure on an arbitrary measurable space. We state the asymptotic equipartition property in this general case; the result is part of the folklore but our presentation is to some extent novel. Then we study a general framework under which such entropies satisfy a chain rule: disintegrations of measures. We give an asymptotic interpretation for conditional entropies in this case. Finally, we apply our result to Haar measures in canonical relation.

Recommendations

• GENERAL ENTROPY OF GENERAL MEASURES
• The measure-theoretic aspects of entropy. II
• scientific article; zbMATH DE number 3173999
• The measure-theoretic aspects of entropy. I
• Relative entropy and relative conditional entropy with infinite partitions

Cites work

• scientific article; zbMATH DE number 1543270 (Why is no real title available?)
• scientific article; zbMATH DE number 3450084 (Why is no real title available?)
• scientific article; zbMATH DE number 1448982 (Why is no real title available?)
• scientific article; zbMATH DE number 3222151 (Why is no real title available?)
• A Mathematical Theory of Communication
• Capacity bounds via duality with applications to multiple-antenna systems on flat-fading channels
• Conditioning as disintegration
• Elements of Information Theory
• Entropy and Source Coding for Integer-Dimensional Singular Random Variables
• Measure theory

Cited in

(5)

• Entropy evolution in reactions
• On the entropy of rectifiable and stratified measures
• Duality of conditional entropy associated with a commutative hypergroup
• scientific article; zbMATH DE number 4061139 (Why is no real title available?)
• Statistical mechanics of entropic forces: disassembling a toy

This page was built for publication: Entropy under disintegrations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2117869)