The information loss of a stochastic map
From MaRDI portal
Publication:6372000
DOI10.3390/E23081021arXiv2107.01975MaRDI QIDQ6372000FDOQ6372000
James Fullwood, Arthur J. Parzygnat
Publication date: 5 July 2021
Abstract: We provide a stochastic extension of the Baez-Fritz-Leinster characterization of the Shannon information loss associated with a measure-preserving function. This recovers the conditional entropy and a closely related information-theoretic measure that we call conditional information loss. Although not functorial, these information measures are semi-functorial, a concept we introduce that is definable in any Markov category. We also introduce the notion of an entropic Bayes' rule for information measures, and we provide a characterization of conditional entropy in terms of this rule.
Bayesian inference (62F15) Measures of information, entropy (94A17) Definitions and generalizations in theory of categories (18A05)
This page was built for publication: The information loss of a stochastic map
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6372000)
