Continuity and additivity properties of information decompositions

DOI10.1016/J.IJAR.2023.108979MaRDI QIDQ6178720zbMATH OpenOpenAlexWikidataFDO

Authors Johannes Rauh, Pradeep Kr. Banerjee, Eckehard Olbrich, Guido Montúfar, Jürgen Jost

Publication date 4 September 2023

Published in International Journal of Approximate Reasoning (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2204.10982

zbMATH Keywords

additivitybivariate information decompositioncontinuityinformation measuresmutual information

Mathematics Subject Classification ID

Reasoning under uncertainty in the context of artificial intelligence (68T37)

Abstract: Information decompositions quantify how the Shannon information about a given random variable is distributed among several other random variables. Various requirements have been proposed that such a decomposition should satisfy, leading to different candidate solutions. Curiously, however, only two of the original requirements that determined the Shannon information have been considered, namely monotonicity and normalization. Two other important properties, continuity and additivity, have not been considered. In this contribution, we focus on the mutual information of two finite variables $Y,Z$ about a third finite variable $S$ and check which of the decompositions satisfy these two properties. While most of them satisfy continuity, only one of them is both continuous and additive.

Recommendations

• scientific article; zbMATH DE number 5526490
• Additivity and conditional information for parametric measures of information
• INDEPENDENCE AND CONDITIONAL DECOMPOSABLE INFORMATION MEASURES
• An extension of the information inequality and related characterizations
• scientific article; zbMATH DE number 3878830
• Continuity and characterization of Shannon-Wiener information measure for continuous probability distributions
• scientific article; zbMATH DE number 683299
• On asymptotic information integral inequalities

Cites work

• A continuity property of the entropy density for spin lattice systems
• A Mathematical Theory of Communication
• Axiomatic characterizations of information measures
• scientific article; zbMATH DE number 3497786 (Why is no real title available?)
• scientific article; zbMATH DE number 1222288 (Why is no real title available?)
• scientific article; zbMATH DE number 2009980 (Why is no real title available?)
• Information decomposition based on cooperative game theory
• Information Theoretical Analysis of Multivariate Correlation
• Information theory. Coding theorems for discrete memoryless systems
• Information-Theoretic Key Agreement of Multiple Terminals—Part I
• On asymptotic continuity of functions of quantum states
• Properties of unique information
• Tight uniform continuity bounds for quantum entropies: conditional entropy, relative entropy distance and energy constraints
• Unifying Classical and Quantum Key Distillation
• Unique information via dependency constraints
• “Squashed entanglement”: An additive entanglement measure

Cited in

(6)

• Uniform continuity of information combination
• INDEPENDENCE AND CONDITIONAL DECOMPOSABLE INFORMATION MEASURES
• scientific article; zbMATH DE number 5526490 (Why is no real title available?)
• scientific article; zbMATH DE number 3983062 (Why is no real title available?)
• Structure Conditions under Progressively Added Information
• An information-theoretic characterization of partitioned property spaces

This page was built for publication: Continuity and additivity properties of information decompositions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6178720)