Recent progresses in characterising information inequalities

DOI10.3390/E13020379MaRDI QIDQ657542zbMATH OpenOpenAlexFDO

Authors Terence H. Chan

Publication date 9 January 2012

Published in Entropy (Search for Journal in Brave)

Full work available at URL https://doi.org/10.3390/e13020379

zbMATH Keywords

determinantal inequalitiesgreene's theoremKolmogorov complexityquasi-uniformityShannon entropiessubspace rank inequalities

Mathematics Subject Classification ID

Measures of information, entropy (94A17) Coding theorems (Shannon theory) (94A24)

Review text

Summary: We present a revision on some of the recent progresses made in characterising and understanding information inequalities, which are the fundamental physical laws in communications and compression. We will begin with the introduction of a geometric framework for information inequalities, followed by the first non-Shannon inequality proved by \textit{Z. Zhang} and \textit{R. W. Young} [IEEE Trans. Inf. Theory 44, 1440--1452 (1998; Zbl 1153.94336)]. The discovery of this non-Shannon inequality is a breakthrough in the area and has led to the subsequent discovery of many more non-Shannon inequalities. We will also review the close relations between information inequalities and other research areas such as Kolmogorov complexity, determinantal inequalities, and group-theoretic inequalities. These relations have led to non-traditional techniques in proving information inequalities and at the same time made impacts back onthose related areas by the introduction of information-theoretic tools.

Recommendations

• On entropy, information inequalities, and groups
• On a relation between information inequalities and group theory
• A class of non-Shannon-type information inequalities and their applications
• A new class of non-Shannon-type inequalities for entropies
• Non-linear information inequalities

Cites work

• A class of non-Shannon-type information inequalities and their applications
• A combinatorial approach to information inequalities
• A framework for linear information inequalities
• A Mathematical Theory of Communication
• A new class of non-Shannon-type inequalities for entropies
• Balanced information inequalities
• CramÉr–Rao and Moment-Entropy Inequalities for Renyi Entropy and Generalized Fisher Information
• Dualities Between Entropy Functions and Network Codes
• Inequalities for Shannon entropy and Kolmogorov complexity
• Moment-Entropy Inequalities for a Random Vector
• New inequalities for subspace arrangements
• Non-linear information inequalities
• On a relation between information inequalities and group theory
• On characterization of entropy function via information inequalities

Cited in

(4)

• A class of non-Shannon-type information inequalities and their applications
• Integrity constraints revisited: from exact to approximate implication
• Using multiobjective optimization to map the entropy region
• On a connection between information and group lattices

Describes a project that uses

Uses Software

• ITIP

This page was built for publication: Recent progresses in characterising information inequalities

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q657542)