Factorized mutual information maximization.

DOI10.14736/KYB-2020-5-0948MaRDI QIDQ5858544zbMATH OpenOpenAlexFDO

Authors Thomas Merkh, Guido Montúfar

Publication date 13 April 2021

Published in Kybernetika (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1906.05460

zbMATH Keywords

divergence maximizationmarginal specification problemmulti-informationmutual informationtransportation polytope

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Measures of information, entropy (94A17)

Recommendations

• Maximizing multi-information
• Mutual information of several random variables and its estimation via variation
• On one extremal problem for mutual information
• Maximum independence and mutual information
• Maximization of the information divergence from multinomial distributions

Cites work

• A conditional entropy bound for a pair of discrete random variables
• An information-geometric approach to a theory of pragmatic structuring
• Approximate maximizers of intricacy functionals
• Divergence From Factorizable Distributions and Matroid Representations by Partitions
• dnner
• Estimating the errors on measured entropy and mutual information
• Finding the Maximizers of the Information Divergence From an Exponential Family
• Gröbner bases and polyhedral geometry of reducible and cyclic models.
• scientific article; zbMATH DE number 3828715 (Why is no real title available?)
• Information Theoretical Analysis of Multivariate Correlation
• Locality of Global Stochastic Interaction in Directed Acyclic Networks
• Maximal Information Divergence from Statistical Models Defined by Neural Networks
• Maximizing multi-information
• Multivariate Information Bottleneck
• Predictability, complexity, and learning
• Predictive information and explorative behavior of autonomous robots
• SYNCHRONIZING TO THE ENVIRONMENT: INFORMATION-THEORETIC CONSTRAINTS ON AGENT LEARNING
• The hierarchy of circuit diameters and transportation polytopes
• Universal Approximation Depth and Errors of Narrow Belief Networks with Discrete Units

Cited in

(9)

• Dictator functions maximize mutual information
• Maximization of the information divergence from multinomial distributions
• Maximum independence and mutual information
• scientific article; zbMATH DE number 2119842 (Why is no real title available?)
• Maximizing multi-information
• Information decomposition based on cooperative game theory
• Multi-information in the thermodynamic limit
• Factorized Mutual Information Maximization
• Approximate maximizers of intricacy functionals

Describes a project that uses

Uses Software

• dnner
• SageMath
• lsd

This page was built for publication: Factorized mutual information maximization.

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5858544)