Maximizing multi-information

MaRDI QIDQ5389893zbMATH OpenFDO

Authors Nihat Ay, Andreas Knauf

Publication date 23 April 2012

Full work available at URL https://arxiv.org/abs/math-ph/0702002, https://eudml.org/doc/33822, http://www.kybernetika.cz/content/2006/5/517

zbMATH Keywords

Boltzmann machineinfomax principlemulti-informationneural networkspair-interactionrelative entropy

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Learning and adaptive systems in artificial intelligence (68T05) Neural nets applied to problems in time-dependent statistical mechanics (82C32) Information theory (general) (94A15)

Recommendations

• Factorized mutual information maximization.
• Maximization of the information divergence from multinomial distributions
• Multi-information in the thermodynamic limit
• Mutual information of several random variables and its estimation via variation
• scientific article; zbMATH DE number 1222288

Cites work

• A Mathematical Theory of Communication
• An information-geometric approach to a theory of pragmatic structuring
• scientific article; zbMATH DE number 41891 (Why is no real title available?)
• Information geometry on hierarchy of probability distributions
• Locality of Global Stochastic Interaction in Directed Acyclic Networks

Cited in

(20)

• A variational principle for ground spaces
• Information geometry on complexity and stochastic interaction
• Maximization of the information divergence from multinomial distributions
• Hierarchical Models, Marginal Polytopes, and Linear Codes
• Information geometry on hierarchy of probability distributions
• Information geometric methods for complexity
• Signatures of quantum phase transitions from the boundary of the numerical range
• scientific article; zbMATH DE number 933211 (Why is no real title available?)
• Mixture decompositions of exponential families using a decomposition of their sample spaces
• When does a mixture of products contain a product of mixtures?
• Universal Approximation Depth and Errors of Narrow Belief Networks with Discrete Units
• Optimality conditions for maximizers of the information divergence from an exponent family
• Maximizing the Bregman divergence from a Bregman family
• Factorized mutual information maximization.
• Multi-information in the thermodynamic limit
• Algebraic structures in statistical methodology. Abstracts from the workshop held December 4--10, 2022
• Entropic Trust Region for Densest Crystallographic Symmetry Group Packings
• Erratum to: Neighborliness of marginal polytopes
• Maximum information divergence from linear and toric models
• Quantum convex support

This page was built for publication: Maximizing multi-information

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5389893)