Maximization of the information divergence from multinomial distributions

MaRDI QIDQ3171430zbMATH OpenFDO

Authors Jozef Juríček

Publication date 5 October 2011

Full work available at URL http://hdl.handle.net/10338.dmlcz/143665

zbMATH Keywords

exponential familyhierarchical modelsInformation divergenceinformation projectionmulti-informationmultinomial distributionrelative entropy

Mathematics Subject Classification ID

Statistical aspects of information-theoretic topics (62B10) Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• Optimality conditions for maximizers of the information divergence from an exponent family
• Maximizing multi-information
• Maximal Information Divergence from Statistical Models Defined by Neural Networks
• Factorized mutual information maximization.
• Binomial and Poisson distributions as maximum entropy distributions

Cited in

(11)

• An information-geometric approach to a theory of pragmatic structuring
• Converting information into probability measures with the Kullback-Leibler divergence
• scientific article; zbMATH DE number 933211 (Why is no real title available?)
• Maximizing the divergence from a hierarchical model of quantum states
• Optimally approximating exponential families
• Optimality conditions for maximizers of the information divergence from an exponent family
• Maximizing multi-information
• Maximal Information Divergence from Statistical Models Defined by Neural Networks
• Factorized mutual information maximization.
• The Pólya information divergence
• Maximum information divergence from linear and toric models

This page was built for publication: Maximization of the information divergence from multinomial distributions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3171430)