Properties of cross-entropy minimization

DOI10.1109/TIT.1981.1056373zbMath0459.94008MaRDI QIDQ3910425

Rodney W. Johnson, John E. Shore

Publication date: 1981

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

zbMATH Keywords

inference about an unknown probability density

Mathematics Subject Classification ID

94A17: Measures of information, entropy

62B10: Statistical aspects of information-theoretic topics

Related Items

An entropic framework for the normal distribution in capability analysis, Maximum entropy and the moment problem, ON THE PROBLEM OF CONSTRAINTS IN NONEXTENSIVE FORMALISM: A QUANTUM MECHANICAL TREATMENT, Can the maximum entropy principle be explained as a consistency requirement?, Uncertainty management with imprecise knowledge with application to design, Replicator equations and the principle of minimal production of information, Combining probabilistic logic programming with the power of maximum entropy, A neural network system for matching dental radiographs, Why \(q\)-expectation values must be used in nonextensive statistical mechanics, MRE hierarchical decomposition of general queueing network models, Information theoretic analysis for a general queueing system at equilibrium with application to queues in tandem, The application of the principle of minimum cross-entropy to the characterization of the exponential-type probability distributions, Characterizing the principle of minimum cross-entropy within a conditional-logical framework, Entropy maximisation and queueing network models, A note on conditional logics and entropy, Unnamed Item, The General Form of γ-Family of Quantum Relative Entropies