Properties of cross-entropy minimization

DOI10.1109/TIT.1981.1056373zbMath0459.94008MaRDI QIDQ3910425

Rodney W. Johnson, John E. Shore

Publication date: 1981

Published in: IEEE Transactions on Information Theory (Search for Journal in Brave)

zbMATH Keywords

inference about an unknown probability density

Mathematics Subject Classification ID

94A17: Measures of information, entropy

62B10: Statistical aspects of information-theoretic topics

Related Items

An entropic framework for the normal distribution in capability analysis, Maximum entropy and the moment problem, ON THE PROBLEM OF CONSTRAINTS IN NONEXTENSIVE FORMALISM: A QUANTUM MECHANICAL TREATMENT, Uncertainty management with imprecise knowledge with application to design, Combining probabilistic logic programming with the power of maximum entropy, A neural network system for matching dental radiographs, Why \(q\)-expectation values must be used in nonextensive statistical mechanics, MRE hierarchical decomposition of general queueing network models, Information theoretic analysis for a general queueing system at equilibrium with application to queues in tandem, The application of the principle of minimum cross-entropy to the characterization of the exponential-type probability distributions, Characterizing the principle of minimum cross-entropy within a conditional-logical framework, Entropy maximisation and queueing network models, A note on conditional logics and entropy