scientific article; zbMATH DE number 1423126
The entropy functional \[ G(\{p_{i}\})=-\sum_{i}p_{i}\ln p_{i} \] is derived as the unique maximand for assigning probabilities given linear constraints. This new derivation presents the principle of maximum entropy for assigning probability distributions. Many derivations of this form exist: these include the Shannon-Jaynes argument, discussed in this paper; a combinatorial argument, which uses Stirling's approximation in the limit of a large, possibly imaginary, ensemble; and the Shore-Johnson argument that a joint distribution to be reconstructed from its single-variable marginals should not exhibit correlation between the variables, since no evidence is given for it. All these arguments give the same result but begin from different axioms, so that which derivation you prefer depends simply on which starting axioms you prefer. In common with the Shannon-Jaynes derivation the idea involves an invariance under arbitrary partitioning of the points on which probabilities are defined. However, the Shannon-Jaynes derivation is a two-stage process: asserting that a particular functional of the probabilities, that has a certain interpretation, should be maximized, and then using that interpretation to generate an equation for the functional itself. This equation is routinely solved to give the usual \(p\ln p\) form. By contrast, the derivation presented in this paper is a one-stage process which does not rest on any interpretation. For the entire collection see [Zbl 0928.00040].
- Maximum entropy principle revisited
- MAXIMUM ENTROPY REVISITED
- The principle of maximum entropy
- scientific article; zbMATH DE number 4002027
- THE MAXIMUM ENTROPY PRINCIPLE FOR GENERALIZED ENTROPIES
- A note on the inevitability of maximum entropy
- The generalised maximum \(\alpha\) entropy principle
- Maximum entropy principle with general deviation measures
- THE MAXIMUM ENTROPY PRINCIPLE: A GENERALIZED CONSTRAINT-BASED ENTROPY
This page was built for publication:
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4946941)