A practical computational framework for the multidimensional moment-constrained maximum entropy principle
The author considers the problem of minimization of the Shannon entropy \[ S(p)=\int_{\mathbb{R}^N} p(\lambda)\log p(\lambda)d\lambda \] or the relative entropy \[ P(p)=\int_{\mathbb{R}^N} p(\lambda)\log (p(\lambda)/\Pi(\lambda))d\lambda \] over all probability densities \(p\) on \(R^N\) which satisfy ``moment conditions (\(i=1,\dots,L\)) \[ \int_{\mathbb{R}^N}C_i(\lambda)p(\lambda)d\lambda=f_i \] for some fixed \(f_i\) and \(C_i\) being products of powers. The proposed numerical method to this problem is based on the Lagrange multipliers technique and an explicit Shannon entropy representation for a class of functions. Newton's method is used for the numerical optimization of the Lagrangian. Application to fitting a full-scale atmospheric general circulation model is considered.
- An improved algorithm for the multidimensional moment-constrained maximum entropy problem
- The multidimensional maximum entropy moment problem: a review on numerical methods
- The multidimensional moment-constrained maximum entropy problem: A BFGS algorithm with constraint scaling
- A general maximum entropy theory: constraint optimization in probability
- An efficient algorithm to compute maximum entropy densities
- A fast Newton algorithm for entropy maximization in phase determination
- A Limited Memory Algorithm for Bound Constrained Optimization
- A mathematical framework for quantifying predictability through relative entropy
- An efficient algorithm to compute maximum entropy densities
- Calculation of maximum entropy densities with application to income distribution
- Hausdorff moment problem and maximum entropy: A unified approach
- scientific article; zbMATH DE number 3862231 (Why is no real title available?)
- scientific article; zbMATH DE number 3863589 (Why is no real title available?)
- scientific article; zbMATH DE number 1243473 (Why is no real title available?)
- scientific article; zbMATH DE number 4001209 (Why is no real title available?)
- scientific article; zbMATH DE number 837911 (Why is no real title available?)
- Quantifying predictability through information theory: small sample estimation in a non-Gaussian framework
- Quantifying Uncertainty for Non-Gaussian Ensembles in Complex Systems
- The multidimensional moment-constrained maximum entropy problem: A BFGS algorithm with constraint scaling
- Maximum entropy algorithm with inexact upper entropy bound based on \(Fup\) basis functions with compact support
- Quantifying predictability through information theory: small sample estimation in a non-Gaussian framework
- Gaussian process regression for maximum entropy distribution
- On a computationally scalable sparse formulation of the multidimensional and nonstationary maximum entropy principle
- Optimization and large scale computation of an entropy-based moment closure
- An improved algorithm for the multidimensional moment-constrained maximum entropy problem
- Conditional and marginal mutual information in Gaussian and hyperbolic decay time series
- Conditioning moments of singular measures for entropy maximization II: Numerical examples
- A general maximum entropy theory: constraint optimization in probability
- Information flow between subspaces of complex dynamical systems
- An efficient algorithm to compute maximum entropy densities
- On the five-moment maximum entropy system of one-dimensional Boltzmann equation
- A Matlab program to calculate distribution with maximum Renyi entropy
- Maximum entropy method in comminution modelling
- A maximum entropy modelling of the rain drop size distribution
- Information theory and dynamical system predictability
This page was built for publication: A practical computational framework for the multidimensional moment-constrained maximum entropy principle
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2572793)
