I-divergence geometry of probability distributions and minimization problems

DOI10.1214/aop/1176996454zbMath0318.60013WikidataQ100708815 ScholiaQ100708815MaRDI QIDQ1222453

Publication date: 1975

Published in: The Annals of Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aop/1176996454

Mathematics Subject Classification ID

60E05: Probability distributions: general theory

49Q20: Variational problems in a geometric measure-theoretic setting

15B48: Positive matrices and their generalizations; cones of matrices

62B10: Statistical aspects of information-theoretic topics

Related Items

Markov process large deviations in \(\tau\)-topology, On the maximum entropy principle for uniformly ergodic Markov chains, On the effective implementation of the iterative proportional fitting procedure, Order independence and factor convergence in iterative scaling, Note on the Schrödinger equation and \(I\)-projections, Temporal behavior of the conditional and Gibbs' entropies, Deviations bounds and conditional principles for thin sets, Poisson inverse problems, Variational processes from the weak forward equation, Causality and maximum entropy updating, Boosting multi-features with prior knowledge for mini unmanned helicopter landmark detection, Minimization of entropy functionals, Equivalence of ensembles for two-species zero-range invariant measures, Discontinuous condensation transition and nonequivalence of ensembles in a zero-range process, Order conditioned independence of real random variables, Information theoretic analysis for a general queueing system at equilibrium with application to queues in tandem, On convergence of conditional probability measures, Laplace approximations for sums of independent random vectors. II: Degenerate maxima and manifolds of maxima, On the construction of approximate multi-factor designs from given marginals using the iterative proportional fitting procedure, Statistical aspects of divergence measures, Large deviation estimates for a conditional probability distribution. Applications to random interaction Gibbs measures, Estimation of weighted multinomial probabilities under log-convex constraints, Entropy-convergence in Stieltjes and Hamburger moment problem, Characterizing the principle of minimum cross-entropy within a conditional-logical framework, An informational divergence geometry for stochastic matrices, Information geometry in functional spaces of classical and quantum finite statistical systems, Informational divergence and the dissimilarity of probability distributions, Cross entropy minimization in uninvadable states of complex populations, Adjustment of importance weights in multiattribute value models by minimum discrimination information, An application of Lipschitzian global optimization to product design, Large deviations and the propagation of chaos for Schrödinger processes, Finite Kullback information diffusion laws with fixed marginals and associated large deviations functionals, Linearly constrained estimation by mathematical programming, Conditional iterative proportional fitting for Gaussian distributions, Bounds for stop-loss premium under restrictions on \(I\)-divergence, On the dual of linear inverse problems, Large deviations for lattice systems. II: Nonstationary independent fields, Schrödinger processes with unbounded or singular potentials, conditional Sanov property, Information theoretic approximations for the \(M/G/1\) retrial queue, Pseudoconvex optimization for a special problem of paint industry, Conditional independence and natural conditional functions, On large deviations for particle systems associated with spatially homogeneous Boltzmann type equations, Soft evidential update for probabilistic multiagent systems, Entropy minimization and Schrödinger processes in infinite dimensions, Bayesian test of homogeneity for Markov chains, Contingency tables with prescribed marginals, Schrödinger's time-reversal of natural laws, Solving Fredholm equations by maximum entropy on the mean. Application to superresolution, Exponential and mixture families in quantum statistics: Dual structure and unbiased parameter estimation, SPIRIT and Léa Sombé: A study in probabilistic reasoning, The Gibbs principle for Markov jump processes, Probability densities from distances and discrimination, Maxentropic analysis of linear programming problems, Constant local dependence, Discrete probability distributions in the generalized moment problem, Bayesian graphical model determination using decision theory, On the measurability of knowledge acquisition and query processing., Rational hedging and valuation of integrated risks under constant absolute risk aversion., Hausdorff moment problem and maximum entropy: A unified approach, Approximation of linear programs by Bregman's \(D_F\) projections, An entropy characterization of the inverse Gaussian distribution and related goodness-of-fit test, An implementation of the iterative proportional fitting procedure by propagation trees., Silver jubilee issue, Maximum entropy principles for disordered spins, Maximum likelihood estimates via duality for log-convex models when cell probabilities are subject to convex constraints, A maxentropic procedure for reconstructing a distribution from its marginals, The curvature induced by covariance, Loglinear models and categorical data analysis with psychometric and econometric applications, Numerical inversion of Laplace transform on the real line of probability density functions, Tomographic reconstruction by maximum entropy in the mean: Unconstrained reconstructions, Information indices: Unification and applications., Connections between entropic and linear projections in asset pricing estimation, Limited information likelihood and Bayesian analysis, Information-theoretic estimation of preference parameters: macroeconomic applications and simulation evidence, On the recovery of joint distributions from limited information, Entropy estimate of probability densities having assigned moments: Hausdorff case, An information-geometric approach to a theory of pragmatic structuring, Optimal investment in incomplete markets when wealth may become negative., Fourier-Legendre approximation of a probability density from discrete data, Optimal scaling of MaLa for nonlinear regression., Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory, A new class of metric divergences on probability spaces and its applicability in statistics, Detecting higher-order interactions among the spiking events in a group of neurons, Generalized projections for non-negative functions, A Bayesian approach to diagnosis of asset pricing models, Many multivariate records, A solution to Schrödinger's problem of nonlinear integral equations, A general duality approach to \(I\)-projections, Inaccuracy rates and Hodges-Lehmann large deviation rates for parametric inferences with nuisance parameters, Entropy, limit theorems, and variational principles for disordered lattice systems, Refinements of the Gibbs conditioning principle, Some problems associated with Donsker-Varadhan processes, Dominating points and large deviations for random vectors, A note on conditional logics and entropy, The epsilon-skew-normal distribution for analyzing near-normal data, Conditional logic and the Principle of Entropy, Propagation of chaos in entropy, Convex pricing by a generalized entropy penalty, Nonnegative matrix factorization and I-divergence alternating minimization, Derivation of mixture distributions and weighted likelihood function as minimizers of KL-divergence subject to constraints, AN ITERATIVE INFERENCE MECHANISM FOR THE PROBABILISTIC EXPERT SYSTEM PES, The reconstruction of a positive function from its finite fourier series, A Justification for Applying the Principle of Minimum Relative Entropy to Information Integration Problems, Minimally informative distributions with given rank correlation for use in uncertainty analysis, A BAYESIAN INTERPRETATION OF MULTIPLE POINT ESTIMATES, On the Convergence of thep-Optimal Martingale Measures to the Minimal Entropy Martingale Measure, Maximum entropy in the generalized moment problem, Information-Geometric Measure for Neural Spikes, Maxentropic construction of risk neutral measures: discrete market models, MAXIMUM ENTROPY FOR REDUCED MOMENT PROBLEMS, From information to probability: An axiomatic approach-Inference is information processing, Limiting distributions for minimum relative entropy calibration, Conditional Independences among Four Random Variables II, A note about minimum relative entropy solutions of finite moment problems, Duality and infinite dimensional optimization, Identification of the drift coeffic plank equation from the momer its stationary solution, Entropic approximation in kinetic theory, Integration of Stochastic Models by Minimizing α-Divergence, Distribution-Invariant Risk Measures, Entropy, and Large Deviations, Unnamed Item, Fluctuation-Dissipation Theorem and Models of Learning, Laplace approximations for sums of independent random vectors, Numerical aspects of finite Hausdorff moment problem by maximum entropy approach, Informative barycentres in statistics, The Shannon information of filtrations and the additional logarithmic utility of insiders, An iterative procedure for general probability measures to obtain \(I\)-projections onto intersections of convex sets, Regularity properties and pathologies of position-space renormalization-group transformations: scope and limitations of Gibbsian theory, Testing the order of a model, Maximum entropy moment system of the semiconductor Boltzmann equation using Kane's dispersion relation, Network tomography: recent developments, Maximum entropy characterizations of the multivariate Liouville distributions, Exploratory analysis of contingency tables by loglinear formulation and generalizations of correspondence analysis, A large deviation approach to some transportation cost inequalities, Maximum Likelihood Set for Estimating a Probability Mass Function, A NOTE ON PROBABILITY ESTIMATION USING RECONSTRUCTABILITY ANALYSIS, Conditional principles for random weighted measures, The extraction of information from multiple point estimates, RETRACTED ARTICLE: Uncertainty modeling based on Bayesian network in ontology mapping, Computational aspects ofl-projections, A note on the geometry of kullback-leibler information numbers, UNCERTAINTY AND ESTIMATION IN RECONSTRUCTABILITY ANALYSIS, On the duality of the mixed entropy programming, Unnamed Item, Unnamed Item, Punktprozesse mit Wechselwirkung, General chi-square goodness-of-fit tests with data-dependent cells