I-divergence geometry of probability distributions and minimization problems

DOI10.1214/aop/1176996454zbMath0318.60013OpenAlexW2160709761WikidataQ100708815 ScholiaQ100708815MaRDI QIDQ1222453

Publication date: 1975

Published in: The Annals of Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aop/1176996454

Mathematics Subject Classification ID

Probability distributions: general theory (60E05) Variational problems in a geometric measure-theoretic setting (49Q20) Positive matrices and their generalizations; cones of matrices (15B48) Statistical aspects of information-theoretic topics (62B10)

Related Items

Information-Geometric Measure for Neural Spikes, Maxentropic construction of risk neutral measures: discrete market models, Maximum entropy and integer partitions, Continuity of f-projections and applications to the iterative proportional fitting procedure, Generalized maximum entropy estimation, Convergence and finite sample approximations of entropic regularized Wasserstein distances in Gaussian and RKHS settings, Identification of the drift coeffic plank equation from the momer its stationary solution, A conditional-logical approach to minimum cross-entropy, MAXIMUM ENTROPY FOR REDUCED MOMENT PROBLEMS, Quantitative Stability of Regularized Optimal Transport and Convergence of Sinkhorn's Algorithm, From information to probability: An axiomatic approach-Inference is information processing, Asymptotics for Semidiscrete Entropic Optimal Transport, DISCRIMINATION-FREE INSURANCE PRICING, Limiting distributions for minimum relative entropy calibration, Entropic approximation in kinetic theory, Two generalized bivariate FGM distributions and rank reduction, Unnamed Item, Asymptotically optimal robust information-based quick detection for general stochastic models with nonparametric postchange uncertainty, On the minimal entropy martingale measure for Lévy processes, Unnamed Item, Entropic regularization of Wasserstein distance between infinite-dimensional Gaussian measures and Gaussian processes, Information in Probability: Another Information-Theoretic Proof of a Finite de Finetti Theorem, Bayesian coherentism, Convergence of estimative density: criterion for model complexity and sample size, Reciprocal properties of random fields on undirected graphs, An entropic generalization of Caffarelli's contraction theorem via covariance inequalities, Toward a mathematical theory of trajectory inference, Quantitative uniform stability of the iterative proportional fitting procedure, Computational methods for adapted optimal transport, An Improved Central Limit Theorem and Fast Convergence Rates for Entropic Transportation Costs, Conditional inference of Poisson models and information geometry: an ancillary review, Stressing dynamic loss models, On a cornerstone of bare-simulation distance/divergence optimization, Dispersion-constrained martingale Schrödinger problems and the exact joint S\&P 500/VIX smile calibration puzzle, Minimal Kullback–Leibler Divergence for Constrained Lévy–Itô Processes, Unnamed Item, Conditional Independences among Four Random Variables II, Unnamed Item, Iterated Proportional Fitting Procedure and Infinite Products of Stochastic Matrices, A note about minimum relative entropy solutions of finite moment problems, Fluctuation-Dissipation Theorem and Models of Learning, RECOVERING PORTFOLIO DEFAULT INTENSITIES IMPLIED BY CDO QUOTES, BAYESIAN NETWORK REVISION WITH PROBABILISTIC CONSTRAINTS, Laplace approximations for sums of independent random vectors, Numerical aspects of finite Hausdorff moment problem by maximum entropy approach, Shannon entropy: a rigorous notion at the crossroads between probability, information theory, dynamical systems and statistical physics, On the Convergence of thep-Optimal Martingale Measures to the Minimal Entropy Martingale Measure, Integration of Stochastic Models by Minimizing α-Divergence, Distribution-Invariant Risk Measures, Entropy, and Large Deviations, Duality and infinite dimensional optimization, Maximum entropy in the generalized moment problem, Compressing strongly connected subgroups in social networks: An entropy-based approach, Context-Specific and Local Independence in Markovian Dependence Structures, Unnamed Item, Optimal Stopping Under Uncertainty in Drift and Jump Intensity, Density modification-based reliability sensitivity analysis, Orlicz Addition for Measures and an Optimization Problem for the -divergence, Unnamed Item, Stochastic Control Liaisons: Richard Sinkhorn Meets Gaspard Monge on a Schrödinger Bridge, Positive contraction mappings for classical and quantum Schrödinger systems, Maximum Entropy Methods for Texture Synthesis: Theory and Practice, A sequential quadratic Hamiltonian scheme to compute optimal relaxed controls, Robust Portfolio Choice and Indifference Valuation, Iterative Bregman Projections for Regularized Transportation Problems, Entropy-based goodness-of-fit tests—a unifying framework: Application to DNA replication, Bayesian model averaging for dynamic panels with an application to a trade gravity model, Finite Sample Approximations of Exact and Entropic Wasserstein Distances Between Covariance Operators and Gaussian Processes, Large deviations for lattice systems. II: Nonstationary independent fields, Schrödinger processes with unbounded or singular potentials, conditional Sanov property, On convergence of conditional probability measures, Alternate scaling algorithm for biproportional divisor methods, Information optimality and Bayesian modelling, Deformed exponentials and applications to finance, Bayesian testing of a point null hypothesis based on the latent information prior, Applications of entropy in finance: a review, Consistency and generalization bounds for maximum entropy density estimation, Laplace approximations for sums of independent random vectors. II: Degenerate maxima and manifolds of maxima, On the sufficiency of pairwise interactions in maximum entropy models of networks, Information theoretic approximations for the \(M/G/1\) retrial queue, The information geometry of Bregman divergences and some applications in multi-expert reasoning, Information geometry on complexity and stochastic interaction, A relationship between the ordinary maximum entropy method and the method of maximum entropy in the mean, Density reconstructions with errors in the data, Dynamic quantile models, Pseudoconvex optimization for a special problem of paint industry, Conditional independence and natural conditional functions, On the construction of approximate multi-factor designs from given marginals using the iterative proportional fitting procedure, On large deviations for particle systems associated with spatially homogeneous Boltzmann type equations, Computational complexity of queries based on itemsets, Soft evidential update for probabilistic multiagent systems, Statistical aspects of divergence measures, Factor analysis models via I-divergence optimization, Large deviation estimates for a conditional probability distribution. Applications to random interaction Gibbs measures, Entropy minimization and Schrödinger processes in infinite dimensions, Bayesian test of homogeneity for Markov chains, Context-specific independence in graphical log-linear models, Contingency tables with prescribed marginals, Schrödinger's time-reversal of natural laws, Temporal behavior of the conditional and Gibbs' entropies, Solving Fredholm equations by maximum entropy on the mean. Application to superresolution, Deviations bounds and conditional principles for thin sets, Poisson inverse problems, Estimation of weighted multinomial probabilities under log-convex constraints, Entropy-convergence in Stieltjes and Hamburger moment problem, A survey of the Schrödinger problem and some of its connections with optimal transport, Characterizing the principle of minimum cross-entropy within a conditional-logical framework, On maximum entropy and minimum KL-divergence optimization by Gröbner basis methods, An informational divergence geometry for stochastic matrices, Equivalence and nonequivalence of ensembles: thermodynamic, macrostate, and measure levels, On the ellipsoidal statistical model for polyatomic gases, Information theory for maximum likelihood estimation of diffusion models, On the closure of relational models, A concept for the evolution of relational probabilistic belief states and the computation of their changes under optimum entropy semantics, Minimal martingale measure: pricing and hedging in a pure jump model under restricted information, Uncertainty averse preferences, Stochastic approximation and Newton's estimate of a mixing distribution, Decomposition of Kullback-Leibler risk and unbiasedness for parameter-free estimators, Information geometry in functional spaces of classical and quantum finite statistical systems, Optimal stopping with dynamic variational preferences, Relational models for contingency tables, Maximum likelihood estimation in log-linear models, Informational divergence and the dissimilarity of probability distributions, Variational processes from the weak forward equation, Causality and maximum entropy updating, Boosting multi-features with prior knowledge for mini unmanned helicopter landmark detection, Approximation of stationary processes by hidden Markov models, Minimization of entropy functionals, Cross entropy minimization in uninvadable states of complex populations, Equivalence of ensembles for two-species zero-range invariant measures, Discontinuous condensation transition and nonequivalence of ensembles in a zero-range process, Model selection tests for moment inequality models, On the effective implementation of the iterative proportional fitting procedure, An overview of algorithmic approaches to compute optimum entropy distributions in the expert system shell MECore (extended version), Expert information and nonparametric Bayesian inference of rare events, Adjustment of importance weights in multiattribute value models by minimum discrimination information, Order independence and factor convergence in iterative scaling, An application of Lipschitzian global optimization to product design, Techniques for generic probabilistic inversion, Note on the Schrödinger equation and \(I\)-projections, Assessing misspecified asset pricing models with empirical likelihood estimators, Iterative proportional scaling via decomposable submodels for contingency tables, Large deviations and the propagation of chaos for Schrödinger processes, Unified generalized iterative scaling and its applications, Exponential series estimator of multivariate densities, Finite Kullback information diffusion laws with fixed marginals and associated large deviations functionals, Compositional models and conditional independence in evidence theory, Markov process large deviations in \(\tau\)-topology, Hausdorff moment problem and maximum entropy: on the existence conditions, On the maximum entropy principle for uniformly ergodic Markov chains, Asymptotic inference for semiparametric association models, Symmetric measures via moments, Testing for non-nested conditional moment restrictions using unconditional empirical likelihood, A refined Jensen's inequality in Hilbert spaces and empirical approximations, Bregman divergences in the \((m\times k)\)-partitioning problem, Biproportional scaling of matrices and the iterative proportional fitting procedure, Convergence of Markov chains in information divergence, Linearly constrained estimation by mathematical programming, Conditional iterative proportional fitting for Gaussian distributions, The formal definition of reference priors, High resolution quantization and entropy coding of jump processes, Bounds for stop-loss premium under restrictions on \(I\)-divergence, On the dual of linear inverse problems, Covariance selection and multivariate dependence, Order conditioned independence of real random variables, Information theoretic analysis for a general queueing system at equilibrium with application to queues in tandem, Information-geometric equivalence of transportation polytopes, Escort distributions minimizing the Kullback-Leibler divergence for a large deviations principle and tests of entropy level, An information-geometric approach to a theory of pragmatic structuring, Optimal investment in incomplete markets when wealth may become negative., Fourier-Legendre approximation of a probability density from discrete data, The geodesic distance on the generalized gamma manifold for texture image retrieval, Optimal scaling of MaLa for nonlinear regression., Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory, A new class of metric divergences on probability spaces and its applicability in statistics, Adaptive log-density estimation, Reverse sensitivity testing: what does it take to break the model?, \(A\)-hypergeometric distributions and Newton polytopes, Detecting higher-order interactions among the spiking events in a group of neurons, PAC-Bayesian high dimensional bipartite ranking, Generalized projections for non-negative functions, A Bayesian approach to diagnosis of asset pricing models, Information geometry of operator scaling, Entropical optimal transport, Schrödinger's system and algorithms, Entropy-regularized 2-Wasserstein distance between Gaussian measures, The empirical saddlepoint estimator, Calibration of the risk-neutral density function by maximization of a two-parameter entropy, Many multivariate records, A solution to Schrödinger's problem of nonlinear integral equations, A general duality approach to \(I\)-projections, Inaccuracy rates and Hodges-Lehmann large deviation rates for parametric inferences with nuisance parameters, Entropy, limit theorems, and variational principles for disordered lattice systems, Refinements of the Gibbs conditioning principle, Sample dependence in the maximum entropy solution to the generalized moment problem, Full Bayesian inference with hazard mixture models, Stability of entropic optimal transport and Schrödinger bridges, Exponential and mixture families in quantum statistics: Dual structure and unbiased parameter estimation, SPIRIT and Léa Sombé: A study in probabilistic reasoning, The Gibbs principle for Markov jump processes, Analysis of a micro-macro acceleration method with minimum relative entropy moment matching, Some problems associated with Donsker-Varadhan processes, Probability densities from distances and discrimination, Dominating points and large deviations for random vectors, Maxentropic analysis of linear programming problems, Two-dimensional distribution of streamwise velocity in open channel flow using maximum entropy principle: incorporation of additional constraints based on conservation laws, Constant local dependence, A proof of the Caffarelli contraction theorem via entropic regularization, Deformed statistics Kullback-Leibler divergence minimization within a scaled Bregman framework, Hypergraphs as a mean of discovering the dependence structure of a discrete multivariate probability distribution, Robust parameter estimation for stationary processes by an exotic disparity from prediction problem, Axiomatisation of fully probabilistic design revisited, Concavification of free entropy, The structure of low-complexity Gibbs measures on product spaces, Discrete probability distributions in the generalized moment problem, Bayesian graphical model determination using decision theory, A note on utility based pricing and asymptotic risk diversification, On the measurability of knowledge acquisition and query processing., Estimation of local microcanonical averages in two lattice mean-field models using coupling techniques, Comparing apples and oranges: measuring differences between exploratory data mining results, Rational hedging and valuation of integrated risks under constant absolute risk aversion., A multi-objective interpretation of optimal transport, An optimal transport approach for the Schrödinger bridge problem and convergence of Sinkhorn algorithm, A note on conditional logics and entropy, The epsilon-skew-normal distribution for analyzing near-normal data, Entropic regularization of continuous optimal transport problems, Pseudo-Gibbs sampler for discrete conditional distributions, Conditional logic and the Principle of Entropy, Sensitivity analysis with \(\chi^2\)-divergences, Information-based parameterization of the log-linear model for categorical data analysis, Generalized incompressible flows, multi-marginal transport and Sinkhorn algorithm, An information criterion for model selection with missing data via complete-data divergence, On the truncated Hausdorff moment problem under Sobolev regularity conditions, Compatibility, desirability, and the running intersection property, Maximum entropy distributions inferred from option portfolios on an asset, Condensation in stochastic particle systems with stationary product measures, Incorporating views on marginal distributions in the calibration of risk models, A quasi-Bayesian perspective to online clustering, Projection theorems and estimating equations for power-law models, On generalization in moment-based domain adaptation, On the unification of possibilistic fuzzy clustering: axiomatic development and convergence analysis, The term structure of Sharpe ratios and arbitrage-free asset pricing in continuous time, Better and simpler error analysis of the Sinkhorn-Knopp algorithm for matrix scaling, Asymptotic distribution and convergence rates of stochastic algorithms for entropic optimal transportation between probability measures, Maximum entropy principles for disordered spins, Maximum likelihood estimates via duality for log-convex models when cell probabilities are subject to convex constraints, Domain decomposition for entropy regularized optimal transport, A maxentropic procedure for reconstructing a distribution from its marginals, The curvature induced by covariance, Hausdorff moment problem and maximum entropy: A unified approach, Applications of weak transport theory, Loglinear models and categorical data analysis with psychometric and econometric applications, Approximation of linear programs by Bregman's \(D_F\) projections, Entropic optimal transport: convergence of potentials, Numerical inversion of Laplace transform on the real line of probability density functions, Tomographic reconstruction by maximum entropy in the mean: Unconstrained reconstructions, An entropy characterization of the inverse Gaussian distribution and related goodness-of-fit test, Information indices: Unification and applications., Connections between entropic and linear projections in asset pricing estimation, Limited information likelihood and Bayesian analysis, Information-theoretic estimation of preference parameters: macroeconomic applications and simulation evidence, On the recovery of joint distributions from limited information, Entropic optimal transport: geometry and large deviations, Entropy for evaluation of Dempster-Shafer belief function models, Entropy estimate of probability densities having assigned moments: Hausdorff case, Martingale Schrödinger bridges and optimal semistatic portfolios, An inverse Sanov theorem for exponential families, An implementation of the iterative proportional fitting procedure by propagation trees., Silver jubilee issue, Unnamed Item, Propagation of chaos in entropy, AN ITERATIVE INFERENCE MECHANISM FOR THE PROBABILISTIC EXPERT SYSTEM PES, THE MINIMAL κ-ENTROPY MARTINGALE MEASURE, RETRACTED ARTICLE: Uncertainty modeling based on Bayesian network in ontology mapping, Coordinate-free analysis of trends in British social mobility, Foundations of compositional model theory, Kullback--Leibler Approximation for Probability Measures on Infinite Dimensional Spaces, The reconstruction of a positive function from its finite fourier series, Entropic Approximation of Wasserstein Gradient Flows, Updating a progic, Exploratory analysis of contingency tables by loglinear formulation and generalizations of correspondence analysis, A Justification for Applying the Principle of Minimum Relative Entropy to Information Integration Problems, Functional calibration estimation by the maximum entropy on the mean principle, Graphical Models and Message-Passing Algorithms: Some Introductory Lectures, A large deviation approach to some transportation cost inequalities, Accumulation points of the iterative proportional fitting procedure, The composite iteration algorithm for finding efficient and financially fair risk-sharing rules, From Infinite to Finite Programs: Explicit Error Bounds with Applications to Approximate Dynamic Programming, A note on the geometry of kullback-leibler information numbers, Qualitative Robustness in Bayesian Inference, Simple bounds for utility maximization with small transaction costs, A Family of Maximum Entropy Densities Matching Call Option Prices, Hierarchical Models, Marginal Polytopes, and Linear Codes, Iterative Scaling in Curved Exponential Families, Unnamed Item, Traversing the Schrödinger bridge strait: Robert Fortet's marvelous proof redux, Unnamed Item, Convex pricing by a generalized entropy penalty, Conditionalization of Copula-Based Models, A new reliability based optimization of tuned mass damper parameters using energy approach, Density forecast of financial returns using decomposition and maximum entropy, Convergence rate of general entropic optimal transport costs, Unnamed Item, On assessing the accuracy of defect free energy computations, Minimally informative distributions with given rank correlation for use in uncertainty analysis, A note on weighted premium calculation principles, Probabilities on sentences in an expressive logic, Theory-coherent forecasting, BOUNDING WRONG‐WAY RISK IN CVA CALCULATION, Punktprozesse mit Wechselwirkung, Generalized entropic risk measures and related BSDEs, Analysis of trophic networks: an optimisation approach, UNCERTAINTY AND ESTIMATION IN RECONSTRUCTABILITY ANALYSIS, A note on the geometric interpretation of the EM algorithm in estimating item characteristics and student abilities, Maximum Likelihood Set for Estimating a Probability Mass Function, On the duality of the mixed entropy programming, Backward stochastic partial differential equations related to utility maximization and hedging, Transformation-based nonparametric estimation of multivariate densities, Minimum \(K_\phi\)-divergence estimators for multinomial models and applications, The blind men and the elephant: on meeting the problem of multiple truths in data from clustering and pattern mining perspectives, A Localization Approach to Improve Iterative Proportional Scaling in Gaussian Graphical Models, An Algebraic Implicitization and Specialization of Minimum KL-Divergence Models, Nonnegative matrix factorization and I-divergence alternating minimization, Derivation of mixture distributions and weighted likelihood function as minimizers of KL-divergence subject to constraints, Informative barycentres in statistics, An approach to hybrid probabilistic models, The Shannon information of filtrations and the additional logarithmic utility of insiders, An iterative procedure for general probability measures to obtain \(I\)-projections onto intersections of convex sets, Regularity properties and pathologies of position-space renormalization-group transformations: scope and limitations of Gibbsian theory, Testing the order of a model, On some recent advances on high dimensional Bayesian statistics, Maximum entropy moment system of the semiconductor Boltzmann equation using Kane's dispersion relation, EM Algorithms, Network tomography: recent developments, On the Bulk Velocity of Brownian Ratchets, Maximum entropy characterizations of the multivariate Liouville distributions, A NOTE ON PROBABILITY ESTIMATION USING RECONSTRUCTABILITY ANALYSIS, Continuity of the maximum-entropy inference, Obtaining a Trapezoidal Distribution, ROBUST EXPONENTIAL HEDGING AND INDIFFERENCE VALUATION, An alternative quasi likelihood approach, Bayesian analysis and data-based inference for model specification, An asymptotic analysis of likelihood-based diffusion model selection using high frequency data, A BAYESIAN INTERPRETATION OF MULTIPLE POINT ESTIMATES, Generalized relative entropies and the capacity of classical-quantum channels, BAYESIAN NETWORK REASONING WITH UNCERTAIN EVIDENCES, Axiomatic generalization of the membership degree weighting function for fuzzy \(C\) means clustering: theoretical development and convergence analysis, Conditional principles for random weighted measures, Degeneracy in sparse ERGMs with functions of degrees as sufficient statistics, Robust optimal risk sharing and risk premia in expanding pools, Unnamed Item, Information Theory, Relative Entropy and Statistics, TESTING FOR NONNESTED CONDITIONAL MOMENT RESTRICTIONS VIA CONDITIONAL EMPIRICAL LIKELIHOOD, Entropic Projections and Dominating Points, Delegated updates in epistemic graphs for opponent modelling, An improved Landauer principle with finite-size corrections, General chi-square goodness-of-fit tests with data-dependent cells, Iterative Proportional Scaling Revisited: A Modern Optimization Perspective, EXISTENCE AND CHARACTERIZATION OF CONDITIONAL DENSITY PROJECTIONS, Integrating inconsistent data in a probabilistic model, Unnamed Item, EQUITY CORRELATIONS IMPLIED BY INDEX OPTIONS: ESTIMATION AND MODEL UNCERTAINTY ANALYSIS, On an algorithm for solving Fredholm integrals of the first kind, Bayesian Estimation and Comparison of Moment Condition Models, The extraction of information from multiple point estimates, Computational aspects ofl-projections, Deviations of convex and coherent entropic risk measures, Maximum entropy copula with given diagonal section, APPROXIMATE BREGMAN NEAR NEIGHBORS IN SUBLINEAR TIME: BEYOND THE TRIANGLE INEQUALITY, Compositional models in valuation-based systems