Accelerating optimization over the space of probability measures

MaRDI QIDQ6982670zbMATH OpenFDO

Authors Shi Chen, Qin Li, Oliver Tse, Stephen J. Wright

Publication date 16 May 2025

Published in Journal of Machine Learning Research (JMLR) (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://jmlr.org/papers/v26/23-1288.html

zbMATH Keywords

Hamiltonian flowsacceleration methodsWasserstein gradient flowsheavy-ball methodmomentum-based methods

Mathematics Subject Classification ID

Convergence of probability measures (60B10) Learning and adaptive systems in artificial intelligence (68T05) Programming in abstract spaces (90C48)

Cites work

• scientific article; zbMATH DE number 6377992 (Why is no real title available?)
• scientific article; zbMATH DE number 3790208 (Why is no real title available?)
• scientific article; zbMATH DE number 1266748 (Why is no real title available?)
• scientific article; zbMATH DE number 1487987 (Why is no real title available?)
• scientific article; zbMATH DE number 2152346 (Why is no real title available?)
• scientific article; zbMATH DE number 7370590 (Why is no real title available?)
• scientific article; zbMATH DE number 7625201 (Why is no real title available?)
• A Systematic Approach to Lyapunov Analyses of Continuous-Time Models in Convex Optimization
• A blob method for diffusion
• A convexity principle for interacting gases
• A mean field view of the landscape of two-layer neural networks
• A variational perspective on accelerated methods in optimization
• Accelerated information gradient flow
• Adaptive restart for accelerated gradient schemes
• An introduction to variational methods for graphical models
• Asymptotic stabilization of inertial gradient dynamics with time-dependent viscosity
• Convergence of Langevin MCMC in KL-divergence
• Convergence to equilibrium in Wasserstein distance for damped Euler equations with interaction forces
• Convex analysis and nonlinear optimization. Theory and examples.
• Fast convergence of inertial dynamics and algorithms with asymptotic vanishing viscosity
• Generalized momentum-based methods: a Hamiltonian perspective
• Graphical models, exponential families, and variational inference
• Hamiltonian ODEs in the Wasserstein space of probability measures
• Interacting Langevin diffusions: gradient structure and ensemble Kalman sampler
• Is there an analog of Nesterov acceleration for gradient-based MCMC?
• Linear coupling: an ultimate unification of gradient and mirror descent
• Mean field analysis of neural networks: a law of large numbers
• Minimax estimation of smooth densities in Wasserstein distance
• On explicit L^2-convergence rate estimate for underdamped Langevin dynamics
• On the Cauchy problem for Boltzmann equations: Global existence and weak stability
• On the long time behavior of second order differential equations with asymptotically small dissipation
• Optimal Transport
• Polar factorization and monotone rearrangement of vector‐valued functions
• Semi-discrete optimization through semi-discrete optimal transport: a framework for neural architecture search
• Some methods of speeding up the convergence of iteration methods
• THE GEOMETRY OF DISSIPATIVE EVOLUTION EQUATIONS: THE POROUS MEDIUM EQUATION
• Wasserstein Hamiltonian flows

Cited in

(2)

• Accelerated Stein variational gradient flow
• A particle algorithm for mean-field variational inference

This page was built for publication: Accelerating optimization over the space of probability measures

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6982670)