Swarm gradient dynamics for global optimization: the mean-field limit case
From MaRDI portal
Abstract: Using jointly geometric and stochastic reformulations of nonconvex problems and exploiting a Monge-Kantorovich gradient system formulation with vanishing forces, we formally extend the simulated annealing method to a wide class of global optimization methods. Due to an inbuilt combination of a gradient-like strategy and particles interactions, we call them swarm gradient dynamics. As in the original paper of Holley-Kusuoka-Stroock, the key to the existence of a schedule ensuring convergence to a global minimizer is a functional inequality. One of our central theoretical contributions is the proof of such an inequality for one-dimensional compact manifolds. We conjecture the inequality to be true in a much wider setting. We also describe a general method allowing for global optimization and evidencing the crucial role of functional inequalities {`a} la {L}ojasiewicz.
Recommendations
- Swarm-based gradient descent method for non-convex optimization
- On the global convergence of particle swarm optimization methods
- A consensus-based model for global optimization and its mean-field limit
- Swarm-based gradient descent meets simulated annealing
- Swarm-based optimization with random descent
Cites work
- A family of functional inequalities: Łojasiewicz inequalities and displacement convex functions
- A strong approximation theorem for stochastic recursive algorithms
- Ant colony optimization theory: a survey
- Asymptotics of the spectral gap with applications to the theory of simulated annealing
- Best constants for Gagliardo-Nirenberg inequalities and applications to nonlinear diffusions.
- Contractions in the 2-Wasserstein length space and thermalization of granular media
- Convergence of Langevin MCMC in KL-divergence
- Entropy dissipation methods for degenerate parabolic problems and generalized Sobolev inequalities
- Equation of state calculations by fast computing machines
- Global convergence of stochastic gradient Hamiltonian Monte Carlo for nonconvex stochastic optimization: nonasymptotic performance bounds and momentum-based acceleration
- Global optimization with polynomials and the problem of moments
- Gradient flows in metric spaces and in the space of probability measures
- Gradient flows of time-dependent functionals in metric spaces and applications to PDEs
- scientific article; zbMATH DE number 43057 (Why is no real title available?)
- scientific article; zbMATH DE number 53884 (Why is no real title available?)
- scientific article; zbMATH DE number 1054244 (Why is no real title available?)
- scientific article; zbMATH DE number 4001209 (Why is no real title available?)
- scientific article; zbMATH DE number 3894218 (Why is no real title available?)
- Kinetic equilibration rates for granular media and related equations: entropy dissipation and mass transportation estimates
- Long-time behaviour and phase transitions for the McKean-Vlasov equation on the torus
- Mean field simulation for Monte Carlo integration
- Metastability. A potential-theoretic approach
- Nonasymptotic convergence analysis for the unadjusted Langevin algorithm
- Quantitative Harris-type theorems for diffusions and McKean-Vlasov processes
- Recuit simulé sur \(\mathbb{R}{}^ n\). Étude de l'évolution de l'énergie libre. (Simulated annealing on \(\mathbb{R}{}^ n\). Study of the evolution of free energy)
- Recursive Stochastic Algorithms for Global Optimization in $\mathbb{R}^d $
- Sampling can be faster than optimization
- Stochastic calculus in manifolds. With an appendix by P.A. Meyer
- THE GEOMETRY OF DISSIPATIVE EVOLUTION EQUATIONS: THE POROUS MEDIUM EQUATION
- The porous medium equation. Mathematical theory
- The Variational Formulation of the Fokker--Planck Equation
- Theoretical Guarantees for Approximate Sampling from Smooth and Log-Concave Densities
- Uniqueness for Fokker-Planck equations with measurable coefficients and applications to the fast diffusion equation
- Weighted ultrafast diffusion equations: from well-posedness to long-time behaviour
Cited in
(9)- Swarm-based optimization with random descent
- Swarm-based gradient descent meets simulated annealing
- Swarm-based gradient descent method for non-convex optimization
- On the convergence of global-optimization fraudulent stochastic algorithms
- Well-posedness and approximation of reflected McKean-Vlasov SDEs with applications
- Controlled stochastic processes for simulated annealing
- Freidlin-Wentzell type exit-time estimates for time-inhomogeneous diffusions and their applications
- Swarm-based optimization with jumps: a kinetic BGK framework and convergence analysis
- The asymptotic behavior of fraudulent algorithms
This page was built for publication: Swarm gradient dynamics for global optimization: the mean-field limit case
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6126662)
