From particle swarm optimization to consensus based optimization: Stochastic modeling and mean-field limit

DOI10.1142/S0218202521500342zbMath1473.35570arXiv2012.05613OpenAlexW3185626819MaRDI QIDQ5164246

Sara Grassi, Lorenzo Pareschi

Publication date: 10 November 2021

Published in: Mathematical Models and Methods in Applied Sciences (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2012.05613

zbMATH Keywords

global optimizationparticle swarm optimizationmean field limitVlasov-Fokker-Planck equationconsensus based optimizationsmall inertia limit

Mathematics Subject Classification ID

Numerical optimization and variational techniques (65K10) Kinetic theory of gases in time-dependent statistical mechanics (82C40) Vlasov equations (35Q83) Probabilistic methods, particle methods, etc. for initial value and initial-boundary value problems involving PDEs (65M75)

Related Items (15)

Constrained Consensus-Based Optimization ⋮ Trends in Consensus-Based Optimization ⋮ Binary interaction methods for high dimensional global optimization and machine learning ⋮ Zero-Inertia Limit: From Particle Swarm Optimization to Consensus-Based Optimization ⋮ Anisotropic Diffusion in Consensus-Based Optimization on the Sphere ⋮ On the mean‐field limit for the consensus‐based optimization ⋮ Consensus-based optimization via jump-diffusion stochastic differential equations ⋮ Kinetic-based optimization enhanced by genetic dynamics ⋮ An adaptive consensus based method for multi-objective optimization with uniform Pareto front approximation ⋮ On the global convergence of particle swarm optimization methods ⋮ Ensemble-Based Gradient Inference for Particle Methods in Optimization and Sampling ⋮ Unnamed Item ⋮ A constrained consensus based optimization algorithm and its application to finance ⋮ Propagation of chaos: a review of models, methods and applications. I: Models and methods ⋮ Propagation of chaos: a review of models, methods and applications. II: Applications

Uses Software

• PRMLT

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Optimization by Simulated Annealing
• A literature survey of benchmark functions for global optimisation problems
• Simulated annealing via Sobolev inequalities
• Consensus-based global optimization with personal best
• Random batch methods (RBM) for interacting particle systems
• Cucker-Smale flocking particles with multiplicative noises: stochastic mean-field limit and phase transition
• A review of the mean field limits for Vlasov equations
• Variational approach to coarse-graining of generalized gradient flows
• Ant colony optimization theory: a survey
• STOCHASTIC MEAN-FIELD LIMIT: NON-LIPSCHITZ FORCES AND SWARMING
• A consensus-based model for global optimization and its mean-field limit
• Particle, kinetic, and hydrodynamic models of swarming
• Convergence of a first-order consensus-based global optimization algorithm
• Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
• An analytical framework for consensus-based global optimization method
• Numerical methods for kinetic equations
• Stochastic Calculus
• A consensus-based global optimization method for high dimensional machine learning problems
• Binary Interaction Algorithms for the Simulation of Flocking and Swarming Dynamics
• A quest toward a mathematical theory of the dynamics of swarms
• Monte Carlo sampling methods using Markov chains and their applications
• Handbook of metaheuristics

This page was built for publication: From particle swarm optimization to consensus based optimization: Stochastic modeling and mean-field limit