An analytical framework for consensus-based global optimization method
From MaRDI portal
Publication:4569644
global optimizationagent-based modelsmean-field limitopinion dynamicsstochastic dynamicsconsensus formation
Approximation methods and heuristics in mathematical programming (90C59) PDEs in connection with game theory, economics, social and behavioral sciences (35Q91) Stochastic programming (90C15) Dynamical systems in optimization and economics (37N40) Stochastic ordinary differential equations (aspects of stochastic analysis) (60H10) Fokker-Planck equations (35Q84) PDEs in connection with control and optimization (35Q93) Stochastic methods (Fokker-Planck, Langevin, etc.) applied to problems in time-dependent statistical mechanics (82C31) Heterogeneous agent models (91B69)
Abstract: In this paper we provide an analytical framework for investigating the efficiency of a consensus-based model for tackling global optimization problems. This work justifies the optimization algorithm in the mean-field sense showing the convergence to the global minimizer for a large class of functions. Theoretical results on consensus estimates are then illustrated by numerical simulations where variants of the method including nonlinear diffusion are introduced.
Recommendations
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- Consensus-based optimization via jump-diffusion stochastic differential equations
- A consensus-based model for global optimization and its mean-field limit
- Stochastic consensus dynamics for nonconvex optimization on the Stiefel manifold: mean-field limit and convergence
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
Cites work
- scientific article; zbMATH DE number 4211245 (Why is no real title available?)
- scientific article; zbMATH DE number 193842 (Why is no real title available?)
- scientific article; zbMATH DE number 3438157 (Why is no real title available?)
- scientific article; zbMATH DE number 1909499 (Why is no real title available?)
- scientific article; zbMATH DE number 960162 (Why is no real title available?)
- A consensus-based model for global optimization and its mean-field limit
- A multiscale meshfree method for macroscopic approximations of interacting particle systems
- A survey on metaheuristics for stochastic combinatorial optimization
- Ant colony optimization theory: a survey
- Asymptotic flocking dynamics for the kinetic Cucker-Smale model
- Asymptotics of the spectral gap with applications to the theory of simulated annealing
- Consensus Problems in Networks of Agents With Switching Topology and Time-Delays
- Contagion shocks in one dimension
- Convergence of the Mass-Transport Steepest Descent Scheme for the Subcritical Patlak–Keller–Segel Model
- Explicit flock solutions for quasi-Morse potentials
- Finite speed of propagation in porous media by mass transportation methods
- From particle to kinetic and hydrodynamic descriptions of flocking
- From the microscale to collective crowd dynamics
- Genetic Algorithms
- Heterophilious dynamics enhances consensus
- Kinetic models of opinion formation
- Nonlinear stability of flock solutions in second-order swarming models
- On the mathematics of emergence
- Particle, kinetic, and hydrodynamic models of swarming
- Separability and completeness for the Wasserstein distance
- Simulated annealing via Sobolev inequalities
- Stability of a 4th-order curvature condition arising in optimal transport theory
- Stochastic Calculus
- Swarming on random graphs
- Uniform convergence to equilibrium for granular media
Cited in
(62)- Optimization by linear kinetic equations and mean-field Langevin dynamics
- Leveraging memory effects and gradient information in consensus-based optimisation: on global convergence in mean-field law
- Swarm-based gradient descent meets simulated annealing
- Consensus-based optimization methods converge globally
- Control methods in hyperbolic PDEs. Abstracts from the workshop held November 5--10, 2023
- On the stochastic robustness of complete clustering predictability for a first‐order consensus model
- Time-discrete momentum consensus-based optimization algorithm and its application to Lyapunov function approximation
- Sharp propagation of chaos for the ensemble Langevin sampler
- Consensus-based optimization for multi-objective problems: a multi-swarm approach
- Swarm-based optimization with random descent
- An adaptive consensus based method for multi-objective optimization with uniform Pareto front approximation
- Swarm-based gradient descent method for non-convex optimization
- Kinetic-based optimization enhanced by genetic dynamics
- Ensemble-Based Gradient Inference for Particle Methods in Optimization and Sampling
- One dimensional consensus based algorithm for non-convex optimization
- Constrained Consensus-Based Optimization
- An anisotropic interaction model with collision avoidance
- Model predictive control with random batch methods for a guiding problem
- On the global convergence of particle swarm optimization methods
- Mean field models for large data-clustering problems
- Collective behaviors of stochastic agent-based models and applications to finance and optimization
- Aggregation and disaggregation of active particles on the unit sphere with time-dependent frequencies
- A consensus-based global optimization method for high dimensional machine learning problems
- Consensus-based optimization via jump-diffusion stochastic differential equations
- Consensus‐based sampling
- Propagation of chaos: a review of models, methods and applications. II: Applications
- Optimal control problems in transport dynamics with additive noise
- A consensus-based model for global optimization and its mean-field limit
- Anisotropic diffusion in consensus-based optimization on the sphere
- Convergence of a first-order consensus-based global optimization algorithm
- On the Generalized Langevin Equation for Simulated Annealing
- Controlled pattern formation of stochastic Cucker-Smale systems with network structures
- Binary interaction methods for high dimensional global optimization and machine learning
- Convergence analysis of the discrete consensus-based optimization algorithm with random batch interactions and heterogeneous noises
- On the completely separable state for the Lohe tensor model
- A note on the mean-field limit for the particle swarm optimization
- Long-time behaviour and phase transitions for the McKean-Vlasov equation on the torus
- A constrained consensus based optimization algorithm and its application to finance
- Pseudospectral methods and iterative solvers for optimization problems from multiscale particle dynamics
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
- Vehicular traffic, crowds, and swarms: from kinetic theory and multiscale methods to applications and research perspectives
- Interacting Langevin diffusions: gradient structure and ensemble Kalman sampler
- Derivative-Free Bayesian Inversion Using Multiscale Dynamics
- Zero-inertia limit: from particle swarm optimization to consensus-based optimization
- Trends in Consensus-Based Optimization
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- Efficient derivative-free Bayesian inference for large-scale inverse problems
- Instantaneous control of interacting particle systems in the mean-field limit
- Mean-field optimal control for biological pattern formation
- Stochastic consensus dynamics for nonconvex optimization on the Stiefel manifold: mean-field limit and convergence
- Convergence analysis of particle swarm optimization in one dimension
- Mean-field optimal control and optimality conditions in the space of probability measures
- On the mean‐field limit for the consensus‐based optimization
- A consensus-based global optimization method with adaptive momentum estimation
- Cluster synchrony of high-dimensional Kuramoto models with higher-order couplings
- A short discussion is followed by an agreement on the global minimum: consensus-based global optimization
- scientific article; zbMATH DE number 7626752 (Why is no real title available?)
- Iterated Kalman methodology for inverse problems
- Complete solvability of the inertial spin model with an averaged spin
- Convergence and error estimates for time-discrete consensus-based optimization algorithms
- Consensus-based global optimization with personal best
- Birth–death dynamics for sampling: global convergence, approximations and their asymptotics
This page was built for publication: An analytical framework for consensus-based global optimization method
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4569644)
