Convergence of a first-order consensus-based global optimization algorithm
From MaRDI portal
Abstract: Global optimization of a non-convex objective function often appears in large-scale machine-learning and artificial intelligence applications. Recently, consensus-based optimization (in short CBO) methods have been introduced as one of the gradient-free optimization methods. In this paper, we provide a convergence analysis for the first-order CBO method in cite{C-J-L-Z}. Prior to the current work, the convergence study was carried out for CBO methods on corresponding mean-field limit, a Fokker-Planck equation, which does not imply the convergence of the CBO method {it per se}. Based on the consensus estimate directly on the first-order CBO model, we provide a convergence analysis of the first-order CBO method cite{C-J-L-Z} without resorting to the corresponding mean-field model. Our convergence analysis consists of two steps. In the first step, we show that the CBO model exhibits a global consensus time asymptotically for any initial data, and in the second step, we provide a sufficient condition on system parameters--which is dimension independent-- and initial data which guarantee that the converged consensus state lies in a small neighborhood of the global minimum almost surely.
Recommendations
- A consensus-based model for global optimization and its mean-field limit
- One dimensional consensus based algorithm for non-convex optimization
- A consensus-based global optimization method with adaptive momentum estimation
- Convergence and error estimates for time-discrete consensus-based optimization algorithms
- An analytical framework for consensus-based global optimization method
Cites work
- scientific article; zbMATH DE number 4048925 (Why is no real title available?)
- scientific article; zbMATH DE number 3471821 (Why is no real title available?)
- scientific article; zbMATH DE number 3524004 (Why is no real title available?)
- scientific article; zbMATH DE number 2121575 (Why is no real title available?)
- A consensus-based model for global optimization and its mean-field limit
- A course on large deviations with an introduction to Gibbs measures
- A simple proof of the Cucker-Smale flocking dynamics and mean-field limit
- An analytical framework for consensus-based global optimization method
- Chemical oscillations, waves, and turbulence
- Emergence of time-asymptotic flocking in a stochastic Cucker-Smale system
- Emergent behaviors of the Cucker–Smale ensemble under attractive–repulsive couplings and Rayleigh frictions
- Heterophilious dynamics enhances consensus
- On the mathematics of emergence
- Optimization by simulated annealing
- Random batch methods (RBM) for interacting particle systems
- Stochastic flocking dynamics of the Cucker-Smale model with multiplicative white noises
- Synchronization: a universal concept in nonlinear sciences
- Vehicular traffic, crowds, and swarms: from kinetic theory and multiscale methods to applications and research perspectives
Cited in
(51)- Polarized consensus-based dynamics for optimization and sampling
- Swarm-based optimization with random descent
- Smoothing iterative consensus-based optimization algorithm for nonsmooth nonconvex optimization problems with global optimality
- Zero-inertia limit: from particle swarm optimization to consensus-based optimization
- Convergence analysis of particle swarm optimization in one dimension
- Two-point correlation function and its applications to the Schrödinger-Lohe type models
- Well-posedness and approximation of reflected McKean-Vlasov SDEs with applications
- A short discussion is followed by an agreement on the global minimum: consensus-based global optimization
- scientific article; zbMATH DE number 7626752 (Why is no real title available?)
- Convergence and error estimates for time-discrete consensus-based optimization algorithms
- Trends in Consensus-Based Optimization
- Uniform-in-time error estimate of the random batch method for the Cucker-Smale model
- Aggregation and disaggregation of active particles on the unit sphere with time-dependent frequencies
- Time-discrete momentum consensus-based optimization algorithm and its application to Lyapunov function approximation
- A PDE framework of consensus-based optimization for objectives with multiple global minimizers
- A constrained consensus based optimization algorithm and its application to finance
- A consensus-based global optimization method for high dimensional machine learning problems
- Consensus, error estimates and applications of first- and second-order consensus-based optimization algorithms
- On the mathematical theory of behavioral swarms emerging collective dynamics
- Constrained Consensus-Based Optimization
- Consensus-based optimisation with truncated noise
- A note on the mean-field limit for the particle swarm optimization
- Model predictive control with random batch methods for a guiding problem
- Consensus‐based sampling
- Consensus-based optimization methods converge globally
- Asymptotic tracking of moving target clouds under uncertain communications
- Emergence of well-ordering and clustering for a first-order nonlinear consensus model
- A consensus-based global optimization method with adaptive momentum estimation
- What is life? A perspective of the mathematical kinetic theory of active particles
- Stochastic consensus dynamics for nonconvex optimization on the Stiefel manifold: mean-field limit and convergence
- Kinetic simulated annealing optimization with entropy-based cooling rate
- Leveraging memory effects and gradient information in consensus-based optimisation: on global convergence in mean-field law
- Consensus-based algorithms for stochastic optimization problems
- Consensus-based global optimization with personal best
- CBO algorithm with average drift and applications to portfolio optimization
- Micro-macro decomposition of particle swarm optimization methods
- New trends in kinetic theory toward the complexity of living systems
- Consensus-based optimization via jump-diffusion stochastic differential equations
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- Mean-field and kinetic descriptions of neural differential equations
- One dimensional consensus based algorithm for non-convex optimization
- Convergence analysis of the discrete consensus-based optimization algorithm with random batch interactions and heterogeneous noises
- A consensus-based model for global optimization and its mean-field limit
- A consensus-based algorithm for non-convex multiplayer games
- Swarm-based gradient descent method for non-convex optimization
- Convergence toward equilibrium of the first-order consensus model with random batch interactions
- Mean-field limits for consensus-based optimization and sampling
- Uniform-in-time mean-field limit estimate for the consensus-based optimization
- Collective behaviors of stochastic agent-based models and applications to finance and optimization
- A multiscale consensus-based algorithm for multilevel optimization
This page was built for publication: Convergence of a first-order consensus-based global optimization algorithm
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3388770)
