A consensus-based model for global optimization and its mean-field limit
From MaRDI portal
Abstract: We introduce a novel first-order stochastic swarm intelligence (SI) model in the spirit of consensus formation models, namely a consensus-based optimization (CBO) algorithm, which may be used for the global optimization of a function in multiple dimensions. The CBO algorithm allows for passage to the mean-field limit, which results in a nonstandard, nonlocal, degenerate parabolic partial differential equation (PDE). Exploiting tools from PDE analysis we provide convergence results that help to understand the asymptotic behavior of the SI model. We further present numerical investigations underlining the feasibility of our approach.
Recommendations
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- Convergence of a first-order consensus-based global optimization algorithm
- An analytical framework for consensus-based global optimization method
- Trends in Consensus-Based Optimization
Cites work
- A discrete nonlinear and non-autonomous model of consensus formation
- A kinetic approach to the study of opinion formation
- A literature survey of benchmark functions for global optimisation problems
- An algorithmic introduction to numerical simulation of stochastic differential equations
- An analytical framework for consensus-based global optimization method
- Asymptotic flocking dynamics for the kinetic Cucker-Smale model
- Behavioral crowds: modeling and Monte Carlo simulations toward validation
- COOPERATIVE STRATEGIES IN FORMATION OF COMPLEX BACTERIAL PATTERNS
- Discontinuous Galerkin methods
- Dynamical systems II. Ergodic theory with applications to dynamical systems and statistical mechanics. Transl. from the Russian
- Emergent Behavior in Flocks
- First‐Order Continuous Models of Opinion Formation
- From particle to kinetic and hydrodynamic descriptions of flocking
- Global optimization. Theory, algorithms, and applications
- Heterophilious dynamics enhances consensus
- scientific article; zbMATH DE number 410740 (Why is no real title available?)
- scientific article; zbMATH DE number 4211245 (Why is no real title available?)
- scientific article; zbMATH DE number 1909499 (Why is no real title available?)
- Interacting multiagent systems. Kinetic equations and Monte Carlo methods
- Kinetic description of optimal control problems and applications to opinion consensus
- Mathematical modeling of collective behavior in socio-economic and life sciences
- Mathematics, complexity and multiscale features of large systems of self-propelled particles
- Mersenne twister
- MODELING CROWD DYNAMICS FROM A COMPLEX SYSTEM VIEWPOINT
- Modeling opinion dynamics: how the network enhances consensus
- On a mathematical theory of complex systems on networks with application to opinion formation
- On the Construction and Comparison of Difference Schemes
- On the mathematics of emergence
- On the modeling of traffic and crowds: a survey of models, speculations, and perspectives
- Opinion dynamics and learning in social networks
- Opinion dynamics and the evolution of social power in influence networks
- Optimization by simulated annealing
- Quantitative sociodynamics. Stochastic methods and models of social interaction processes.
- Reaching a Consensus
- Recent approaches to global optimization problems through particle Swarm optimization
- Stochastic evolutionary differential games toward a systems theory of behavioral social dynamics
- Stochastic mean-field limit: non-Lipschitz forces and swarming
- Thermodynamical approach to the travelling salesman problem: An efficient simulation algorithm
- Towards consensus: some convergence theorems on repeated averaging
Cited in
(only showing first 100 items - show all)- Convergence and error estimates for time-discrete consensus-based optimization algorithms
- A note on the mean-field limit for the particle swarm optimization
- Consensus-based global optimization with personal best
- A constrained consensus based optimization algorithm and its application to finance
- One dimensional consensus based algorithm for non-convex optimization
- Emergent behaviors of high-dimensional Kuramoto models on Stiefel manifolds
- Propagation of chaos: a review of models, methods and applications. I: Models and methods
- Propagation of chaos: a review of models, methods and applications. II: Applications
- Pseudospectral methods and iterative solvers for optimization problems from multiscale particle dynamics
- Convergence analysis of particle swarm optimization in one dimension
- Iterative learning based consensus control for distributed parameter type multi-agent differential inclusion systems with time-delay
- Parameter calibration with stochastic gradient descent for interacting particle systems driven by neural networks
- Controlled pattern formation of stochastic Cucker-Smale systems with network structures
- Binary interaction methods for high dimensional global optimization and machine learning
- Instantaneous control of interacting particle systems in the mean-field limit
- An anisotropic interaction model with collision avoidance
- A short discussion is followed by an agreement on the global minimum: consensus-based global optimization
- Modeling behavioral social systems
- Convergence of a first-order consensus-based global optimization algorithm
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- An analytical framework for consensus-based global optimization method
- Swarming for faster convergence in stochastic optimization
- Challenges in active particles methods: theory and applications
- A multiscale view of nonlinear diffusion in biology: from cells to tissues
- Mean-field optimal control for biological pattern formation
- A consensus-based global optimization method for high dimensional machine learning problems
- Deep network with approximation error being reciprocal of width to power of square root of depth
- Stochastic gradient descent and fast relaxation to thermodynamic equilibrium: a stochastic control approach
- Derivative-Free Bayesian Inversion Using Multiscale Dynamics
- Efficient derivative-free Bayesian inference for large-scale inverse problems
- scientific article; zbMATH DE number 7626752 (Why is no real title available?)
- Trends in Consensus-Based Optimization
- Stochastic consensus dynamics for nonconvex optimization on the Stiefel manifold: mean-field limit and convergence
- Zero-inertia limit: from particle swarm optimization to consensus-based optimization
- Anisotropic diffusion in consensus-based optimization on the sphere
- Convergence analysis of the discrete consensus-based optimization algorithm with random batch interactions and heterogeneous noises
- Tikhonov regularization within ensemble Kalman inversion
- Mean field limits for interacting diffusions with colored noise: phase transitions and spectral numerical methods
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
- Constructing sampling schemes via coupling: Markov semigroups and optimal transport
- Mathematical models of self-propelled particles
- Mean-field optimal control and optimality conditions in the space of probability measures
- Constrained Consensus-Based Optimization
- Birth–death dynamics for sampling: global convergence, approximations and their asymptotics
- Neural network approximation: three hidden layers are enough
- Consensus‐based sampling
- On the stochastic robustness of complete clustering predictability for a first‐order consensus model
- On the mean‐field limit for the consensus‐based optimization
- Parameter Calibration with Consensus-Based Optimization for Interaction Dynamics Driven by Neural Networks
- Reproducing kernel Hilbert spaces in the mean field limit
- Consensus-based optimization via jump-diffusion stochastic differential equations
- On the Generalized Langevin Equation for Simulated Annealing
- Kinetic-based optimization enhanced by genetic dynamics
- Swarm gradient dynamics for global optimization: the mean-field limit case
- Swarm-based optimization with random descent
- Collective behaviors of stochastic agent-based models and applications to finance and optimization
- An adaptive consensus based method for multi-objective optimization with uniform Pareto front approximation
- On the global convergence of particle swarm optimization methods
- Ensemble-Based Gradient Inference for Particle Methods in Optimization and Sampling
- Reduced variance random batch methods for nonlocal PDEs
- EnKSGD: a class of preconditioned black box optimization and inversion algorithms
- Consensus-based optimization for multi-objective problems: a multi-swarm approach
- Time-discrete momentum consensus-based optimization algorithm and its application to Lyapunov function approximation
- Consensus-based optimization methods converge globally
- Control methods in hyperbolic PDEs. Abstracts from the workshop held November 5--10, 2023
- Leveraging memory effects and gradient information in consensus-based optimisation: on global convergence in mean-field law
- Swarm-based gradient descent meets simulated annealing
- Swarm-based gradient descent method for non-convex optimization
- Optimization by linear kinetic equations and mean-field Langevin dynamics
- Micro-macro decomposition of particle swarm optimization methods
- Uniform-in-time propagation of chaos for the Cucker-Smale model
- Fast and robust consensus-based optimization via optimal feedback control
- Adversarial flows: a gradient flow characterization of adversarial attacks
- Consensus-based algorithms for stochastic optimization problems
- Energy-stable swarm-based inertial algorithms for optimization
- MirrorCBO: a consensus-based optimization method in the spirit of mirror descent
- Dynamics of measure-valued agents in the space of probabilities
- Mean-field limits for consensus-based optimization and sampling
- Uniform-in-time mean-field limit estimate for the consensus-based optimization
- A multiscale consensus-based algorithm for multilevel optimization
- Smoothing iterative consensus-based optimization algorithm for nonsmooth nonconvex optimization problems with global optimality
- A consensus-based algorithm for non-convex multiplayer games
- Well-posedness and approximation of reflected McKean-Vlasov SDEs with applications
- Interacting particle Langevin algorithm for maximum marginal likelihood estimation
- Ensemble Kalman methods: a mean-field perspective
- A mathematical perspective on transformers
- A discrete consensus-based global optimization method with noisy objective function
- Mini-workshop: High-dimensional control problems and mean-field equations with applications in machine learning. Abstracts from the mini-workshop held December 8--13, 2024
- Model predictive control strategies using consensus-based optimization
- A PDE framework of consensus-based optimization for objectives with multiple global minimizers
- Polarized consensus-based dynamics for optimization and sampling
- Metropolis-adjusted interacting particle sampling
- Consensus, error estimates and applications of first- and second-order consensus-based optimization algorithms
- Recent kernel methods for interacting particle systems: first numerical results
- Consensus-based optimisation with truncated noise
- Bayesian nonparametric inference in McKean-Vlasov models
- Self-interacting CBO: existence, uniqueness, and long-time convergence
- Mean field limits for interacting diffusions in a two-scale potential
- Well-posedness and propagation of chaos for multi-agent models with strategies and diffusive effects
- A localized consensus-based sampling algorithm
This page was built for publication: A consensus-based model for global optimization and its mean-field limit
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2963631)
