A consensus-based model for global optimization and its mean-field limit
From MaRDI portal
Publication:2963631
Abstract: We introduce a novel first-order stochastic swarm intelligence (SI) model in the spirit of consensus formation models, namely a consensus-based optimization (CBO) algorithm, which may be used for the global optimization of a function in multiple dimensions. The CBO algorithm allows for passage to the mean-field limit, which results in a nonstandard, nonlocal, degenerate parabolic partial differential equation (PDE). Exploiting tools from PDE analysis we provide convergence results that help to understand the asymptotic behavior of the SI model. We further present numerical investigations underlining the feasibility of our approach.
Recommendations
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- Convergence of a first-order consensus-based global optimization algorithm
- An analytical framework for consensus-based global optimization method
- Trends in Consensus-Based Optimization
Cites work
- scientific article; zbMATH DE number 410740 (Why is no real title available?)
- scientific article; zbMATH DE number 4211245 (Why is no real title available?)
- scientific article; zbMATH DE number 1909499 (Why is no real title available?)
- A discrete nonlinear and non-autonomous model of consensus formation
- A kinetic approach to the study of opinion formation
- A literature survey of benchmark functions for global optimisation problems
- An algorithmic introduction to numerical simulation of stochastic differential equations
- An analytical framework for consensus-based global optimization method
- Asymptotic flocking dynamics for the kinetic Cucker-Smale model
- Behavioral crowds: modeling and Monte Carlo simulations toward validation
- COOPERATIVE STRATEGIES IN FORMATION OF COMPLEX BACTERIAL PATTERNS
- Discontinuous Galerkin methods
- Dynamical systems II. Ergodic theory with applications to dynamical systems and statistical mechanics. Transl. from the Russian
- Emergent Behavior in Flocks
- First‐Order Continuous Models of Opinion Formation
- From particle to kinetic and hydrodynamic descriptions of flocking
- Global optimization. Theory, algorithms, and applications
- Heterophilious dynamics enhances consensus
- Interacting multiagent systems. Kinetic equations and Monte Carlo methods
- Kinetic description of optimal control problems and applications to opinion consensus
- MODELING CROWD DYNAMICS FROM A COMPLEX SYSTEM VIEWPOINT
- Mathematical modeling of collective behavior in socio-economic and life sciences
- Mathematics, complexity and multiscale features of large systems of self-propelled particles
- Mersenne twister
- Modeling opinion dynamics: how the network enhances consensus
- On a mathematical theory of complex systems on networks with application to opinion formation
- On the Construction and Comparison of Difference Schemes
- On the mathematics of emergence
- On the modeling of traffic and crowds: a survey of models, speculations, and perspectives
- Opinion dynamics and learning in social networks
- Opinion dynamics and the evolution of social power in influence networks
- Optimization by simulated annealing
- Quantitative sociodynamics. Stochastic methods and models of social interaction processes.
- Reaching a Consensus
- Recent approaches to global optimization problems through particle Swarm optimization
- Stochastic evolutionary differential games toward a systems theory of behavioral social dynamics
- Stochastic mean-field limit: non-Lipschitz forces and swarming
- Thermodynamical approach to the travelling salesman problem: An efficient simulation algorithm
- Towards consensus: some convergence theorems on repeated averaging
Cited in
(72)- Swarm gradient dynamics for global optimization: the mean-field limit case
- Swarm-based optimization with random descent
- An adaptive consensus based method for multi-objective optimization with uniform Pareto front approximation
- Zero-inertia limit: from particle swarm optimization to consensus-based optimization
- Efficient derivative-free Bayesian inference for large-scale inverse problems
- Pseudospectral methods and iterative solvers for optimization problems from multiscale particle dynamics
- Convergence analysis of particle swarm optimization in one dimension
- Iterative learning based consensus control for distributed parameter type multi-agent differential inclusion systems with time-delay
- Mean field models for large data-clustering problems
- A short discussion is followed by an agreement on the global minimum: consensus-based global optimization
- scientific article; zbMATH DE number 7626752 (Why is no real title available?)
- EnKSGD: a class of preconditioned black box optimization and inversion algorithms
- Consensus-based optimization for multi-objective problems: a multi-swarm approach
- Convergence and error estimates for time-discrete consensus-based optimization algorithms
- Modeling behavioral social systems
- Trends in Consensus-Based Optimization
- Parameter calibration with stochastic gradient descent for interacting particle systems driven by neural networks
- Time-discrete momentum consensus-based optimization algorithm and its application to Lyapunov function approximation
- Challenges in active particles methods: theory and applications
- An anisotropic interaction model with collision avoidance
- A constrained consensus based optimization algorithm and its application to finance
- On the mean‐field limit for the consensus‐based optimization
- A consensus-based global optimization method for high dimensional machine learning problems
- On the Generalized Langevin Equation for Simulated Annealing
- Deep network with approximation error being reciprocal of width to power of square root of depth
- Mean field limits for interacting diffusions in a two-scale potential
- Mathematical models of self-propelled particles
- Constrained Consensus-Based Optimization
- Constructing sampling schemes via coupling: Markov semigroups and optimal transport
- Controlled pattern formation of stochastic Cucker-Smale systems with network structures
- A note on the mean-field limit for the particle swarm optimization
- Birth–death dynamics for sampling: global convergence, approximations and their asymptotics
- Consensus‐based sampling
- Mean field limits for interacting diffusions with colored noise: phase transitions and spectral numerical methods
- Mean-field optimal control for biological pattern formation
- Consensus-based optimization methods converge globally
- Convergence of a first-order consensus-based global optimization algorithm
- A multiscale view of nonlinear diffusion in biology: from cells to tissues
- On the global convergence of particle swarm optimization methods
- Stochastic consensus dynamics for nonconvex optimization on the Stiefel manifold: mean-field limit and convergence
- Anisotropic diffusion in consensus-based optimization on the sphere
- Control methods in hyperbolic PDEs. Abstracts from the workshop held November 5--10, 2023
- Binary interaction methods for high dimensional global optimization and machine learning
- Neural network approximation: three hidden layers are enough
- Ensemble-Based Gradient Inference for Particle Methods in Optimization and Sampling
- Leveraging memory effects and gradient information in consensus-based optimisation: on global convergence in mean-field law
- Reproducing kernel Hilbert spaces in the mean field limit
- Instantaneous control of interacting particle systems in the mean-field limit
- Consensus-based global optimization with personal best
- A global optimization heuristic for estimating agent based models
- Consensus-based optimization via jump-diffusion stochastic differential equations
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- On the stochastic robustness of complete clustering predictability for a first‐order consensus model
- One dimensional consensus based algorithm for non-convex optimization
- Parameter Calibration with Consensus-Based Optimization for Interaction Dynamics Driven by Neural Networks
- Mean-field optimal control and optimality conditions in the space of probability measures
- Convergence analysis of the discrete consensus-based optimization algorithm with random batch interactions and heterogeneous noises
- Swarm-based gradient descent meets simulated annealing
- Tikhonov regularization within ensemble Kalman inversion
- Emergent behaviors of high-dimensional Kuramoto models on Stiefel manifolds
- An analytical framework for consensus-based global optimization method
- Swarm-based gradient descent method for non-convex optimization
- Optimization by linear kinetic equations and mean-field Langevin dynamics
- Derivative-Free Bayesian Inversion Using Multiscale Dynamics
- Propagation of chaos: a review of models, methods and applications. I: Models and methods
- Swarming for faster convergence in stochastic optimization
- Propagation of chaos: a review of models, methods and applications. II: Applications
- Stochastic gradient descent and fast relaxation to thermodynamic equilibrium: a stochastic control approach
- Reduced variance random batch methods for nonlocal PDEs
- Kinetic-based optimization enhanced by genetic dynamics
- Collective behaviors of stochastic agent-based models and applications to finance and optimization
This page was built for publication: A consensus-based model for global optimization and its mean-field limit
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2963631)
