Consensus-based optimization via jump-diffusion stochastic differential equations
From MaRDI portal
Abstract: We introduce a new consensus based optimization (CBO) method where interacting particle system is driven by jump-diffusion stochastic differential equations. We study well-posedness of the particle system as well as of its mean-field limit. The major contributions of this paper are proofs of convergence of the interacting particle system towards the mean-field limit and convergence of a discretized particle system towards the continuous-time dynamics in the mean-square sense. We also prove convergence of the mean-field jump-diffusion SDEs towards global minimizer for a large class of objective functions. We demonstrate improved performance of the proposed CBO method over earlier CBO methods in numerical simulations on benchmark objective functions.
Recommendations
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- A consensus-based model for global optimization and its mean-field limit
- An analytical framework for consensus-based global optimization method
- Convergence analysis of the discrete consensus-based optimization algorithm with random batch interactions and heterogeneous noises
Cites work
- A consensus-based global optimization method for high dimensional machine learning problems
- A consensus-based model for global optimization and its mean-field limit
- A constrained consensus based optimization algorithm and its application to finance
- An analytical framework for consensus-based global optimization method
- Anisotropic diffusion in consensus-based optimization on the sphere
- Ant colony optimization theory: a survey
- Asymptotic flocking dynamics for the kinetic Cucker-Smale model
- Asymptotics of the spectral gap with applications to the theory of simulated annealing
- Binary interaction methods for high dimensional global optimization and machine learning
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- Contagion shocks in one dimension
- Convergence analysis of the discrete consensus-based optimization algorithm with random batch interactions and heterogeneous noises
- Convergence and error estimates for time-discrete consensus-based optimization algorithms
- Convergence of a first-order consensus-based global optimization algorithm
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
- From particle to kinetic and hydrodynamic descriptions of flocking
- Heterophilious dynamics enhances consensus
- scientific article; zbMATH DE number 4211245 (Why is no real title available?)
- scientific article; zbMATH DE number 1909499 (Why is no real title available?)
- scientific article; zbMATH DE number 1402217 (Why is no real title available?)
- scientific article; zbMATH DE number 3895476 (Why is no real title available?)
- scientific article; zbMATH DE number 960162 (Why is no real title available?)
- Introduction to Derivative-Free Optimization
- Introduction to mathematical sociology
- Kinetic models of opinion formation
- Lévy Processes and Stochastic Calculus
- McKean-Vlasov Ito-Skorohod equations, and nonlinear diffusions with discrete jump sets
- Nonlinear diffusion with jumps
- Numerical Integration of Stochastic Differential Equations with Nonglobally Lipschitz Coefficients
- Numerical solution of stochastic differential equations with jumps in finance
- On stochastic equations with respect to semimartingales I.†
- On tamed Euler approximations of SDEs driven by Lévy noise with applications to delay equations
- On the mathematics of emergence
- Random Perturbations of Dynamical Systems
- Random walk algorithm for the Dirichlet problem for parabolic integro-differential equation
- Stochastic consensus dynamics for nonconvex optimization on the Stiefel manifold: mean-field limit and convergence
- Stochastic numerics for mathematical physics
- Towards a mathematical theory of behavioral human crowds
- Trends in Consensus-Based Optimization
- Vehicular traffic, crowds, and swarms: from kinetic theory and multiscale methods to applications and research perspectives
- Well-posedness and propagation of chaos for McKean-Vlasov equations with jumps and locally Lipschitz coefficients
- What is life? A perspective of the mathematical kinetic theory of active particles
Cited in
(32)- Convergence and error estimates for time-discrete consensus-based optimization algorithms
- A constrained consensus based optimization algorithm and its application to finance
- Consensus-based optimization on hypersurfaces: Well-posedness and mean-field limit
- An analytical framework for consensus-based global optimization method
- Consensus for black-box nonlinear agents using optimistic optimization
- Stochastic consensus dynamics for nonconvex optimization on the Stiefel manifold: mean-field limit and convergence
- Zero-inertia limit: from particle swarm optimization to consensus-based optimization
- Convergence analysis of the discrete consensus-based optimization algorithm with random batch interactions and heterogeneous noises
- From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limit
- Parameter Calibration with Consensus-Based Optimization for Interaction Dynamics Driven by Neural Networks
- Kinetic-based optimization enhanced by genetic dynamics
- Ensemble-Based Gradient Inference for Particle Methods in Optimization and Sampling
- Consensus-Based Optimization for Saddle Point Problems
- Time-discrete momentum consensus-based optimization algorithm and its application to Lyapunov function approximation
- Consensus-based optimization methods converge globally
- Control methods in hyperbolic PDEs. Abstracts from the workshop held November 5--10, 2023
- Leveraging memory effects and gradient information in consensus-based optimisation: on global convergence in mean-field law
- Sharp propagation of chaos for the ensemble Langevin sampler
- Optimization by linear kinetic equations and mean-field Langevin dynamics
- Fast and robust consensus-based optimization via optimal feedback control
- Mean-field limits for consensus-based optimization and sampling
- Tensor cross interpolation for global discrete optimization with application to Bayesian network inference
- A multiscale consensus-based algorithm for multilevel optimization
- A consensus-based algorithm for non-convex multiplayer games
- Computational methods for stationary and nonstationary Fokker-Planck-Kolmogorov equations with random coefficients
- Well-posedness and approximation of reflected McKean-Vlasov SDEs with applications
- A PDE framework of consensus-based optimization for objectives with multiple global minimizers
- Consensus-based optimisation with truncated noise
- Controlled stochastic processes for simulated annealing
- Well-posedness and mean-field limit estimate of a consensus-based algorithm for multiplayer games
- Swarm-based optimization with jumps: a kinetic BGK framework and convergence analysis
- Pseudo almost periodic solutions in distribution for stochastic differential equations driven by Brownian and fractional Brownian motions
This page was built for publication: Consensus-based optimization via jump-diffusion stochastic differential equations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6102917)