Derivative-free optimization methods
From MaRDI portal
algorithmaugmented Lagrangianbilevelcomplexitycomposite non smoothconstrainedconvergenceDDSderivative free optimizationGPSlocal and global optimizationMADSminimaxmulti fidelitymulti-objectivemultistartpenaltysimulationSQPstochasticTrust Regionunconstrainedunder estimatorWCC
Numerical mathematical programming methods (65K05) Research exposition (monographs, survey articles) pertaining to operations research and mathematical programming (90-02) Computational methods for problems pertaining to operations research and mathematical programming (90-08) Derivative-free methods and methods using generalized derivatives (90C56)
Abstract: In many optimization problems arising from scientific, engineering and artificial intelligence applications, objective and constraint functions are available only as the output of a black-box or simulation oracle that does not provide derivative information. Such settings necessitate the use of methods for derivative-free, or zeroth-order, optimization. We provide a review and perspectives on developments in these methods, with an emphasis on highlighting recent developments and on unifying treatment of such problems in the non-linear optimization and machine learning literature. We categorize methods based on assumed properties of the black-box functions, as well as features of the methods. We first overview the primary setting of deterministic methods applied to unconstrained, non-convex optimization problems where the objective function is defined by a deterministic black-box oracle. We then discuss developments in randomized methods, methods that assume some additional structure about the objective (including convexity, separability and general non-smooth compositions), methods for problems where the output of the black-box oracle is stochastic, and methods for handling different types of constraints.
Recommendations
Cites work
Too many MaRDI portal entities accessed. Number of entities loaded: 250/250.
Cited in
(only showing first 100 items - show all)- Objective-derivative-free methods for constrained optimization
- An indicator for the switch from derivative-free to derivative-based optimization
- An optimized derivative-free form of the Potra-Pták method
- Generating set search using simplex gradients for bound-constrained black-box optimization
- On the properties of the cosine measure and the uniform angle subspace
- An accelerated directional derivative method for smooth stochastic convex optimization
- Inexact derivative-free optimization for bilevel learning
- A derivative-free optimization approach for the autotuning of a forex trading strategy
- A method for convex black-box integer global optimization
- Derivative-free superiorization: principle and algorithm
- A zeroth order method for stochastic weakly convex optimization
- A new one-point residual-feedback oracle for black-box learning and control
- Data-driven spatial branch-and-bound algorithms for box-constrained simulation-based optimization
- A derivative-free trust-region algorithm with copula-based models for probability maximization problems
- Approximating the diagonal of a Hessian: which sample set of points should be used
- A geometric integration approach to nonsmooth, nonconvex optimisation
- Applying Bayesian optimization with Gaussian process regression to computational fluid dynamics problems
- Stochastic zeroth-order discretizations of Langevin diffusions for Bayesian inference
- Cluster Gauss-Newton method. An algorithm for finding multiple approximate minimisers of nonlinear least squares problems with applications to parameter estimation of pharmacokinetic models
- Derivative-free methods for mixed-integer nonsmooth constrained optimization
- A theoretical and empirical comparison of gradient approximations in derivative-free optimization
- Efficient unconstrained black box optimization
- Zeroth-order algorithms for stochastic distributed nonconvex optimization
- A one-bit, comparison-based gradient estimator
- Iteratively sampling scheme for stochastic optimization with variable number sample path
- Quantifying uncertainty with ensembles of surrogates for blackbox optimization
- Improved exploitation of higher order smoothness in derivative-free optimization
- Zeroth-order methods for noisy Hölder-gradient functions
- An empirical study of derivative-free-optimization algorithms for targeted black-box attacks in deep neural networks
- The Pontryagin maximum principle for solving Fokker-Planck optimal control problems
- DEFT-FUNNEL: an open-source global optimization solver for constrained grey-box and black-box problems
- Derivative free methodologies for circuit worst case analysis
- Derivative-free optimization: a review of algorithms and comparison of software implementations
- Survey of trust-region derivative free optimization methods
- A mixed finite differences scheme for gradient approximation
- Zeroth-order feedback optimization for cooperative multi-agent systems
- Derivative free optimization in higher dimension
- Derivative-Free Optimization
- scientific article; zbMATH DE number 6514307 (Why is no real title available?)
- Introduction to Derivative-Free Optimization
- Derivative-free optimization and filter methods to solve nonlinear constrained problems
- scientific article; zbMATH DE number 3920218 (Why is no real title available?)
- ASTRO-DF: a class of adaptive sampling trust-region algorithms for derivative-free stochastic optimization
- Derivative-free and blackbox optimization
- Derivative-free optimization methods for finite minimax problems
- Derivative-free methods for policy optimization: guarantees for linear quadratic systems
- A Derivative-Free Method for Structured Optimization Problems
- Global Convergence Rate Analysis of a Generic Line Search Algorithm with Noise
- Recovery of a time-dependent bottom topography function from the shallow water equations via an adjoint approach
- Derivative-Free Bayesian Inversion Using Multiscale Dynamics
- Model-based derivative-free methods for convex-constrained optimization
- New first-order algorithms for stochastic variational inequalities
- Finite Difference Gradient Approximation: To Randomize or Not?
- Adaptive Tikhonov strategies for stochastic ensemble Kalman inversion
- Sequential Learning of Active Subspaces
- Exploiting Problem Structure in Derivative Free Optimization
- A stochastic Levenberg-Marquardt method using random models with complexity results
- An accelerated method for derivative-free smooth stochastic convex optimization
- Global Linear Convergence of Evolution Strategies on More than Smooth Strongly Convex Functions
- Coupled learning enabled stochastic programming with endogenous uncertainty
- Adaptive Finite-Difference Interval Estimation for Noisy Derivative-Free Optimization
- Anisotropic diffusion in consensus-based optimization on the sphere
- Tuning Multigrid Methods with Robust Optimization and Local Fourier Analysis
- Biobjective Simulation Optimization on Integer Lattices Using the Epsilon-Constraint Method in a Retrospective Approximation Framework
- Learning Enabled Constrained Black-Box Optimization
- Black-Box Optimization: Methods and Applications
- Manifold sampling for optimizing nonsmooth nonconvex compositions
- Benchmarking Derivative-Free Optimization Algorithms
- Derivative-free optimization for population dynamic models
- Finding Optimal Algorithmic Parameters Using Derivative‐Free Optimization
- A derivative-free two level random search method for unconstrained optimization
- Bilevel Methods for Image Reconstruction
- On the numerical performance of finite-difference-based methods for derivative-free optimization
- Full-low evaluation methods for derivative-free optimization
- Scalable subspace methods for derivative-free nonlinear least-squares optimization
- A nonlinear conjugate gradient method using inexact first-order information
- Robust design optimization for enhancing delamination resistance of composites
- Direct Search Based on Probabilistic Descent in Reduced Spaces
- scientific article; zbMATH DE number 7753344 (Why is no real title available?)
- Rotorcraft low-noise trajectories design: black-box optimization using surrogates
- Optimal sizing and dispatch of solar power with storage
- Hermite least squares optimization: a modification of BOBYQA for optimization with limited derivative information
- A unified analysis of stochastic gradient‐free Frank–Wolfe methods
- A fast and efficient estimation of the parameters of a model of accident frequencies via an MM algorithm
- Resource allocation problems with expensive function evaluations
- Two decades of blackbox optimization applications
- Derivative-free optimization of a rapid-cycling synchrotron
- Quadratic regularization methods with finite-difference gradient approximations
- Adaptive sampling quasi-Newton methods for zeroth-order stochastic optimization
- Worst-case evaluation complexity of a derivative-free quadratic regularization method
- A derivative-free optimization algorithm combining line-search and trust-region techniques
- Unifying framework for accelerated randomized methods in convex optimization
- Recent theoretical advances in decentralized distributed convex optimization
- Recent Theoretical Advances in Non-Convex Optimization
- Derivative-free alternating projection algorithms for general nonconvex-concave minimax problems
- A real-time optimization algorithm for the fixed-stress splitting scheme
- EnKSGD: a class of preconditioned black box optimization and inversion algorithms
- Linear convergence of the derivative-free proximal bundle method on convex nonsmooth functions, with application to the derivative-free \(\mathcal{VU}\)-algorithm
- Global solutions to nonconvex problems by evolution of Hamilton-Jacobi PDEs
- Adaptive state-dependent diffusion for derivative-free optimization
Describes a project that uses
Uses Software
This page was built for publication: Derivative-free optimization methods
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5230522)
