Adaptive Interpolation Strategies in Derivative-Free Optimization: a case study

MaRDI QIDQ5148368zbMATH OpenFDO

Authors W. Hare, Majid Jaberipour

Publication date 3 February 2021

Full work available at URL https://arxiv.org/abs/1511.02794, http://www.yokohamapublishers.jp/online-p/PJO/vol14/pjov14n2p327.pdf

zbMATH Keywords

derivative-free optimizationdynamic model selectionlinear interpolationminimum Frobenius normquadratic interpolation

Mathematics Subject Classification ID

Discrete approximations in optimal control (49M25) Numerical mathematical programming methods (65K05) Derivative-free methods and methods using generalized derivatives (90C56)

Abstract: Derivative-Free optimization (DFO) focuses on designing methods to solve optimization problems without the analytical knowledge of gradients of the objective function. There are two main families of DFO methods: model-based methods and direct search methods. In model-based DFO methods, a model of the objective function is constructed using only objective function values, and the model is used to guide the computation of the next iterate. Natural questions in this class of algorithms include how many function evaluations should be used to construct the model? And, should this number be fixed, or adaptively selected by the algorithm? In this paper, we numerically examine these questions, using Hare and Lucet's Derivative-Free Proximal Point (DFPP) algorithm [Hare, Lucet, 2014] as a case study. Results suggest that the number of function evaluations used to construct the model has a huge impact on algorithm performance, and adaptive strategies can both improve and hinder algorithm performance.

Recommendations

• Adaptive Finite-Difference Interval Estimation for Noisy Derivative-Free Optimization
• Analysis and optimization of an adaptive interpolation algorithm for the numerical solution of a system of ordinary differential equations with interval parameters
• An adaptive strategy on the error of the objective functions for uncertainty-based derivative-free optimization
• An adaptive implementation of interpolation methods for boundary value ordinary differential equations
• scientific article; zbMATH DE number 1552017
• Automatic approximation using asymptotically optimal adaptive interpolation
• Derivative-free optimal iterative methods
• Adaptive approximation models in optimization
• Survey of derivative-free optimization
• Derivative-free optimization: a review of algorithms and comparison of software implementations

Cited in

(6)

• Derivative-free optimization via proximal point methods
• Modified Active Subspaces Using the Average of Gradients
• Adaptive Finite-Difference Interval Estimation for Noisy Derivative-Free Optimization
• An optimal interpolation set for model-based derivative-free optimization methods
• Gradient and diagonal Hessian approximations using quadratic interpolation models and aligned regular bases
• A discussion on variational analysis in derivative-free optimization

This page was built for publication: Adaptive Interpolation Strategies in Derivative-Free Optimization: a case study

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5148368)