Sobolev seminorm of quadratic functions with applications to derivative-free optimization
From MaRDI portal
Publication:403635
DOI10.1007/S10107-013-0679-3zbMATH Open1315.90063arXiv1111.4576OpenAlexW2159413860MaRDI QIDQ403635FDOQ403635
Authors: Zaikun Zhang 
Publication date: 29 August 2014
Published in: Mathematical Programming. Series A. Series B (Search for Journal in Brave)
Abstract: This paper studies the Sobolev seminorm of quadratic functions. The research is motivated by the least-norm interpolation that is widely used in derivative-free optimization. We express the seminorm of a quadratic function explicitly in terms of the Hessian and the gradient when the underlying domain is a ball. The seminorm gives new insights into least-norm interpolation. It clarifies the analytical and geometrical meaning of the objective function in least-norm interpolation. We employ the seminorm to study the extended symmetric Broyden update proposed by Powell. Numerical results show that the new thoery helps improve the performance of the update. Apart from the theoretical results, we propose a new method of comparing derivative-free solvers, which is more convincing than merely counting the numbers of function evaluations.
Full work available at URL: https://arxiv.org/abs/1111.4576
Recommendations
- Least Frobenius norm updating of quadratic models that satisfy interpolation conditions
- On the use of quadratic models in unconstrained minimization without derivatives
- Geometry of interpolation sets in derivative free optimization
- Beyond symmetric Broyden for updating quadratic models in minimization without derivatives
- A quadratic tridiagonal interpolation DFO method for unconstrained optimization
Numerical mathematical programming methods (65K05) Nonlinear programming (90C30) Derivative-free methods and methods using generalized derivatives (90C56)
Cites Work
- Recent progress in unconstrained nonlinear optimization without derivatives
- Implicit filtering
- CUTEr and SifDec
- CONDOR, a new parallel, constrained extension of Powell's UOBYQA algorithm: Experimental results and comparison with the DFO algorithm
- Wedge trust region method for derivative free optimization.
- UOBYQA: unconstrained optimization by quadratic approximation
- Benchmarking optimization software with performance profiles.
- Title not available (Why is that?)
- Least Change Secant Updates for Quasi-Newton Methods
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Trust Region Methods
- The NEWUOA software for unconstrained optimization without derivatives
- Introduction to Derivative-Free Optimization
- Title not available (Why is that?)
- Title not available (Why is that?)
- Direct search methods: Then and now
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Computation of sparse low degree interpolating polynomials and their application to derivative-free optimization
- An Implicit Filtering Algorithm for Optimization of Functions with Many Local Minima
- Title not available (Why is that?)
- ORBIT: Optimization by Radial Basis Function Interpolation in Trust-Regions
- Incorporating minimum Frobenius norm models in direct search
- On trust region methods for unconstrained minimization without derivatives
- Least Frobenius norm updating of quadratic models that satisfy interpolation conditions
- Developments of NEWUOA for minimization without derivatives
- Superlinear Convergence and Implicit Filtering
- Title not available (Why is that?)
- Function Minimization by Interpolation in a Data Table
- A Modification of Davidon's Minimization Method to Accept Difference Approximations of Derivatives
- A derivative-free nonmonotone line-search technique for unconstrained optimization
Cited In (9)
- Least Frobenius norm updating of quadratic models that satisfy interpolation conditions
- Best practices for comparing optimization algorithms
- Anisotropic diffusion in consensus-based optimization on the sphere
- An optimal interpolation set for model-based derivative-free optimization methods
- A derivative-free algorithm for spherically constrained optimization
- Recent advances in trust region algorithms
- Hill-Climbing Algorithm with a Stick for Unconstrained Optimization Problems
- Geometry of sample sets in derivative-free optimization: polynomial regression and underdetermined interpolation
- Derivative-free optimization methods
Uses Software
This page was built for publication: Sobolev seminorm of quadratic functions with applications to derivative-free optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q403635)
