Concurrent function evaluations in local and global optimization
This paper discusses some basic opportunities for the use of multiprocessing in the solution of optimization problems. We consider two fundamental optimization problems, unconstrained optimization and global optimization, in the important case when function evaluation is expensive and gradients are evaluated by finite differences. First we discuss some simple parallel strategies based upon the use of concurrent function evaluations to evaluate the finite difference gradient. These include the speculative evaluation of the gradient concurrently with the evaluation of the function before it is known whether the gradient value at this point will be required. We present examples that indicate the effectiveness of these parallel strategies for unconstrained optimization. We also give experimental results that show the effect of using these strategies to parallelize each of the multiple local minimizations within a recently proposed concurrent global optimization algorithm. We briefly discuss several parallel optimization strategies that are related to these approaches but make more fundamental changes to standard sequential optimization algorithms.
- Parallel global optimization of functions of several variables
- Concurrent stochastic methods for global optimization
- scientific article; zbMATH DE number 1785850
- scientific article; zbMATH DE number 5182846
- Balancing global and local search in parallel efficient global optimization algorithms
- Parallel algorithms for global optimization
- scientific article; zbMATH DE number 802433
- Optimization of Globally Convex Functions
- Concurrent stochastic methods for global optimization
- scientific article; zbMATH DE number 3901929 (Why is no real title available?)
- scientific article; zbMATH DE number 3912117 (Why is no real title available?)
- scientific article; zbMATH DE number 3917583 (Why is no real title available?)
- scientific article; zbMATH DE number 3928227 (Why is no real title available?)
- scientific article; zbMATH DE number 4055386 (Why is no real title available?)
- scientific article; zbMATH DE number 3687182 (Why is no real title available?)
- scientific article; zbMATH DE number 140605 (Why is no real title available?)
- scientific article; zbMATH DE number 3793774 (Why is no real title available?)
- Stochastic Methods for Global Optimization
- Tensor Methods for Nonlinear Equations
- Parallel quasi-Newton methods for unconstrained optimization
- Application of Bayesian approach to numerical methods of global and stochastic optimization
- Hybridization of adaptive differential evolution with an expensive local search method
- Multi-directional parallel algorithms for unconstrained optimization
- Performance comparison and workload analysis of mesh untangling and smoothing algorithms
- Direct Search Methods on Parallel Machines
- THE RANDOM SEARCH GLOBAL OPTIMIZATION METHOD FOR PARALLEL COMPUTERS
- A parallel algorithm for global optimization
- A parallel unconstrained quasi-Newton algorithm and its performance on a local memory parallel computer
This page was built for publication: Concurrent function evaluations in local and global optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1085788)