A new taxonomy of global optimization algorithms
From MaRDI portal
Abstract: Surrogate-based optimization, nature-inspired metaheuristics, and hybrid combinations have become state of the art in algorithm design for solving real-world optimization problems. Still, it is difficult for practitioners to get an overview that explains their advantages in comparison to a large number of available methods in the scope of optimization. Available taxonomies lack the embedding of current approaches in the larger context of this broad field. This article presents a taxonomy of the field, which explores and matches algorithm strategies by extracting similarities and differences in their search strategies. A particular focus lies on algorithms using surrogates, nature-inspired designs, and those created by design optimization. The extracted features of components or operators allow us to create a set of classification indicators to distinguish between a small number of classes. The features allow a deeper understanding of components of the search strategies and further indicate the close connections between the different algorithm designs. We present intuitive analogies to explain the basic principles of the search algorithms, particularly useful for novices in this research field. Furthermore, this taxonomy allows recommendations for the applicability of the corresponding algorithms.
Recommendations
- Review on nature-inspired algorithms
- Survey on Bayesian optimization methodology and applications
- Global optimization method using adaptive and parallel ensemble of surrogates for engineering design optimization
- A taxonomy of global optimization methods based on response surfaces
- Coupled eagle strategy and differential evolution for unconstrained and constrained global optimization
Cites work
- A comparison of evolution strategies with other direct search methods in the presence of noise
- A decision-theoretic generalization of on-line learning and an application to boosting
- A Fast Learning Algorithm for Deep Belief Nets
- A novel hybrid sequential design strategy for global surrogate modeling of computer experiments
- A Simplex Method for Function Minimization
- A survey on direct search methods for blackbox optimization and their applications
- A survey on optimization metaheuristics
- A taxonomy of global optimization methods based on response surfaces
- Adaptive subgradient methods for online learning and stochastic optimization
- An introduction to quantum computing algorithms
- Application of Bayesian approach to numerical methods of global and stochastic optimization
- Branch-and-Bound Methods: A Survey
- Complete search in continuous global optimization and constraint satisfaction
- Conditioning of Quasi-Newton Methods for Function Minimization
- Design and analysis of computer experiments. With comments and a rejoinder by the authors
- Direct search methods: Then and now
- Efficient global optimization of expensive black-box functions
- Enhanced simulated annealing for globally minimizing functions of many-continuous variables
- Evolution strategies. A comprehensive introduction
- Evolutionary Multi-Criterion Optimization
- Exploration and exploitation in evolutionary algorithms: a survey
- FITTING OF TABU SEARCH TO OPTIMIZE FUNCTIONS OF CONTINUOUS VARIABLES
- General variable neighborhood search for the continuous optimization
- Global optimization
- Global optimization of statistical functions with simulated annealing
- scientific article; zbMATH DE number 1702339 (Why is no real title available?)
- scientific article; zbMATH DE number 1728538 (Why is no real title available?)
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 3872987 (Why is no real title available?)
- scientific article; zbMATH DE number 4099040 (Why is no real title available?)
- scientific article; zbMATH DE number 43985 (Why is no real title available?)
- scientific article; zbMATH DE number 3487202 (Why is no real title available?)
- scientific article; zbMATH DE number 3511513 (Why is no real title available?)
- scientific article; zbMATH DE number 3541882 (Why is no real title available?)
- scientific article; zbMATH DE number 976350 (Why is no real title available?)
- scientific article; zbMATH DE number 1953201 (Why is no real title available?)
- scientific article; zbMATH DE number 2010047 (Why is no real title available?)
- scientific article; zbMATH DE number 2002582 (Why is no real title available?)
- scientific article; zbMATH DE number 2079883 (Why is no real title available?)
- scientific article; zbMATH DE number 1857675 (Why is no real title available?)
- scientific article; zbMATH DE number 795587 (Why is no real title available?)
- scientific article; zbMATH DE number 3240118 (Why is no real title available?)
- scientific article; zbMATH DE number 960162 (Why is no real title available?)
- Hybrid metaheuristics
- Hyper-Heuristics: An Emerging Direction in Modern Search Technology
- Influence of ensemble surrogate models and sampling strategy on the solution quality of algorithms for~computationally expensive black-box global optimization problems
- Introduction to evolutionary computing
- Introduction to evolutionary computing
- Metaheuristics. From design to implementation.
- Minimizing multimodal functions of continuous variables with the “simulated annealing” algorithm—Corrigenda for this article is available here
- MISO: mixed-integer surrogate optimization framework
- Model-based search for combinatorial optimization: A critical survey
- Multilayer feedforward networks are universal approximators
- On the limited memory BFGS method for large scale optimization
- Optimal aeroacoustic shape design using the surrogate management framework
- Optimal parameter choices via precise black-box analysis
- Optimization by simulated annealing
- Parameter setting in evolutionary algorithms.
- Random forests
- SMS-EMOA: multiobjective selection based on dominated hypervolume
- Survey of multi-objective optimization methods for engineering
- Tabu search applied to global optimization
- Tabu Search—Part I
- The Sequential Parameter Optimization Toolbox
- The Theory and Practice of Simulated Annealing
- Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: A survey of the state-of-the-art
- Variable neighbourhood search: methods and applications
Cited in
(6)- A new version of the Price's algorithm for global optimization
- Novelty search for global optimization
- Comparison of exact and approximate approaches to UAVs mission contingency planning in dynamic environments
- Algorithmic differentiation techniques for global optimization in the COCONUT environment
- Promising GAHC and HC12 algorithms in global optimization tasks
- NPROS: a not so pure random orthogonal search algorithm -- a suite of random optimization algorithms driven by reinforcement learning
This page was built for publication: A new taxonomy of global optimization algorithms
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6137180)
