A Bayesian approach to constrained single- and multi-objective optimization
From MaRDI portal
(Redirected from Publication:506449)
Abstract: This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to evaluate. As a consequence, the number of evaluations that can be used to carry out the optimization is very limited, as in complex industrial design optimization problems. The method we propose to overcome this difficulty has its roots in both the Bayesian and the multi-objective optimization literatures. More specifically, an extended domination rule is used to handle objectives and constraints in a unified way, and a corresponding expected hyper-volume improvement sampling criterion is proposed. This new criterion is naturally adapted to the search of a feasible point when none is available, and reduces to existing Bayesian sampling criteria---the classical Expected Improvement (EI) criterion and some of its constrained/multi-objective extensions---as soon as at least one feasible point is available. The calculation and optimization of the criterion are performed using Sequential Monte Carlo techniques. In particular, an algorithm similar to the subset simulation method, which is well known in the field of structural reliability, is used to estimate the criterion. The method, which we call BMOO (for Bayesian Multi-Objective Optimization), is compared to state-of-the-art algorithms for single- and multi-objective constrained optimization.
Recommendations
- Bayesian approach to global optimization and application to multiobjective and constrained problems
- scientific article; zbMATH DE number 7164723
- scientific article; zbMATH DE number 4174179
- Kriging-based infill sampling criterion for constraint handling in multi-objective optimization
- Survey on Bayesian optimization methodology and applications
Cites work
- scientific article; zbMATH DE number 43985 (Why is no real title available?)
- scientific article; zbMATH DE number 3612796 (Why is no real title available?)
- scientific article; zbMATH DE number 1203355 (Why is no real title available?)
- scientific article; zbMATH DE number 653035 (Why is no real title available?)
- scientific article; zbMATH DE number 2013535 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- scientific article; zbMATH DE number 3251902 (Why is no real title available?)
- A Globally Convergent Augmented Lagrangian Algorithm for Optimization with General Constraints and Simple Bounds
- A general framework for constrained Bayesian optimization using information-based search
- A probabilistic algorithm for global optimization
- An informational approach to the global optimization of expensive-to-evaluate functions
- Efficient global optimization of expensive black-box functions
- Enhancing infill sampling criteria for surrogate-based constrained optimization
- Evolutionary Multi-Criterion Optimization
- Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization
- Gaussian processes for machine learning.
- Interpolation of spatial data. Some theory for kriging
- Monte Carlo strategies in scientific computing
- Multiobjective optimization using Gaussian process emulators via stepwise uncertainty reduction
- Sequential Monte Carlo Samplers
- Sequential Monte Carlo for rare event estimation
- Sequential design of computer experiments for the estimation of a probability of failure
- The design and analysis of computer experiments.
- The pseudo-marginal approach for efficient Monte Carlo computations
Cited in
(36)- Coupling and selecting constraints in Bayesian optimization under uncertainties
- Multi-objective simultaneous optimistic optimization
- An adaptive agent-based process model for optimizing innovative design
- Bayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency
- An adaptive Bayesian approach to surrogate-assisted evolutionary multi-objective optimization
- Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization
- (Global) optimization: historical notes and recent developments
- Bayesian Subset Simulation
- Learning Enabled Constrained Black-Box Optimization
- Kriging-based infill sampling criterion for constraint handling in multi-objective optimization
- Multiobjective Tree-Structured Parzen Estimator
- Handling of constraints in multiobjective blackbox optimization
- Subset simulation for multi-objective optimization
- Bayesian optimization of variable-size design space problems
- pBO-2GP-3B: a batch parallel known/unknown constrained Bayesian optimization with feasibility classification and its applications in computational fluid dynamics
- A surrogate-assisted a priori multiobjective evolutionary algorithm for constrained multiobjective optimization problems
- Performance indicators in multiobjective optimization
- Expected improvement for expensive optimization: a review
- Sequential model based optimization of partially defined functions under unknown constraints
- On the use of polynomial models in multiobjective directional direct search
- scientific article; zbMATH DE number 7164723 (Why is no real title available?)
- A framework of adaptive fuzzy control and optimization for nonlinear systems with output constraints
- Targeting solutions in Bayesian multi-objective optimization: sequential and batch versions
- Methods for constrained optimization of expensive mixed-integer multi-objective problems, with application to an internal combustion engine design problem
- Combining Bayesian optimization and Lipschitz optimization
- Bayesian optimisation for constrained problems
- Sequential Design of Multi-Fidelity Computer Experiments: Maximizing the Rate of Stepwise Uncertainty Reduction
- A survey on kriging-based infill algorithms for multiobjective simulation optimization
- A sampling criterion for constrained Bayesian optimization with uncertainties
- A Hierarchical Expected Improvement Method for Bayesian Optimization
- A supermartingale approach to Gaussian process based sequential design of experiments
- A general framework for constrained Bayesian optimization using information-based search
- Efficient global optimization for high-dimensional constrained problems by using the Kriging models combined with the partial least squares method
- Accelerated random search for constrained global optimization assisted by radial basis function surrogates
- Bayesian Optimization for Cascade-Type Multistage Processes
- Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules
This page was built for publication: A Bayesian approach to constrained single- and multi-objective optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q506449)
