A Bayesian approach to constrained single- and multi-objective optimization
From MaRDI portal
(Redirected from Publication:506449)
Abstract: This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to evaluate. As a consequence, the number of evaluations that can be used to carry out the optimization is very limited, as in complex industrial design optimization problems. The method we propose to overcome this difficulty has its roots in both the Bayesian and the multi-objective optimization literatures. More specifically, an extended domination rule is used to handle objectives and constraints in a unified way, and a corresponding expected hyper-volume improvement sampling criterion is proposed. This new criterion is naturally adapted to the search of a feasible point when none is available, and reduces to existing Bayesian sampling criteria---the classical Expected Improvement (EI) criterion and some of its constrained/multi-objective extensions---as soon as at least one feasible point is available. The calculation and optimization of the criterion are performed using Sequential Monte Carlo techniques. In particular, an algorithm similar to the subset simulation method, which is well known in the field of structural reliability, is used to estimate the criterion. The method, which we call BMOO (for Bayesian Multi-Objective Optimization), is compared to state-of-the-art algorithms for single- and multi-objective constrained optimization.
Recommendations
- Bayesian approach to global optimization and application to multiobjective and constrained problems
- scientific article; zbMATH DE number 7164723
- scientific article; zbMATH DE number 4174179
- Kriging-based infill sampling criterion for constraint handling in multi-objective optimization
- Survey on Bayesian optimization methodology and applications
Cites work
- scientific article; zbMATH DE number 43985 (Why is no real title available?)
- scientific article; zbMATH DE number 3612796 (Why is no real title available?)
- scientific article; zbMATH DE number 1203355 (Why is no real title available?)
- scientific article; zbMATH DE number 653035 (Why is no real title available?)
- scientific article; zbMATH DE number 2013535 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- scientific article; zbMATH DE number 3251902 (Why is no real title available?)
- A Globally Convergent Augmented Lagrangian Algorithm for Optimization with General Constraints and Simple Bounds
- A general framework for constrained Bayesian optimization using information-based search
- A probabilistic algorithm for global optimization
- An informational approach to the global optimization of expensive-to-evaluate functions
- Efficient global optimization of expensive black-box functions
- Enhancing infill sampling criteria for surrogate-based constrained optimization
- Evolutionary Multi-Criterion Optimization
- Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization
- Gaussian processes for machine learning.
- Interpolation of spatial data. Some theory for kriging
- Monte Carlo strategies in scientific computing
- Multiobjective optimization using Gaussian process emulators via stepwise uncertainty reduction
- Sequential Monte Carlo Samplers
- Sequential Monte Carlo for rare event estimation
- Sequential design of computer experiments for the estimation of a probability of failure
- The design and analysis of computer experiments.
- The pseudo-marginal approach for efficient Monte Carlo computations
Cited in
(36)- pBO-2GP-3B: a batch parallel known/unknown constrained Bayesian optimization with feasibility classification and its applications in computational fluid dynamics
- A sampling criterion for constrained Bayesian optimization with uncertainties
- Sequential Design of Multi-Fidelity Computer Experiments: Maximizing the Rate of Stepwise Uncertainty Reduction
- An adaptive agent-based process model for optimizing innovative design
- A Hierarchical Expected Improvement Method for Bayesian Optimization
- A general framework for constrained Bayesian optimization using information-based search
- Multiobjective Tree-Structured Parzen Estimator
- Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization
- Performance indicators in multiobjective optimization
- Combining Bayesian optimization and Lipschitz optimization
- A supermartingale approach to Gaussian process based sequential design of experiments
- Bayesian optimization of variable-size design space problems
- Expected improvement for expensive optimization: a review
- Sequential model based optimization of partially defined functions under unknown constraints
- On the use of polynomial models in multiobjective directional direct search
- Handling of constraints in multiobjective blackbox optimization
- Efficient global optimization for high-dimensional constrained problems by using the Kriging models combined with the partial least squares method
- Coupling and selecting constraints in Bayesian optimization under uncertainties
- Subset simulation for multi-objective optimization
- Bayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency
- Bayesian Subset Simulation
- A surrogate-assisted a priori multiobjective evolutionary algorithm for constrained multiobjective optimization problems
- Learning Enabled Constrained Black-Box Optimization
- Multi-objective simultaneous optimistic optimization
- An adaptive Bayesian approach to surrogate-assisted evolutionary multi-objective optimization
- Kriging-based infill sampling criterion for constraint handling in multi-objective optimization
- Bayesian optimisation for constrained problems
- Targeting solutions in Bayesian multi-objective optimization: sequential and batch versions
- Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules
- Accelerated random search for constrained global optimization assisted by radial basis function surrogates
- A framework of adaptive fuzzy control and optimization for nonlinear systems with output constraints
- A survey on kriging-based infill algorithms for multiobjective simulation optimization
- Bayesian Optimization for Cascade-Type Multistage Processes
- Methods for constrained optimization of expensive mixed-integer multi-objective problems, with application to an internal combustion engine design problem
- (Global) optimization: historical notes and recent developments
- scientific article; zbMATH DE number 7164723 (Why is no real title available?)
This page was built for publication: A Bayesian approach to constrained single- and multi-objective optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q506449)
