A Bayesian approach to constrained single- and multi-objective optimization
From MaRDI portal
Publication:506449
DOI10.1007/S10898-016-0427-3zbMATH Open1390.90441arXiv1510.00503OpenAlexW2191881503MaRDI QIDQ506449FDOQ506449
Authors: Paul Feliot, Julien Bect, Emmanuel Vazquez 
Publication date: 1 February 2017
Published in: Journal of Global Optimization (Search for Journal in Brave)
Abstract: This article addresses the problem of derivative-free (single- or multi-objective) optimization subject to multiple inequality constraints. Both the objective and constraint functions are assumed to be smooth, non-linear and expensive to evaluate. As a consequence, the number of evaluations that can be used to carry out the optimization is very limited, as in complex industrial design optimization problems. The method we propose to overcome this difficulty has its roots in both the Bayesian and the multi-objective optimization literatures. More specifically, an extended domination rule is used to handle objectives and constraints in a unified way, and a corresponding expected hyper-volume improvement sampling criterion is proposed. This new criterion is naturally adapted to the search of a feasible point when none is available, and reduces to existing Bayesian sampling criteria---the classical Expected Improvement (EI) criterion and some of its constrained/multi-objective extensions---as soon as at least one feasible point is available. The calculation and optimization of the criterion are performed using Sequential Monte Carlo techniques. In particular, an algorithm similar to the subset simulation method, which is well known in the field of structural reliability, is used to estimate the criterion. The method, which we call BMOO (for Bayesian Multi-Objective Optimization), is compared to state-of-the-art algorithms for single- and multi-objective constrained optimization.
Full work available at URL: https://arxiv.org/abs/1510.00503
Recommendations
- Bayesian approach to global optimization and application to multiobjective and constrained problems
- scientific article; zbMATH DE number 7164723
- scientific article; zbMATH DE number 4174179
- Kriging-based infill sampling criterion for constraint handling in multi-objective optimization
- Survey on Bayesian optimization methodology and applications
sequential Monte CarloGaussian processkrigingmulti-objectiveexpected improvementsubset simulationBayesian optimization
Cites Work
- Efficient global optimization of expensive black-box functions
- A general framework for constrained Bayesian optimization using information-based search
- Sequential Monte Carlo Samplers
- Interpolation of spatial data. Some theory for kriging
- The design and analysis of computer experiments.
- Gaussian processes for machine learning.
- Title not available (Why is that?)
- Title not available (Why is that?)
- The pseudo-marginal approach for efficient Monte Carlo computations
- Title not available (Why is that?)
- Monte Carlo strategies in scientific computing
- Sequential design of computer experiments for the estimation of a probability of failure
- An informational approach to the global optimization of expensive-to-evaluate functions
- A Globally Convergent Augmented Lagrangian Algorithm for Optimization with General Constraints and Simple Bounds
- Enhancing infill sampling criteria for surrogate-based constrained optimization
- Title not available (Why is that?)
- Sequential Monte Carlo for rare event estimation
- Title not available (Why is that?)
- Title not available (Why is that?)
- Fast calculation of multiobjective probability of improvement and expected improvement criteria for Pareto optimization
- A probabilistic algorithm for global optimization
- Title not available (Why is that?)
- Evolutionary Multi-Criterion Optimization
- Multiobjective optimization using Gaussian process emulators via stepwise uncertainty reduction
Cited In (36)
- pBO-2GP-3B: a batch parallel known/unknown constrained Bayesian optimization with feasibility classification and its applications in computational fluid dynamics
- Sequential Design of Multi-Fidelity Computer Experiments: Maximizing the Rate of Stepwise Uncertainty Reduction
- An adaptive agent-based process model for optimizing innovative design
- A Hierarchical Expected Improvement Method for Bayesian Optimization
- A general framework for constrained Bayesian optimization using information-based search
- Multiobjective Tree-Structured Parzen Estimator
- Output Space Entropy Search Framework for Multi-Objective Bayesian Optimization
- Performance indicators in multiobjective optimization
- Combining Bayesian optimization and Lipschitz optimization
- A supermartingale approach to Gaussian process based sequential design of experiments
- Handling of constraints in multiobjective blackbox optimization
- Bayesian optimization of variable-size design space problems
- Expected improvement for expensive optimization: a review
- Sequential model based optimization of partially defined functions under unknown constraints
- On the use of polynomial models in multiobjective directional direct search
- Efficient global optimization for high-dimensional constrained problems by using the Kriging models combined with the partial least squares method
- Coupling and selecting constraints in Bayesian optimization under uncertainties
- Bayesian Joint Chance Constrained Optimization: Approximations and Statistical Consistency
- Subset simulation for multi-objective optimization
- Bayesian Subset Simulation
- A surrogate-assisted a priori multiobjective evolutionary algorithm for constrained multiobjective optimization problems
- Learning Enabled Constrained Black-Box Optimization
- Multi-objective simultaneous optimistic optimization
- An adaptive Bayesian approach to surrogate-assisted evolutionary multi-objective optimization
- Kriging-based infill sampling criterion for constraint handling in multi-objective optimization
- Bayesian optimisation for constrained problems
- Targeting solutions in Bayesian multi-objective optimization: sequential and batch versions
- Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules
- A framework of adaptive fuzzy control and optimization for nonlinear systems with output constraints
- Accelerated random search for constrained global optimization assisted by radial basis function surrogates
- A survey on kriging-based infill algorithms for multiobjective simulation optimization
- Bayesian Optimization for Cascade-Type Multistage Processes
- Methods for constrained optimization of expensive mixed-integer multi-objective problems, with application to an internal combustion engine design problem
- (Global) optimization: historical notes and recent developments
- Title not available (Why is that?)
- A sampling criterion for constrained Bayesian optimization with uncertainties
Uses Software
This page was built for publication: A Bayesian approach to constrained single- and multi-objective optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q506449)
