Multifidelity Bayesian Experimental Design to Quantify Rare-Event Statistics

DOI10.1137/22M1503956MaRDI QIDQ6131420zbMATH OpenOpenAlexFDO

Authors Xianliang Gong, Yulin Pan

Publication date 5 April 2024

Published in SIAM/ASA Journal on Uncertainty Quantification (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2201.00222

zbMATH Keywords

uncertainty quantificationrare eventsBayesian experimental designmultifidelity models

Mathematics Subject Classification ID

Bayesian inference (62F15) Learning and adaptive systems in artificial intelligence (68T05) Large deviations (60F10) Sampling theory, sample surveys (62D05) Statistics of extreme values; tail inference (62G32) Optimal statistical designs (62K05)

Abstract: In this work, we develop a multi-fidelity Bayesian experimental design framework to efficiently quantify the extreme-event statistics of an input-to-response (ItR) system with given input probability and expensive function evaluations. The key idea here is to leverage low-fidelity samples whose responses can be computed with a cost of a certain fraction of that for high-fidelity samples, in an optimized configuration to reduce the total computational cost. To accomplish this goal, we employ a multi-fidelity Gaussian process as the surrogate model of the ItR function, and develop a new acquisition based on which the optimized next sample can be selected in terms of its location in the sample space and the fidelity level. In addition, we develop an inexpensive analytical evaluation of the acquisition and its derivative, avoiding numerical integrations that are prohibitive for high-dimensional problems. The new method is tested in a bi-fidelity context for a series of synthetic problems with varying dimensions, low-fidelity model accuracy and computational costs. Comparing with the single-fidelity method and the bi-fidelity method with a pre-defined fidelity hierarchy, our method consistently shows the best (or among the best) performance for all the test cases. Finally, we demonstrate the superiority of our method in solving an engineering problem of estimating the extreme ship motion statistics in irregular waves, using computational fluid dynamics (CFD) with two different grid resolutions as the high and low fidelity models.

Recommendations

• Active learning with multifidelity modeling for efficient rare event simulation
• Multifidelity preconditioning of the cross-entropy method for rare event simulation and failure probability estimation
• Output-weighted optimal sampling for Bayesian regression and rare event statistics using few samples
• Multifidelity approaches for optimization under uncertainty
• Survey of multifidelity methods in uncertainty propagation, inference, and optimization

Cites work

• scientific article; zbMATH DE number 1149423 (Why is no real title available?)
• A composite neural network that learns from multi-fidelity data: application to function approximation and inverse PDE problems
• Advanced Lectures on Machine Learning
• Asymptotic probabilities and differential equations
• Bayesian experimental design: A review
• Bayesian optimization with output-weighted optimal sampling
• Computation of extreme values of time averaged observables in climate models with large deviation techniques
• Deep learning
• Extreme event probability estimation using PDE-constrained optimization and large deviation theory, with application to tsunamis
• Extreme event quantification in dynamical systems with random components
• Gaussian process surrogates for failure detection: a Bayesian experimental design approach
• Multi-fidelity Bayesian neural networks: algorithms and applications
• Multi-fidelity optimization via surrogate modelling
• Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling
• Numerical computation of rare events via large deviation theory
• Optimization under rare chance constraints
• Output-Weighted Optimal Sampling for Bayesian Experimental Design and Uncertainty Quantification
• Output-weighted optimal sampling for Bayesian regression and rare event statistics using few samples
• Predicting the output from a complex computer code when fast approximations are available
• Reduced-order precursors of rare events in unidirectional nonlinear water waves
• Rogue waves and large deviations in deep sea
• Sequential Bayesian experimental design for estimation of extreme-event probability in stochastic input-to-response systems
• Sequential sampling strategy for extreme event statistics in nonlinear dynamical systems
• Updating Quasi-Newton Matrices with Limited Storage

Cited in

(1)

• A review of recent advances in surrogate models for uncertainty quantification of high-dimensional engineering applications

This page was built for publication: Multifidelity Bayesian Experimental Design to Quantify Rare-Event Statistics

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6131420)