Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization
From MaRDI portal
Publication:4580293
DOI10.1137/16M1082469zbMATH Open1458.65003arXiv1806.10761OpenAlexW2811395263WikidataQ129384446 ScholiaQ129384446MaRDI QIDQ4580293FDOQ4580293
Karen Willcox, Max Gunzburger, Benjamin Peherstorfer
Publication date: 14 August 2018
Published in: SIAM Review (Search for Journal in Brave)
Abstract: In many situations across computational science and engineering, multiple computational models are available that describe a system of interest. These different models have varying evaluation costs and varying fidelities. Typically, a computationally expensive high-fidelity model describes the system with the accuracy required by the current application at hand, while lower-fidelity models are less accurate but computationally cheaper than the high-fidelity model. Outer-loop applications, such as optimization, inference, and uncertainty quantification, require multiple model evaluations at many different inputs, which often leads to computational demands that exceed available resources if only the high-fidelity model is used. This work surveys multifidelity methods that accelerate the solution of outer-loop applications by combining high-fidelity and low-fidelity model evaluations, where the low-fidelity evaluations arise from an explicit low-fidelity model (e.g., a simplified physics approximation, a reduced model, a data-fit surrogate, etc.) that approximates the same output quantity as the high-fidelity model. The overall premise of these multifidelity methods is that low-fidelity models are leveraged for speedup while the high-fidelity model is kept in the loop to establish accuracy and/or convergence guarantees. We categorize multifidelity methods according to three classes of strategies: adaptation, fusion, and filtering. The paper reviews multifidelity methods in the outer-loop contexts of uncertainty propagation, inference, and optimization.
Full work available at URL: https://arxiv.org/abs/1806.10761
model reductionsurrogate modelmultifidelity optimizationmultifidelity statistical inferencemultifidelity uncertainty propagationmultifidelity uncertainty quantification
Research exposition (monographs, survey articles) pertaining to numerical analysis (65-02) Research exposition (monographs, survey articles) pertaining to statistics (62-02) Research exposition (monographs, survey articles) pertaining to calculus of variations and optimal control (49-02)
Cites Work
- Efficient global optimization of expensive black-box functions
- Monte Carlo strategies in scientific computing.
- Weak convergence and optimal scaling of random walk Metropolis algorithms
- Design and analysis of computer experiments. With comments and a rejoinder by the authors
- Support-vector networks
- Bayesian calibration of computer models. (With discussion)
- Bayesian Treed Gaussian Process Models With an Application to Computer Modeling
- `` Direct Search Solution of Numerical and Statistical Problems
- Variable Metric Method for Minimization
- A Rapidly Convergent Descent Method for Minimization
- An adaptive Metropolis algorithm
- Statistical and computational inverse problems.
- A taxonomy of global optimization methods based on response surfaces
- Delayed rejection in reversible jump Metropolis-Hastings.
- Ten Lectures on Wavelets
- Sparse grids
- Anderson Acceleration for Fixed-Point Iterations
- GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
- An Algorithm for Least-Squares Estimation of Nonlinear Parameters
- Model Selection and Multimodel Inference
- Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms
- Iterative Procedures for Nonlinear Integral Equations
- A method for the solution of certain non-linear problems in least squares
- Adaptive Markov Chain Monte Carlo through Regeneration
- Riemann Manifold Langevin and Hamiltonian Monte Carlo Methods
- Combining Field Data and Computer Simulations for Calibration and Prediction
- Adaptiveh-refinement for reduced-order models
- Statistical inverse problems: discretization, model reduction and inverse crimes
- Approximation errors and truncation of computational domains with application to geophysical tomography
- Inverse problems: a Bayesian perspective
- Nonlinear Model Reduction via Discrete Empirical Interpolation
- Finite Element Approximations for Stokes–Darcy Flow with Beavers–Joseph Interface Conditions
- Approximation errors and model reduction with an application in optical diffusion tomography
- Multilevel Monte Carlo Path Simulation
- An approximation error approach for compensating for modelling errors between the radiative transfer equation and the diffusion approximation in diffuse optical tomography
- A New Look at Proper Orthogonal Decomposition
- Trust Region Methods
- Approximation error analysis in nonlinear state estimation with an application to state-space identification
- Approximation of Large-Scale Dynamical Systems
- A Stochastic Collocation Method for Elliptic Partial Differential Equations with Random Input Data
- Galerkin proper orthogonal decomposition methods for parabolic problems
- Approximation errors in nonstationary inverse problems
- Multi-index Monte Carlo: when sparsity meets sampling
- A Multilevel Stochastic Collocation Method for Partial Differential Equations with Random Input Data
- Further analysis of multilevel Monte Carlo methods for elliptic PDEs with random coefficients
- Turbulence and the dynamics of coherent structures. I. Coherent structures
- Principal component analysis in linear systems: Controllability, observability, and model reduction
- Multi-Level Adaptive Solutions to Boundary-Value Problems
- Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients
- Model reduction methods based on Krylov subspaces
- Global Convergence of General Derivative-Free Trust-Region Algorithms to First- and Second-Order Critical Points
- On the stability of the reduced basis method for Stokes equations in parametrized domains
- A successive constraint linear optimization method for lower bounds of parametric coercivity and inf-sup stability constants
- A survey of projection-based model reduction methods for parametric dynamical systems
- Progressive construction of a parametric reduced‐order model for PDE‐constrained optimization
- On the Convergence of Pattern Search Algorithms
- Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations
- Introduction to Derivative-Free Optimization
- A Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data
- Certified real‐time solution of the parametrized steady incompressible Navier–Stokes equations: rigorous reduced‐basis a posteriori error bounds
- Galerkin Proper Orthogonal Decomposition Methods for a General Equation in Fluid Dynamics
- A Class of Methods for Solving Nonlinear Simultaneous Equations
- A New Algorithm for Unconstrained Optimization
- Reduced basis approximation and a posteriori error estimation for affinely parametrized elliptic coercive partial differential equations. Application to transport and continuum mechanics.
- Multi-fidelity optimization via surrogate modelling
- A Multigrid Tutorial, Second Edition
- A Survey of Model Reduction by Balanced Truncation and Some New Results
- Predicting the output from a complex computer code when fast approximations are available
- Reduced basis method for finite volume approximations of parametrized linear evolution equations
- The principle of minimized iterations in the solution of the matrix eigenvalue problem
- A stochastic Newton MCMC method for large-scale statistical inverse problems with application to seismic inversion
- Parallel Multilevel Preconditioners
- MCMC methods for functions: modifying old algorithms to make them faster
- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- A stochastic collocation algorithm with multifidelity models
- Centroidal Voronoi Tessellations: Applications and Algorithms
- Convergence Analysis for Anderson Acceleration
- Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems
- On dynamic mode decomposition: theory and applications
- Dynamic mode decomposition with control
- $\mathcal{H}_2$ Model Reduction for Large-Scale Linear Dynamical Systems
- Combining Probability Distributions from Dependent Information Sources
- On Metropolis-Hastings algorithms with delayed rejection
- POD and CVT-based reduced-order modeling of Navier-Stokes flows
- Constrained multifidelity optimization using model calibration
- Asymptotic waveform evaluation via a Lanczos method
- Synthesis of minimum roundoff noise fixed point digital filters
- Accelerating optimization of parametric linear systems by model order reduction
- RECONSTRUCTION OF DOMAIN BOUNDARY AND CONDUCTIVITY IN ELECTRICAL IMPEDANCE TOMOGRAPHY USING THE APPROXIMATION ERROR APPROACH
- A Bayesian approach to characterizing uncertainty in inverse problems using coarse and fine-scale information
- Preconditioning Markov Chain Monte Carlo Simulations Using Coarse-Scale Models
- Optimal control of the cylinder wake in the laminar regime by trust-region methods and POD reduced-order models
- Error estimates for abstract linear-quadratic optimal control problems using proper orthogonal decomposition
- Multilevel preconditioning
- A variance reduction method for parametrized stochastic differential equations using the reduced basis paradigm
- Reduced basis approximation and a posteriori error estimation for Stokes flows in parametrized geometries: roles of the inf-sup stability constants
- Accurate and efficient evaluation of failure probability for partial different equations with random input data
- Multifidelity approaches for optimization under uncertainty
- Convergence Rates of the POD–Greedy Method
- Interpolatory Projection Methods for Parameterized Model Reduction
- Accurate Uncertainty Quantification Using Inaccurate Computational Models
- An efficient surrogate-based method for computing rare failure probability
- Evaluation of failure probability via surrogate models
- Worst case scenario analysis for elliptic problems with uncertainty
- A new error bound for reduced basis approximation of parabolic partial differential equations
- Global Convergence of Radial Basis Function Trust Region Derivative-Free Algorithms
- The hierarchical basis multigrid method
- Dynamic data-driven reduced-order models
- A fast Monte-Carlo method with a reduced basis of control variates applied to uncertainty propagation and Bayesian estimation
- Stochastic finite element methods for partial differential equations with random input data
- A multi level Monte Carlo method with control variate for elliptic PDEs with log-normal coefficients
- Likelihood-informed dimension reduction for nonlinear inverse problems
- Data-driven model reduction for the Bayesian solution of inverse problems
- A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow
- A Space-Time Petrov--Galerkin Certified Reduced Basis Method: Application to the Boussinesq Equations
- Exaflop/s: the why and the how
- Dimension-independent likelihood-informed MCMC
- Analysis and finite element approximation of a coupled, continuum pipe-flow/Darcy model for flow in porous media with embedded conduits
- Multifidelity importance sampling
- Online Adaptive Model Reduction for Nonlinear Systems via Low-Rank Updates
- Hierarchical bases give conjugate gradient type methods a multigrid speed of convergence
- Fast local reduced basis updates for the efficient reduction of nonlinear systems with hyper-reduction
- On control variate estimators
- Optimal model management for multifidelity Monte Carlo estimation
- A model and variance reduction method for computing statistical outputs of stochastic elliptic partial differential equations
- IMPROVING SIMULATION EFFICIENCY WITH QUASI CONTROL VARIATES
- A MATHEMATICAL AND COMPUTATIONAL FRAMEWORK FOR MULTIFIDELITY DESIGN AND ANALYSIS WITH COMPUTER MODELS
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
- Title not available (Why is that?)
Cited In (only showing first 100 items - show all)
- Taylor approximation and variance reduction for PDE-constrained optimal control under uncertainty
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Multi-fidelity modeling framework for nonlinear unsteady aerodynamics of airfoils
- Nonlinear Reduced Models for State and Parameter Estimation
- Multi-fidelity classification using Gaussian processes: accelerating the prediction of large-scale computational models
- Fast sampling of parameterised Gaussian random fields
- Stability of Discrete Empirical Interpolation and Gappy Proper Orthogonal Decomposition with Randomized and Deterministic Sampling Points
- Randomized approaches to accelerate MCMC algorithms for Bayesian inverse problems
- A bi-fidelity stochastic collocation method for transport equations with diffusive scaling and multi-dimensional random inputs
- Multifidelity probability estimation via fusion of estimators
- Goal-oriented adaptive modeling of random heterogeneous media and model-based multilevel Monte Carlo methods
- Multi-fidelity nonlinear unsteady aerodynamic modeling and uncertainty estimation based on hierarchical Kriging
- Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes
- Efficient prediction of turbulent flow quantities using a Bayesian hierarchical multifidelity model
- A transport-based multifidelity preconditioner for Markov chain Monte Carlo
- Multi-fidelity surrogate-based optimal design of road vehicle suspension systems
- Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
- Novel rough set theory-based method for epistemic uncertainty modeling, analysis and applications
- Resource-Constrained Model Selection for Uncertainty Propagation and Data Assimilation
- Adaptive Reduced-Order Model Construction for Conditional Value-at-Risk Estimation
- Projection-based model reduction: formulations for physics-based machine learning
- A non-intrusive multifidelity method for the reduced order modeling of nonlinear problems
- The Random Feature Model for Input-Output Maps between Banach Spaces
- Sampling Low-Dimensional Markovian Dynamics for Preasymptotically Recovering Reduced Models from Data with Operator Inference
- Residual Gaussian process: a tractable nonparametric Bayesian emulator for multi-fidelity simulations
- A general frame for uncertainty propagation under multimodally distributed random variables
- The statistical finite element method (statFEM) for coherent synthesis of observation data and model predictions
- Non-intrusive reduced-order modeling of parameterized electromagnetic scattering problems using cubic spline interpolation
- A multi-level procedure for enhancing accuracy of machine learning algorithms
- Multifidelity Data Fusion via Gradient-Enhanced Gaussian Process Regression
- Uncertainty calibration for probabilistic projection methods
- POD-based model order reduction with an adaptive snapshot selection for a discontinuous Galerkin approximation of the time-domain Maxwell's equations
- Multiobjective optimal control methods for the Navier-Stokes equations using reduced order modeling
- Multilevel Adaptive Sparse Leja Approximations for Bayesian Inverse Problems
- A Multifidelity Ensemble Kalman Filter with Reduced Order Control Variates
- A generalized multi-fidelity simulation method using sparse polynomial chaos expansion
- On Multilevel Best Linear Unbiased Estimators
- Conditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systems
- High-dimensional and higher-order multifidelity Monte Carlo estimators
- Learning Enabled Constrained Black-Box Optimization
- An Adaptive Surrogate Modeling Based on Deep Neural Networks for Large-Scale Bayesian Inverse Problems
- Data-driven forward discretizations for Bayesian inversion
- Parametric solutions of turbulent incompressible flows in OpenFOAM via the proper generalised decomposition
- Nonintrusive proper generalised decomposition for parametrised incompressible flow problems in OpenFOAM
- Optimal potential functions for the interacting particle system method
- Tensor-Based Numerical Method for Stochastic Homogenization
- Bi-fidelity stochastic gradient descent for structural optimization under uncertainty
- Accelerating uncertainty quantification of groundwater flow modelling using a deep neural network proxy
- Data fusion for uncertainty quantification with non-intrusive polynomial chaos
- Data-driven reduced order modeling for time-dependent problems
- Uncertainty Quantification for the BGK Model of the Boltzmann Equation Using Multilevel Variance Reduced Monte Carlo Methods
- Active learning with multifidelity modeling for efficient rare event simulation
- A generalized probabilistic learning approach for multi-fidelity uncertainty quantification in complex physical simulations
- Data-driven multifidelity topology design using a deep generative model: application to forced convection heat transfer problems
- 1 Model reduction in chemical process optimization
- Sensitivity-driven adaptive sparse stochastic approximations in plasma microinstability analysis
- A multifidelity Monte Carlo method for realistic computational budgets
- Optimal Reduced Model Algorithms for Data-Based State Estimation
- A Benchmark for the Bayesian Inversion of Coefficients in Partial Differential Equations
- Data-driven compressive sensing and applications in uncertainty quantification
- Applying Bayesian optimization with Gaussian process regression to computational fluid dynamics problems
- IGA-based multi-index stochastic collocation for random PDEs on arbitrary domains
- Uncertainty quantification of discontinuous outputs via a non-intrusive bifidelity strategy
- Transfer learning based multi-fidelity physics informed deep neural network
- Multifidelity uncertainty quantification with models based on dissimilar parameters
- An Adaptive Non-Intrusive Multi-Fidelity Reduced Basis Method for Parameterized Partial Differential Equations
- Multi-fidelity regression using artificial neural networks: efficient approximation of parameter-dependent output quantities
- A physics-informed multi-fidelity approach for the estimation of differential equations parameters in low-data or large-noise regimes
- Multi-fidelity Bayesian neural networks: algorithms and applications
- Propagation of uncertainty in the mechanical and biological response of growing tissues using multi-fidelity Gaussian process regression
- A non-intrusive model order reduction approach for parameterized time-domain Maxwell's equations
- Variational inference for nonlinear inverse problems via neural net kernels: comparison to Bayesian neural networks, application to topology optimization
- Title not available (Why is that?)
- Efficient aerodynamic analysis and optimization under uncertainty using multi-fidelity polynomial chaos-Kriging surrogate model
- An intelligent multi-fidelity surrogate-assisted multi-objective reservoir production optimization method based on transfer stacking
- Model Reduction for Transport-Dominated Problems via Online Adaptive Bases and Adaptive Sampling
- Registration-based model reduction of parameterized two-dimensional conservation laws
- Multifidelity Dimension Reduction via Active Subspaces
- Multifidelity Monte Carlo Estimation of Variance and Sensitivity Indices
- Constrained Optimization in the Presence of Noise
- A new bi-fidelity model reduction method for Bayesian inverse problems
- Multi-fidelity parametric sensitivity estimation for large eddy simulation with the Spalart–Allmaras model
- On global normal linear approximations for nonlinear Bayesian inverse problems
- Forward sensitivity analysis and mode dependent control for closure modeling of Galerkin systems
- Operator inference with roll outs for learning reduced models from scarce and low-quality data
- A trust region method for noisy unconstrained optimization
- A concurrent implementation of the surrogate management framework with application to cardiovascular shape optimization
- Data driven adaptive Gaussian mixture model for solving Fokker-Planck equation
- Multi-model communication and data assimilation for mitigating model error and improving forecasts
- Multifidelity Approximate Bayesian Computation
- A Bandit-Learning Approach to Multifidelity Approximation
- Learning Low-Dimensional Dynamical-System Models from Noisy Frequency-Response Data with Loewner Rational Interpolation
- Multi-fidelity analysis and uncertainty quantification of beam vibration using correction response surfaces
- Co-kriging based multi-fidelity uncertainty quantification of beam vibration using coarse and fine finite element meshes
- Multi-fidelity response surfaces for uncertainty quantification in beams using coarse and fine finite element discretizations
- Residual-based error correction for neural operator accelerated Infinite-dimensional Bayesian inverse problems
- Online MCMC Thinning with Kernelized Stein Discrepancy
- Neural-physics multi-fidelity model with active learning and uncertainty quantification for GPU-enabled microfluidic concentration gradient generator design
- Bi-fidelity reduced polynomial chaos expansion for uncertainty quantification
- Feasibility of DEIM for retrieving the initial field via dimensionality reduction
Uses Software
This page was built for publication: Survey of Multifidelity Methods in Uncertainty Propagation, Inference, and Optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4580293)
