Survey of multifidelity methods in uncertainty propagation, inference, and optimization
From MaRDI portal
Publication:4580293
DOI10.1137/16M1082469zbMATH Open1458.65003arXiv1806.10761OpenAlexW2811395263WikidataQ129384446 ScholiaQ129384446MaRDI QIDQ4580293FDOQ4580293
Authors: Benjamin Peherstorfer, Karen Willcox, Max Gunzburger 
Publication date: 14 August 2018
Published in: SIAM Review (Search for Journal in Brave)
Abstract: In many situations across computational science and engineering, multiple computational models are available that describe a system of interest. These different models have varying evaluation costs and varying fidelities. Typically, a computationally expensive high-fidelity model describes the system with the accuracy required by the current application at hand, while lower-fidelity models are less accurate but computationally cheaper than the high-fidelity model. Outer-loop applications, such as optimization, inference, and uncertainty quantification, require multiple model evaluations at many different inputs, which often leads to computational demands that exceed available resources if only the high-fidelity model is used. This work surveys multifidelity methods that accelerate the solution of outer-loop applications by combining high-fidelity and low-fidelity model evaluations, where the low-fidelity evaluations arise from an explicit low-fidelity model (e.g., a simplified physics approximation, a reduced model, a data-fit surrogate, etc.) that approximates the same output quantity as the high-fidelity model. The overall premise of these multifidelity methods is that low-fidelity models are leveraged for speedup while the high-fidelity model is kept in the loop to establish accuracy and/or convergence guarantees. We categorize multifidelity methods according to three classes of strategies: adaptation, fusion, and filtering. The paper reviews multifidelity methods in the outer-loop contexts of uncertainty propagation, inference, and optimization.
Full work available at URL: https://arxiv.org/abs/1806.10761
Recommendations
- Multifidelity approaches for optimization under uncertainty
- Optimal model management for multifidelity Monte Carlo estimation
- Budget-limited distribution learning in multifidelity problems
- Context-Aware Surrogate Modeling for Balancing Approximation and Sampling Costs in Multifidelity Importance Sampling and Bayesian Inverse Problems
- Multifidelity Monte Carlo Estimation with Adaptive Low-Fidelity Models
model reductionsurrogate modelmultifidelity optimizationmultifidelity statistical inferencemultifidelity uncertainty propagationmultifidelity uncertainty quantification
Research exposition (monographs, survey articles) pertaining to numerical analysis (65-02) Research exposition (monographs, survey articles) pertaining to statistics (62-02) Research exposition (monographs, survey articles) pertaining to calculus of variations and optimal control (49-02)
Cites Work
- Efficient global optimization of expensive black-box functions
- Title not available (Why is that?)
- Monte Carlo strategies in scientific computing.
- Weak convergence and optimal scaling of random walk Metropolis algorithms
- Design and analysis of computer experiments. With comments and a rejoinder by the authors
- Support-vector networks
- Bayesian calibration of computer models. (With discussion)
- Bayesian treed Gaussian process models with an application to computer modeling
- Gaussian processes for machine learning.
- `` Direct Search Solution of Numerical and Statistical Problems
- Variable Metric Method for Minimization
- Title not available (Why is that?)
- Title not available (Why is that?)
- A Rapidly Convergent Descent Method for Minimization
- Pattern recognition and machine learning.
- Title not available (Why is that?)
- An adaptive Metropolis algorithm
- Statistical and computational inverse problems.
- A taxonomy of global optimization methods based on response surfaces
- Delayed rejection in reversible jump Metropolis-Hastings.
- Title not available (Why is that?)
- Ten Lectures on Wavelets
- Title not available (Why is that?)
- Sparse grids
- Anderson acceleration for fixed-point iterations
- GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
- An Algorithm for Least-Squares Estimation of Nonlinear Parameters
- Title not available (Why is that?)
- Model Selection and Multimodel Inference
- Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms
- Iterative Procedures for Nonlinear Integral Equations
- A method for the solution of certain non-linear problems in least squares
- Adaptive Markov Chain Monte Carlo through Regeneration
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Combining Field Data and Computer Simulations for Calibration and Prediction
- Adaptive \(h\)-refinement for reduced-order models
- Statistical inverse problems: discretization, model reduction and inverse crimes
- Approximation errors and truncation of computational domains with application to geophysical tomography
- Inverse problems: a Bayesian perspective
- Nonlinear model reduction via discrete empirical interpolation
- Finite Element Approximations for Stokes–Darcy Flow with Beavers–Joseph Interface Conditions
- Approximation errors and model reduction with an application in optical diffusion tomography
- Multilevel Monte Carlo Path Simulation
- An approximation error approach for compensating for modelling errors between the radiative transfer equation and the diffusion approximation in diffuse optical tomography
- A New Look at Proper Orthogonal Decomposition
- Trust Region Methods
- Approximation error analysis in nonlinear state estimation with an application to state-space identification
- Approximation of Large-Scale Dynamical Systems
- A Stochastic Collocation Method for Elliptic Partial Differential Equations with Random Input Data
- Galerkin proper orthogonal decomposition methods for parabolic problems
- Approximation errors in nonstationary inverse problems
- Multi-index Monte Carlo: when sparsity meets sampling
- A multilevel stochastic collocation method for partial differential equations with random input data
- Further analysis of multilevel Monte Carlo methods for elliptic PDEs with random coefficients
- Turbulence and the dynamics of coherent structures. I. Coherent structures
- Principal component analysis in linear systems: Controllability, observability, and model reduction
- Multi-Level Adaptive Solutions to Boundary-Value Problems
- Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients
- Title not available (Why is that?)
- Model reduction methods based on Krylov subspaces
- Title not available (Why is that?)
- Global convergence of general derivative-free trust-region algorithms to first- and second-order critical points
- On the stability of the reduced basis method for Stokes equations in parametrized domains
- A successive constraint linear optimization method for lower bounds of parametric coercivity and inf-sup stability constants
- A survey of projection-based model reduction methods for parametric dynamical systems
- Progressive construction of a parametric reduced-order model for PDE-constrained optimization
- On the Convergence of Pattern Search Algorithms
- Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations
- Introduction to Derivative-Free Optimization
- A Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data
- Certified real‐time solution of the parametrized steady incompressible Navier–Stokes equations: rigorous reduced‐basis a posteriori error bounds
- Galerkin Proper Orthogonal Decomposition Methods for a General Equation in Fluid Dynamics
- A Class of Methods for Solving Nonlinear Simultaneous Equations
- A New Algorithm for Unconstrained Optimization
- Reduced basis approximation and a posteriori error estimation for affinely parametrized elliptic coercive partial differential equations. Application to transport and continuum mechanics.
- Multi-fidelity optimization via surrogate modelling
- Title not available (Why is that?)
- Title not available (Why is that?)
- A Multigrid Tutorial, Second Edition
- A Survey of Model Reduction by Balanced Truncation and Some New Results
- Predicting the output from a complex computer code when fast approximations are available
- Reduced basis method for finite volume approximations of parametrized linear evolution equations
- Title not available (Why is that?)
- The principle of minimized iterations in the solution of the matrix eigenvalue problem
- A stochastic Newton MCMC method for large-scale statistical inverse problems with application to seismic inversion
- Parallel Multilevel Preconditioners
- MCMC methods for functions: modifying old algorithms to make them faster
- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- A stochastic collocation algorithm with multifidelity models
- Centroidal Voronoi Tessellations: Applications and Algorithms
- Convergence analysis for Anderson acceleration
- Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems
- On dynamic mode decomposition: theory and applications
- Dynamic mode decomposition with control
- $\mathcal{H}_2$ Model Reduction for Large-Scale Linear Dynamical Systems
- Combining Probability Distributions from Dependent Information Sources
- On Metropolis-Hastings algorithms with delayed rejection
- POD and CVT-based reduced-order modeling of Navier-Stokes flows
- Constrained multifidelity optimization using model calibration
- Asymptotic waveform evaluation via a Lanczos method
- Title not available (Why is that?)
- Synthesis of minimum roundoff noise fixed point digital filters
- Title not available (Why is that?)
- Accelerating optimization of parametric linear systems by model order reduction
- RECONSTRUCTION OF DOMAIN BOUNDARY AND CONDUCTIVITY IN ELECTRICAL IMPEDANCE TOMOGRAPHY USING THE APPROXIMATION ERROR APPROACH
- A Bayesian approach to characterizing uncertainty in inverse problems using coarse and fine-scale information
- Preconditioning Markov Chain Monte Carlo Simulations Using Coarse-Scale Models
- Title not available (Why is that?)
- Optimal control of the cylinder wake in the laminar regime by trust-region methods and POD reduced-order models
- Error estimates for abstract linear-quadratic optimal control problems using proper orthogonal decomposition
- Multilevel preconditioning
- Title not available (Why is that?)
- A variance reduction method for parametrized stochastic differential equations using the reduced basis paradigm
- Reduced basis approximation and a posteriori error estimation for Stokes flows in parametrized geometries: roles of the inf-sup stability constants
- Accurate and efficient evaluation of failure probability for partial different equations with random input data
- Multifidelity approaches for optimization under uncertainty
- Convergence rates of the POD-greedy method
- Interpolatory projection methods for parameterized model reduction
- Accurate uncertainty quantification using inaccurate computational models
- An efficient surrogate-based method for computing rare failure probability
- Evaluation of failure probability via surrogate models
- Worst case scenario analysis for elliptic problems with uncertainty
- A new error bound for reduced basis approximation of parabolic partial differential equations
- Global convergence of radial basis function trust region derivative-free algorithms
- The hierarchical basis multigrid method
- Dynamic data-driven reduced-order models
- A fast Monte-Carlo method with a reduced basis of control variates applied to uncertainty propagation and Bayesian estimation
- Stochastic finite element methods for partial differential equations with random input data
- A multi level Monte Carlo method with control variate for elliptic PDEs with log-normal coefficients
- Likelihood-informed dimension reduction for nonlinear inverse problems
- Data-driven model reduction for the Bayesian solution of inverse problems
- A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow
- A space-time Petrov-Galerkin certified reduced basis method: application to the Boussinesq equations
- Exaflop/s: the why and the how
- Dimension-independent likelihood-informed MCMC
- Analysis and finite element approximation of a coupled, continuum pipe-flow/Darcy model for flow in porous media with embedded conduits
- Multifidelity importance sampling
- Online adaptive model reduction for nonlinear systems via low-rank updates
- Hierarchical bases give conjugate gradient type methods a multigrid speed of convergence
- Fast local reduced basis updates for the efficient reduction of nonlinear systems with hyper-reduction
- On control variate estimators
- Bayesian analysis of computer code outputs
- Optimal model management for multifidelity Monte Carlo estimation
- Title not available (Why is that?)
- A model and variance reduction method for computing statistical outputs of stochastic elliptic partial differential equations
- IMPROVING SIMULATION EFFICIENCY WITH QUASI CONTROL VARIATES
- A MATHEMATICAL AND COMPUTATIONAL FRAMEWORK FOR MULTIFIDELITY DESIGN AND ANALYSIS WITH COMPUTER MODELS
Cited In (only showing first 100 items - show all)
- Uncertainty quantification for the BGK model of the Boltzmann equation using multilevel variance reduced Monte Carlo methods
- A trust region method for noisy unconstrained optimization
- A bi-fidelity stochastic collocation method for transport equations with diffusive scaling and multi-dimensional random inputs
- A concurrent implementation of the surrogate management framework with application to cardiovascular shape optimization
- Multifidelity probability estimation via fusion of estimators
- Multifidelity approximate Bayesian computation with sequential Monte Carlo parameter sampling
- Novel rough set theory-based method for epistemic uncertainty modeling, analysis and applications
- Bi-fidelity reduced polynomial chaos expansion for uncertainty quantification
- Feasibility of DEIM for retrieving the initial field via dimensionality reduction
- The Random Feature Model for Input-Output Maps between Banach Spaces
- Bi-fidelity approximation for uncertainty quantification and sensitivity analysis of irradiated particle-laden turbulence
- Space-time multilevel Monte Carlo methods and their application to cardiac electrophysiology
- A multifidelity method for a nonlocal diffusion model
- Using deep learning to extend the range of air pollution monitoring and forecasting
- Mesoscale informed parameter estimation through machine learning: a case-study in fracture modeling
- Multifidelity modeling for physics-informed neural networks (PINNs)
- Coupling multi-fidelity Kriging and model-order reduction for the construction of virtual charts
- Multi-fidelity analysis and uncertainty quantification of beam vibration using co-kriging interpolation method
- Deep coregionalization for the emulation of simulation-based spatial-temporal fields
- Accelerated basis adaptation in homogeneous chaos spaces
- Mutual information for explainable deep learning of multiscale systems
- Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems
- Data-driven low-fidelity models for multi-fidelity Monte Carlo sampling in plasma micro-turbulence analysis
- Novel data-driven method for non-probabilistic uncertainty analysis of engineering structures based on ellipsoid model
- Fast predictive multi-fidelity prediction with models of quantized fidelity levels
- Stochastic multi-fidelity surrogate modeling of dendritic crystal growth
- Numerical linear algebra in data assimilation
- Learning Enabled Constrained Black-Box Optimization
- Data-driven forward discretizations for Bayesian inversion
- A massively parallel implementation of multilevel Monte Carlo for finite element models
- Multifidelity approximate Bayesian computation
- MFNets: data efficient all-at-once learning of multifidelity surrogates as directed networks of information sources
- Real-time reduced-order modeling of stochastic partial differential equations via time-dependent subspaces
- Evidence-theory-based uncertain parameter identification method for mechanical systems with imprecise information
- Multifidelity preconditioning of the cross-entropy method for rare event simulation and failure probability estimation
- Rare event simulation for large-scale structures with local nonlinearities
- Multilevel adaptive sparse Leja approximations for Bayesian inverse problems
- Adaptive reduced-order model construction for conditional value-at-risk estimation
- Multifidelity Monte Carlo Estimation with Adaptive Low-Fidelity Models
- A non-intrusive model order reduction approach for parameterized time-domain Maxwell's equations
- Variational inference for nonlinear inverse problems via neural net kernels: comparison to Bayesian neural networks, application to topology optimization
- A multifidelity ensemble Kalman filter with reduced order control variates
- An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
- Two-grid based adaptive proper orthogonal decomposition method for time dependent partial differential equations
- Efficient aerodynamic analysis and optimization under uncertainty using multi-fidelity polynomial chaos-Kriging surrogate model
- An intelligent multi-fidelity surrogate-assisted multi-objective reservoir production optimization method based on transfer stacking
- Registration-based model reduction of parameterized two-dimensional conservation laws
- Physics Guided Machine Learning for Variational Multiscale Reduced Order Modeling
- Multi-fidelity algorithms for the horizontal alignment problem in road design
- Taylor approximation and variance reduction for PDE-constrained optimal control under uncertainty
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Multi-fidelity uncertainty quantification method with application to nonlinear structural response analysis
- Multi-fidelity modeling framework for nonlinear unsteady aerodynamics of airfoils
- Multi-fidelity classification using Gaussian processes: accelerating the prediction of large-scale computational models
- Fast sampling of parameterised Gaussian random fields
- Randomized approaches to accelerate MCMC algorithms for Bayesian inverse problems
- Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling
- Goal-oriented adaptive modeling of random heterogeneous media and model-based multilevel Monte Carlo methods
- Multi-fidelity nonlinear unsteady aerodynamic modeling and uncertainty estimation based on hierarchical Kriging
- Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes
- Efficient prediction of turbulent flow quantities using a Bayesian hierarchical multifidelity model
- A transport-based multifidelity preconditioner for Markov chain Monte Carlo
- Model reduction in chemical process optimization
- Multi-fidelity surrogate-based optimal design of road vehicle suspension systems
- Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
- Resource-Constrained Model Selection for Uncertainty Propagation and Data Assimilation
- Nonhierarchical multi-model fusion using spatial random processes
- Projection-based model reduction: formulations for physics-based machine learning
- On multilevel best linear unbiased estimators
- A non-intrusive multifidelity method for the reduced order modeling of nonlinear problems
- Variable-fidelity modeling of structural analysis of assemblies
- Sampling Low-Dimensional Markovian Dynamics for Preasymptotically Recovering Reduced Models from Data with Operator Inference
- Residual Gaussian process: a tractable nonparametric Bayesian emulator for multi-fidelity simulations
- Multi-fidelity design optimisation strategy under uncertainty with limited computational budget
- Nonlinear reduced models for state and parameter estimation
- Multifidelity information fusion algorithms for high-dimensional systems and massive data sets
- Model reduction for transport-dominated problems via online adaptive bases and adaptive sampling
- A general frame for uncertainty propagation under multimodally distributed random variables
- The statistical finite element method (statFEM) for coherent synthesis of observation data and model predictions
- Non-intrusive reduced-order modeling of parameterized electromagnetic scattering problems using cubic spline interpolation
- A multi-level procedure for enhancing accuracy of machine learning algorithms
- Optimal reduced model algorithms for data-based state estimation
- Multifidelity Data Fusion via Gradient-Enhanced Gaussian Process Regression
- Uncertainty calibration for probabilistic projection methods
- Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution
- Stability of discrete empirical interpolation and gappy proper orthogonal decomposition with randomized and deterministic sampling points
- POD-based model order reduction with an adaptive snapshot selection for a discontinuous Galerkin approximation of the time-domain Maxwell's equations
- Multiobjective optimal control methods for the Navier-Stokes equations using reduced order modeling
- A generalized multi-fidelity simulation method using sparse polynomial chaos expansion
- Multifidelity approaches for optimization under uncertainty
- Conditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systems
- High-dimensional and higher-order multifidelity Monte Carlo estimators
- Parametric solutions of turbulent incompressible flows in OpenFOAM via the proper generalised decomposition
- Nonintrusive proper generalised decomposition for parametrised incompressible flow problems in OpenFOAM
- Optimal potential functions for the interacting particle system method
- Tensor-Based Numerical Method for Stochastic Homogenization
- Computational aspects of stochastic collocation with multifidelity models
- Bi-fidelity stochastic gradient descent for structural optimization under uncertainty
- Accelerating uncertainty quantification of groundwater flow modelling using a deep neural network proxy
- Data fusion for uncertainty quantification with non-intrusive polynomial chaos
Uses Software
This page was built for publication: Survey of multifidelity methods in uncertainty propagation, inference, and optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4580293)
