Survey of multifidelity methods in uncertainty propagation, inference, and optimization
From MaRDI portal
Publication:4580293
Abstract: In many situations across computational science and engineering, multiple computational models are available that describe a system of interest. These different models have varying evaluation costs and varying fidelities. Typically, a computationally expensive high-fidelity model describes the system with the accuracy required by the current application at hand, while lower-fidelity models are less accurate but computationally cheaper than the high-fidelity model. Outer-loop applications, such as optimization, inference, and uncertainty quantification, require multiple model evaluations at many different inputs, which often leads to computational demands that exceed available resources if only the high-fidelity model is used. This work surveys multifidelity methods that accelerate the solution of outer-loop applications by combining high-fidelity and low-fidelity model evaluations, where the low-fidelity evaluations arise from an explicit low-fidelity model (e.g., a simplified physics approximation, a reduced model, a data-fit surrogate, etc.) that approximates the same output quantity as the high-fidelity model. The overall premise of these multifidelity methods is that low-fidelity models are leveraged for speedup while the high-fidelity model is kept in the loop to establish accuracy and/or convergence guarantees. We categorize multifidelity methods according to three classes of strategies: adaptation, fusion, and filtering. The paper reviews multifidelity methods in the outer-loop contexts of uncertainty propagation, inference, and optimization.
Recommendations
- Multifidelity approaches for optimization under uncertainty
- Optimal model management for multifidelity Monte Carlo estimation
- Budget-limited distribution learning in multifidelity problems
- Context-Aware Surrogate Modeling for Balancing Approximation and Sampling Costs in Multifidelity Importance Sampling and Bayesian Inverse Problems
- Multifidelity Monte Carlo Estimation with Adaptive Low-Fidelity Models
Cites work
- scientific article; zbMATH DE number 3815002 (Why is no real title available?)
- scientific article; zbMATH DE number 3958638 (Why is no real title available?)
- scientific article; zbMATH DE number 46855 (Why is no real title available?)
- scientific article; zbMATH DE number 3503002 (Why is no real title available?)
- scientific article; zbMATH DE number 3597760 (Why is no real title available?)
- scientific article; zbMATH DE number 1332320 (Why is no real title available?)
- scientific article; zbMATH DE number 2000348 (Why is no real title available?)
- scientific article; zbMATH DE number 2065597 (Why is no real title available?)
- scientific article; zbMATH DE number 1561761 (Why is no real title available?)
- scientific article; zbMATH DE number 2143187 (Why is no real title available?)
- scientific article; zbMATH DE number 4001209 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- scientific article; zbMATH DE number 840151 (Why is no real title available?)
- scientific article; zbMATH DE number 5060482 (Why is no real title available?)
- scientific article; zbMATH DE number 3388490 (Why is no real title available?)
- scientific article; zbMATH DE number 2222860 (Why is no real title available?)
- scientific article; zbMATH DE number 3196612 (Why is no real title available?)
- $\mathcal{H}_2$ Model Reduction for Large-Scale Linear Dynamical Systems
- A Bayesian approach to characterizing uncertainty in inverse problems using coarse and fine-scale information
- A Class of Methods for Solving Nonlinear Simultaneous Equations
- A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow
- A MATHEMATICAL AND COMPUTATIONAL FRAMEWORK FOR MULTIFIDELITY DESIGN AND ANALYSIS WITH COMPUTER MODELS
- A Multigrid Tutorial, Second Edition
- A New Algorithm for Unconstrained Optimization
- A New Look at Proper Orthogonal Decomposition
- A Rapidly Convergent Descent Method for Minimization
- A Sparse Grid Stochastic Collocation Method for Partial Differential Equations with Random Input Data
- A Stochastic Collocation Method for Elliptic Partial Differential Equations with Random Input Data
- A Survey of Model Reduction by Balanced Truncation and Some New Results
- A fast Monte-Carlo method with a reduced basis of control variates applied to uncertainty propagation and Bayesian estimation
- A method for the solution of certain non-linear problems in least squares
- A model and variance reduction method for computing statistical outputs of stochastic elliptic partial differential equations
- A multi level Monte Carlo method with control variate for elliptic PDEs with log-normal coefficients
- A multilevel stochastic collocation method for partial differential equations with random input data
- A new error bound for reduced basis approximation of parabolic partial differential equations
- A space-time Petrov-Galerkin certified reduced basis method: application to the Boussinesq equations
- A stochastic Newton MCMC method for large-scale statistical inverse problems with application to seismic inversion
- A stochastic collocation algorithm with multifidelity models
- A successive constraint linear optimization method for lower bounds of parametric coercivity and inf-sup stability constants
- A survey of projection-based model reduction methods for parametric dynamical systems
- A taxonomy of global optimization methods based on response surfaces
- A variance reduction method for parametrized stochastic differential equations using the reduced basis paradigm
- Accelerating optimization of parametric linear systems by model order reduction
- Accurate and efficient evaluation of failure probability for partial different equations with random input data
- Accurate uncertainty quantification using inaccurate computational models
- Adaptive Markov Chain Monte Carlo through Regeneration
- Adaptive \(h\)-refinement for reduced-order models
- An Algorithm for Least-Squares Estimation of Nonlinear Parameters
- An adaptive Metropolis algorithm
- An approximation error approach for compensating for modelling errors between the radiative transfer equation and the diffusion approximation in diffuse optical tomography
- An efficient surrogate-based method for computing rare failure probability
- Analysis and finite element approximation of a coupled, continuum pipe-flow/Darcy model for flow in porous media with embedded conduits
- Anderson acceleration for fixed-point iterations
- Approximation error analysis in nonlinear state estimation with an application to state-space identification
- Approximation errors and model reduction with an application in optical diffusion tomography
- Approximation errors and truncation of computational domains with application to geophysical tomography
- Approximation errors in nonstationary inverse problems
- Approximation of Large-Scale Dynamical Systems
- Asymptotic waveform evaluation via a Lanczos method
- Bayesian analysis of computer code outputs
- Bayesian calibration of computer models. (With discussion)
- Bayesian treed Gaussian process models with an application to computer modeling
- Centroidal Voronoi Tessellations: Applications and Algorithms
- Certified real‐time solution of the parametrized steady incompressible Navier–Stokes equations: rigorous reduced‐basis a posteriori error bounds
- Combining Field Data and Computer Simulations for Calibration and Prediction
- Combining Probability Distributions from Dependent Information Sources
- Constrained multifidelity optimization using model calibration
- Convergence analysis for Anderson acceleration
- Convergence rates of the POD-greedy method
- Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms
- Data-driven model reduction for the Bayesian solution of inverse problems
- Delayed rejection in reversible jump Metropolis-Hastings.
- Design and analysis of computer experiments. With comments and a rejoinder by the authors
- Dimension-independent likelihood-informed MCMC
- Dimensionality reduction and polynomial chaos acceleration of Bayesian inference in inverse problems
- Dynamic data-driven reduced-order models
- Dynamic mode decomposition with control
- Efficient global optimization of expensive black-box functions
- Efficient reduced-basis treatment of nonaffine and nonlinear partial differential equations
- Error estimates for abstract linear-quadratic optimal control problems using proper orthogonal decomposition
- Evaluation of failure probability via surrogate models
- Exaflop/s: the why and the how
- Fast local reduced basis updates for the efficient reduction of nonlinear systems with hyper-reduction
- Finite Element Approximations for Stokes–Darcy Flow with Beavers–Joseph Interface Conditions
- Further analysis of multilevel Monte Carlo methods for elliptic PDEs with random coefficients
- GMRES: A Generalized Minimal Residual Algorithm for Solving Nonsymmetric Linear Systems
- Galerkin Proper Orthogonal Decomposition Methods for a General Equation in Fluid Dynamics
- Galerkin proper orthogonal decomposition methods for parabolic problems
- Gaussian processes for machine learning.
- Global convergence of general derivative-free trust-region algorithms to first- and second-order critical points
- Global convergence of radial basis function trust region derivative-free algorithms
- Hierarchical bases give conjugate gradient type methods a multigrid speed of convergence
- IMPROVING SIMULATION EFFICIENCY WITH QUASI CONTROL VARIATES
- Interpolatory projection methods for parameterized model reduction
- Introduction to Derivative-Free Optimization
- Inverse problems: a Bayesian perspective
- Iterative Procedures for Nonlinear Integral Equations
- Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems
- Likelihood-informed dimension reduction for nonlinear inverse problems
- MCMC methods for functions: modifying old algorithms to make them faster
- Model Selection and Multimodel Inference
- Model reduction methods based on Krylov subspaces
- Monte Carlo strategies in scientific computing.
- Multi-Level Adaptive Solutions to Boundary-Value Problems
- Multi-fidelity optimization via surrogate modelling
- Multi-index Monte Carlo: when sparsity meets sampling
- Multifidelity approaches for optimization under uncertainty
- Multifidelity importance sampling
- Multilevel Monte Carlo Path Simulation
- Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients
- Multilevel preconditioning
- Nonlinear model reduction via discrete empirical interpolation
- On Metropolis-Hastings algorithms with delayed rejection
- On control variate estimators
- On dynamic mode decomposition: theory and applications
- On the Convergence of Pattern Search Algorithms
- On the stability of the reduced basis method for Stokes equations in parametrized domains
- Online adaptive model reduction for nonlinear systems via low-rank updates
- Optimal control of the cylinder wake in the laminar regime by trust-region methods and POD reduced-order models
- Optimal model management for multifidelity Monte Carlo estimation
- POD and CVT-based reduced-order modeling of Navier-Stokes flows
- Parallel Multilevel Preconditioners
- Pattern recognition and machine learning.
- Preconditioning Markov Chain Monte Carlo Simulations Using Coarse-Scale Models
- Predicting the output from a complex computer code when fast approximations are available
- Principal component analysis in linear systems: Controllability, observability, and model reduction
- Progressive construction of a parametric reduced-order model for PDE-constrained optimization
- RECONSTRUCTION OF DOMAIN BOUNDARY AND CONDUCTIVITY IN ELECTRICAL IMPEDANCE TOMOGRAPHY USING THE APPROXIMATION ERROR APPROACH
- Reduced basis approximation and a posteriori error estimation for Stokes flows in parametrized geometries: roles of the inf-sup stability constants
- Reduced basis approximation and a posteriori error estimation for affinely parametrized elliptic coercive partial differential equations. Application to transport and continuum mechanics.
- Reduced basis method for finite volume approximations of parametrized linear evolution equations
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Sparse grids
- Statistical and computational inverse problems.
- Statistical inverse problems: discretization, model reduction and inverse crimes
- Stochastic finite element methods for partial differential equations with random input data
- Support-vector networks
- Synthesis of minimum roundoff noise fixed point digital filters
- Ten Lectures on Wavelets
- The hierarchical basis multigrid method
- The principle of minimized iterations in the solution of the matrix eigenvalue problem
- Trust Region Methods
- Turbulence and the dynamics of coherent structures. I. Coherent structures
- Variable Metric Method for Minimization
- Weak convergence and optimal scaling of random walk Metropolis algorithms
- Worst case scenario analysis for elliptic problems with uncertainty
- `` Direct Search Solution of Numerical and Statistical Problems
Cited in
(only showing first 100 items - show all)- Taylor approximation and variance reduction for PDE-constrained optimal control under uncertainty
- Multi-fidelity algorithms for the horizontal alignment problem in road design
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Multi-fidelity uncertainty quantification method with application to nonlinear structural response analysis
- Multi-fidelity modeling framework for nonlinear unsteady aerodynamics of airfoils
- Multifidelity Bayesian Experimental Design to Quantify Rare-Event Statistics
- Stacking Designs: Designing Multifidelity Computer Experiments with Target Predictive Accuracy
- Constrained Optimization in the Presence of Noise
- A new bi-fidelity model reduction method for Bayesian inverse problems
- Multi-fidelity parametric sensitivity estimation for large eddy simulation with the Spalart–Allmaras model
- Generalized information reuse for optimization under uncertainty with non-sample average estimators
- Fast sampling of parameterised Gaussian random fields
- Uncertainty quantification for the BGK model of the Boltzmann equation using multilevel variance reduced Monte Carlo methods
- Multi-fidelity classification using Gaussian processes: accelerating the prediction of large-scale computational models
- Randomized approaches to accelerate MCMC algorithms for Bayesian inverse problems
- On global normal linear approximations for nonlinear Bayesian inverse problems
- A concurrent implementation of the surrogate management framework with application to cardiovascular shape optimization
- Multifidelity probability estimation via fusion of estimators
- A bi-fidelity stochastic collocation method for transport equations with diffusive scaling and multi-dimensional random inputs
- Multilevel control variates for uncertainty quantification in simulations of cloud cavitation
- Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling
- Goal-oriented adaptive modeling of random heterogeneous media and model-based multilevel Monte Carlo methods
- Forward sensitivity analysis and mode dependent control for closure modeling of Galerkin systems
- Operator inference with roll outs for learning reduced models from scarce and low-quality data
- A trust region method for noisy unconstrained optimization
- Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes
- Multifidelity approximate Bayesian computation with sequential Monte Carlo parameter sampling
- Data driven adaptive Gaussian mixture model for solving Fokker-Planck equation
- A transport-based multifidelity preconditioner for Markov chain Monte Carlo
- Multi-fidelity nonlinear unsteady aerodynamic modeling and uncertainty estimation based on hierarchical Kriging
- Efficient prediction of turbulent flow quantities using a Bayesian hierarchical multifidelity model
- Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
- Novel rough set theory-based method for epistemic uncertainty modeling, analysis and applications
- Model reduction in chemical process optimization
- Multi-fidelity surrogate-based optimal design of road vehicle suspension systems
- Multi-model communication and data assimilation for mitigating model error and improving forecasts
- Resource-Constrained Model Selection for Uncertainty Propagation and Data Assimilation
- Nonhierarchical multi-model fusion using spatial random processes
- Ensemble approximate control variate estimators: applications to multifidelity importance sampling
- Projection-based model reduction: formulations for physics-based machine learning
- Bi-fidelity reduced polynomial chaos expansion for uncertainty quantification
- Feasibility of DEIM for retrieving the initial field via dimensionality reduction
- Multi-fidelity analysis and uncertainty quantification of beam vibration using correction response surfaces
- Co-kriging based multi-fidelity uncertainty quantification of beam vibration using coarse and fine finite element meshes
- Multi-fidelity response surfaces for uncertainty quantification in beams using coarse and fine finite element discretizations
- On multilevel best linear unbiased estimators
- A non-intrusive multifidelity method for the reduced order modeling of nonlinear problems
- Residual-based error correction for neural operator accelerated Infinite-dimensional Bayesian inverse problems
- Online MCMC Thinning with Kernelized Stein Discrepancy
- Neural-physics multi-fidelity model with active learning and uncertainty quantification for GPU-enabled microfluidic concentration gradient generator design
- Variable-fidelity modeling of structural analysis of assemblies
- The Random Feature Model for Input-Output Maps between Banach Spaces
- Bi-fidelity approximation for uncertainty quantification and sensitivity analysis of irradiated particle-laden turbulence
- Multilevel Fine-Tuning: Closing Generalization Gaps in Approximation of Solution Maps under a Limited Budget for Training Data
- Bayesian deep operator learning for homogenized to fine-scale maps for multiscale PDE
- Sampling Low-Dimensional Markovian Dynamics for Preasymptotically Recovering Reduced Models from Data with Operator Inference
- A domain decomposition model reduction method for linear convection-diffusion equations with random coefficients
- Space-time multilevel Monte Carlo methods and their application to cardiac electrophysiology
- Using deep learning to extend the range of air pollution monitoring and forecasting
- Mesoscale informed parameter estimation through machine learning: a case-study in fracture modeling
- A multifidelity method for a nonlocal diffusion model
- Discussion of: ``Signature-based models of preventive maintenance
- Operator learning using random features: a tool for scientific computing
- Multifidelity modeling for physics-informed neural networks (PINNs)
- Residual Gaussian process: a tractable nonparametric Bayesian emulator for multi-fidelity simulations
- Coupling multi-fidelity Kriging and model-order reduction for the construction of virtual charts
- A combination technique for optimal control problems constrained by random PDEs
- Multi-fidelity design optimisation strategy under uncertainty with limited computational budget
- Deep coregionalization for the emulation of simulation-based spatial-temporal fields
- Multi-fidelity analysis and uncertainty quantification of beam vibration using co-kriging interpolation method
- Data-informed uncertainty quantification for laser-based powder bed fusion additive manufacturing
- A general frame for uncertainty propagation under multimodally distributed random variables
- Nonlinear reduced models for state and parameter estimation
- Multifidelity information fusion algorithms for high-dimensional systems and massive data sets
- Model reduction for transport-dominated problems via online adaptive bases and adaptive sampling
- Mutual information for explainable deep learning of multiscale systems
- Bayesian multiscale deep generative model for the solution of high-dimensional inverse problems
- Data-driven low-fidelity models for multi-fidelity Monte Carlo sampling in plasma micro-turbulence analysis
- Accelerated basis adaptation in homogeneous chaos spaces
- Novel data-driven method for non-probabilistic uncertainty analysis of engineering structures based on ellipsoid model
- The statistical finite element method (statFEM) for coherent synthesis of observation data and model predictions
- Non-intrusive reduced-order modeling of parameterized electromagnetic scattering problems using cubic spline interpolation
- Neural Networks with Local Converging Inputs (NNLCI) for Solving Conservation Laws, Part I: 1D Problems
- A multi-level procedure for enhancing accuracy of machine learning algorithms
- A randomized multi-index sequential Monte Carlo method
- Optimal reduced model algorithms for data-based state estimation
- Fast predictive multi-fidelity prediction with models of quantized fidelity levels
- Stochastic multi-fidelity surrogate modeling of dendritic crystal growth
- Uncertainty calibration for probabilistic projection methods
- Multifidelity Data Fusion via Gradient-Enhanced Gaussian Process Regression
- Objective Bayesian Analysis of a Cokriging Model for Hierarchical Multifidelity Codes
- POD-based model order reduction with an adaptive snapshot selection for a discontinuous Galerkin approximation of the time-domain Maxwell's equations
- Multiobjective optimal control methods for the Navier-Stokes equations using reduced order modeling
- Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution
- Stability of discrete empirical interpolation and gappy proper orthogonal decomposition with randomized and deterministic sampling points
- A generalized multi-fidelity simulation method using sparse polynomial chaos expansion
- Multifidelity approaches for optimization under uncertainty
- Mitigating Model Error via a Multimodel Method and Application to Tropical Intraseasonal Oscillations
- Conditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systems
- A study of multiscale kinetic models with uncertainties
This page was built for publication: Survey of multifidelity methods in uncertainty propagation, inference, and optimization
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4580293)
