Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
From MaRDI portal
Publication:2002273
Abstract: State-of-the-art computer codes for simulating real physical systems are often characterized by a vast number of input parameters. Performing uncertainty quantification (UQ) tasks with Monte Carlo (MC) methods is almost always infeasible because of the need to perform hundreds of thousands or even millions of forward model evaluations in order to obtain convergent statistics. One, thus, tries to construct a cheap-to-evaluate surrogate model to replace the forward model solver. For systems with large numbers of input parameters, one has to deal with the curse of dimensionality - the exponential increase in the volume of the input space, as the number of parameters increases linearly. In this work, we demonstrate the use of deep neural networks (DNN) to construct surrogate models for numerical simulators. We parameterize the structure of the DNN in a manner that lends the DNN surrogate the interpretation of recovering a low dimensional nonlinear manifold. The model response is a parameterized nonlinear function of the low dimensional projections of the input. We think of this low dimensional manifold as a nonlinear generalization of the notion of the active subspace. Our approach is demonstrated with a problem on uncertainty propagation in a stochastic elliptic partial differential equation (SPDE) with uncertain diffusion coefficient. We deviate from traditional formulations of the SPDE problem by not imposing a specific covariance structure on the random diffusion coefficient. Instead, we attempt to solve a more challenging problem of learning a map between an arbitrary snapshot of the diffusion field and the response.
Recommendations
- Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification
- Deep neural network surrogates for nonsmooth quantities of interest in shape uncertainty quantification
- Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data
- Deep learning in high dimension: neural network expression rates for generalized polynomial chaos expansions in UQ
- An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
Cites work
- scientific article; zbMATH DE number 6378127 (Why is no real title available?)
- scientific article; zbMATH DE number 1191619 (Why is no real title available?)
- scientific article; zbMATH DE number 1304256 (Why is no real title available?)
- scientific article; zbMATH DE number 2117879 (Why is no real title available?)
- Active subspace methods in theory and practice: applications to kriging surfaces
- Adaptive subgradient methods for online learning and stochastic optimization
- AlexNet
- Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification
- Deep learning
- Discovering an active subspace in a single‐diode solar cell model
- Exploiting active subspaces to quantify uncertainty in the numerical simulation of the hyshot II scramjet
- Gaussian processes for machine learning.
- Gaussian processes with built-in dimensionality reduction: applications to high-dimensional uncertainty propagation
- Introduction to uncertainty quantification
- Inverse regression-based uncertainty quantification algorithms for high-dimensional models: theory and practice
- Kernel principal component analysis for stochastic input model generation
- Large-scale machine learning with stochastic gradient descent
- Modeling uncertainty in flow simulations via generalized polynomial chaos.
- Modeling uncertainty in steady state diffusion problems via generalized polynomial chaos
- Monte Carlo analysis of inverse problems
- Monte Carlo strategies in scientific computing.
- Multi-output local Gaussian process regression: applications to uncertainty quantification
- Multi-output separable Gaussian process: towards an efficient, fully Bayesian paradigm for uncertainty quantification
- Multidimensional adaptive relevance vector machines for uncertainty quantification
- Multilayer feedforward networks are universal approximators
- Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling
- Nonlinear methods of spectral analysis. 2nd corrected and updated edition
- Predicting the output from a complex computer code when fast approximations are available
- Principal component analysis.
- Regularization and Variable Selection Via the Elastic Net
- Survey of multifidelity methods in uncertainty propagation, inference, and optimization
- The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
- Uncertainty Quantification and Polynomial Chaos Techniques in Computational Fluid Dynamics
- Uncertainty propagation using infinite mixture of gaussian processes and variational Bayesian inference
Cited in
(only showing first 100 items - show all)- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Stochastic modeling of inhomogeneities in the aortic wall and uncertainty quantification using a Bayesian encoder-decoder surrogate
- Deep learning of vortex-induced vibrations
- GINNs: graph-informed neural networks for multiscale physics
- Train Like a (Var)Pro: Efficient Training of Neural Networks with Variable Projection
- Machine learning for flux regression in discrete fracture networks
- On generalized residual network for deep learning of unknown dynamical systems
- A sample-efficient deep learning method for multivariate uncertainty qualification of acoustic-vibration interaction problems
- Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks
- Numerical weighted integration of functions having mixed smoothness
- Estimation of an improved surrogate model in uncertainty quantification by neural networks
- Deep ReLU neural network approximation in Bochner spaces and applications to parametric PDEs
- A higher-order singular value decomposition tensor emulator for spatiotemporal simulators
- An adaptive surrogate modeling based on deep neural networks for large-scale Bayesian inverse problems
- Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification
- Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data
- Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data
- Deep learning observables in computational fluid dynamics
- Data driven governing equations approximation using deep neural networks
- An Acceleration Strategy for Randomize-Then-Optimize Sampling Via Deep Neural Networks
- Data-driven solutions and parameter discovery of the Sasa-Satsuma equation via the physics-informed neural networks method
- Learning constitutive relations from indirect observations using deep neural networks
- Active learning Bayesian support vector regression model for global approximation
- Dimensionality reduction for complex models via Bayesian compressive sensing
- Data-driven deep learning of partial differential equations in modal space
- Multifidelity multilevel Monte Carlo to accelerate approximate Bayesian parameter inference for partially observed stochastic processes
- Scalable uncertainty quantification for deep operator networks using randomized priors
- Enforcing imprecise constraints on generative adversarial networks for emulating physical systems
- Variational inference with NoFAS: normalizing flow with adaptive surrogate for computationally expensive models
- Learning nonlocal constitutive models with neural networks
- LaSDI: parametric latent space dynamics identification
- Simulation of the 3D hyperelastic behavior of ventricular myocardium using a finite-element based neural-network approach
- Mutual information for explainable deep learning of multiscale systems
- Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons
- Parametric dynamic mode decomposition for reduced order modeling
- PPINN: parareal physics-informed neural network for time-dependent PDEs
- Efficient uncertainty quantification for dynamic subsurface flow with surrogate by theory-guided neural network
- Understanding and Mitigating Gradient Flow Pathologies in Physics-Informed Neural Networks
- Physics-informed machine learning models for predicting the progress of reactive-mixing
- ConvPDE-UQ: convolutional neural networks with quantified uncertainty for heterogeneous elliptic partial differential equations on varied domains
- Error estimates and physics informed augmentation of neural networks for thermally coupled incompressible Navier Stokes equations
- Bayesian neural networks for uncertainty quantification in data-driven materials modeling
- scientific article; zbMATH DE number 7326170 (Why is no real title available?)
- Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
- A bi-fidelity surrogate modeling approach for uncertainty propagation in three-dimensional hemodynamic simulations
- Deep learning of free boundary and Stefan problems
- Deep learning in high dimension: neural network expression rates for generalized polynomial chaos expansions in UQ
- A Bayesian multiscale deep learning framework for flows in random media
- A novel sequential method to train physics informed neural networks for Allen Cahn and Cahn Hilliard equations
- Bayesian model and dimension reduction for uncertainty propagation: applications in random media
- Extended dynamic mode decomposition for inhomogeneous problems
- Image inversion and uncertainty quantification for constitutive laws of pattern formation
- Solving inverse problems using conditional invertible neural networks
- Numerical solution of the parametric diffusion equation by deep neural networks
- A deep learning driven pseudospectral PCE based FFT homogenization algorithm for complex microstructures
- The Random Feature Model for Input-Output Maps between Banach Spaces
- Bayesian learning of orthogonal embeddings for multi-fidelity Gaussian processes
- Emulation of CPU-demanding reactive transport models: a comparison of Gaussian processes, polynomial chaos expansion, and deep neural networks
- Probabilistic deep learning for real-time large deformation simulations
- Conditional deep surrogate models for stochastic, high-dimensional, and multi-fidelity systems
- Structured Bayesian Gaussian process latent variable model: applications to data-driven dimensionality reduction and high-dimensional inversion
- A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems
- A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the small data regime
- Coercing machine learning to output physically accurate results
- Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks
- Solving the discretised neutron diffusion equations using neural networks
- scientific article; zbMATH DE number 6975079 (Why is no real title available?)
- Collocation approximation by deep neural ReLU networks for parametric and stochastic PDEs with lognormal inputs
- Quality measures for the evaluation of machine learning architectures on the quantification of epistemic and aleatoric uncertainties in complex dynamical systems
- ReLU neural network Galerkin BEM
- Surrogate modeling for Bayesian inverse problems based on physics-informed neural networks
- A framework for strategic discovery of credible neural network surrogate models under uncertainty
- Probabilistic partition of unity networks for high‐dimensional regression problems
- Deep learning of biological models from data: applications to ODE models
- On the influence of over-parameterization in manifold based surrogates and deep neural operators
- Multi-Fidelity Uncertainty Propagation Approach for Multi-Dimensional Correlated Flow Field Responses
- Bi-fidelity variational auto-encoder for uncertainty quantification
- Operator learning using random features: a tool for scientific computing
- Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty
- Deep capsule encoder–decoder network for surrogate modeling and uncertainty quantification
- Stein variational gradient descent with local approximations
- Deep weighted Monte Carlo: a hybrid option pricing framework using neural networks
- Scalable conditional deep inverse Rosenblatt transports using tensor trains and gradient-based dimension reduction
- Active subspace of neural networks: structural analysis and universal attacks
- A Model-Constrained Tangent Slope Learning Approach for Dynamical Systems
- VI-DGP: a variational inference method with deep generative prior for solving high-dimensional inverse problems
- Sparse-grid sampling recovery and numerical integration of functions having mixed smoothness
- Random field of homogeneous and multi-material structures by the smoothed finite element method and Karhunen-Loève expansion
- Transformers for modeling physical systems
- Data-driven modeling of partially observed biological systems
- Level Set Learning with Pseudoreversible Neural Networks for Nonlinear Dimension Reduction in Function Approximation
- Dual order-reduced Gaussian process emulators (DORGP) for quantifying high-dimensional uncertain crack growth using limited and noisy data
- Functional PCA and deep neural networks-based Bayesian inverse uncertainty quantification with transient experimental data
- Quantification on the generalization performance of deep neural network with Tychonoff separation axioms
- Polynomial chaos expansions on principal geodesic Grassmannian submanifolds for surrogate modeling and uncertainty quantification
- A statistician teaches deep learning
- Neural and spectral operator surrogates: unified construction and expression rate bounds
- Bayesian neural networks for predicting uncertainty in full-field material response
- A review of recent advances in surrogate models for uncertainty quantification of high-dimensional engineering applications
- Uncertainty quantification for noisy inputs-outputs in physics-informed neural networks and neural operators
Describes a project that uses
Uses Software
This page was built for publication: Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2002273)
