Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks
From MaRDI portal
Publication:2223019
Abstract: Stochastic partial differential equations (SPDEs) are ubiquitous in engineering and computational sciences. The stochasticity arises as a consequence of uncertainty in input parameters, constitutive relations, initial/boundary conditions, etc. Because of these functional uncertainties, the stochastic parameter space is often high-dimensional, requiring hundreds, or even thousands, of parameters to describe it. This poses an insurmountable challenge to response surface modeling since the number of forward model evaluations needed to construct an accurate surrogate grows exponentially with the dimension of the uncertain parameter space; a phenomenon referred to as the extit{curse of dimensionality}. State-of-the-art methods for high-dimensional uncertainty propagation seek to alleviate the curse of dimensionality by performing dimensionality reduction in the uncertain parameter space. However, one still needs to perform forward model evaluations that potentially carry a very high computational burden. We propose a novel methodology for high-dimensional uncertainty propagation of elliptic SPDEs which lifts the requirement for a deterministic forward solver. Our approach is as follows. We parameterize the solution of the elliptic SPDE using a deep residual network (ResNet). In a departure from the traditional squared residual (SR) based loss function for training the ResNet, we introduce a novel physics-informed loss function derived from variational principles. Specifically, our loss function is the expectation of the energy functional of the PDE over the stochastic variables. We demonstrate our solver-free approach through various examples where the elliptic SPDE is subjected to different types of high-dimensional input uncertainties. Also, we solve high-dimensional uncertainty propagation and inverse problems.
Recommendations
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
- Solving parametric PDE problems with artificial neural networks
- Exploring the locally low dimensional structure in solving random elliptic PDEs
- Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks
Cites work
- scientific article; zbMATH DE number 1243473 (Why is no real title available?)
- scientific article; zbMATH DE number 1304256 (Why is no real title available?)
- scientific article; zbMATH DE number 1529823 (Why is no real title available?)
- scientific article; zbMATH DE number 2208228 (Why is no real title available?)
- Accelerating Markov chain Monte Carlo with active subspaces
- Active subspace methods in theory and practice: applications to kriging surfaces
- Bayesian deep convolutional encoder-decoder networks for surrogate modeling and uncertainty quantification
- Computational partial differential equations. Numerical methods and Diffpack programming
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Deep learning
- Exploiting active subspaces to quantify uncertainty in the numerical simulation of the hyshot II scramjet
- Gaussian processes with built-in dimensionality reduction: applications to high-dimensional uncertainty propagation
- Introduction to uncertainty quantification
- Inverse Problem Theory and Methods for Model Parameter Estimation
- Kernel principal component analysis for stochastic input model generation
- Langevin diffusions and the Metropolis-adjusted Langevin algorithm
- Large-scale machine learning with stochastic gradient descent
- Modern Monte Carlo variants for uncertainty quantification in neutron transport
- Multi-output local Gaussian process regression: applications to uncertainty quantification
- Multi-output separable Gaussian process: towards an efficient, fully Bayesian paradigm for uncertainty quantification
- Multilayer feedforward networks are universal approximators
- Multilevel Monte Carlo methods and applications to elliptic PDEs with random coefficients
- On the convergence of generalized polynomial chaos expansions
- Optimal Scaling of Discrete Approximations to Langevin Diffusions
- Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data
- Quasi-Monte Carlo finite element methods for a class of elliptic partial differential equations with random coefficients
- The Wiener--Askey Polynomial Chaos for Stochastic Differential Equations
- The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems
- Uncertainty Quantification and Polynomial Chaos Techniques in Computational Fluid Dynamics
- Uncertainty propagation using infinite mixture of gaussian processes and variational Bayesian inference
Cited in
(46)- Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data
- Bayesian model and dimension reduction for uncertainty propagation: applications in random media
- CEENs: causality-enforced evolutional networks for solving time-dependent partial differential equations
- Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons
- Learning to solve Bayesian inverse problems: an amortized variational inference approach using Gaussian and flow guides
- A Variational Neural Network Approach for Glacier Modelling with Nonlinear Rheology
- Fractional Chebyshev deep neural network (FCDNN) for solving differential models
- AMS-Net: Adaptive Multiscale Sparse Neural Network with Interpretable Basis Expansion for Multiphase Flow Problems
- Physics-informed information field theory for modeling physical systems with uncertainty quantification
- PI-VEGAN: Physics Informed Variational Embedding Generative Adversarial Networks for Stochastic Differential Equations
- Multifidelity deep operator networks for data-driven and physics-informed problems
- Physics-informed variational inference for uncertainty quantification of stochastic differential equations
- GINNs: graph-informed neural networks for multiscale physics
- A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables
- A derivative-free method for solving elliptic partial differential equations with deep neural networks
- Bayesian Deep Learning Framework for Uncertainty Quantification in Stochastic Partial Differential Equations
- An overview on deep learning-based approximation methods for partial differential equations
- Level Set Learning with Pseudoreversible Neural Networks for Nonlinear Dimension Reduction in Function Approximation
- Energy-informed graph transformer model for solid mechanical analyses
- Efficient uncertainty quantification for dynamic subsurface flow with surrogate by theory-guided neural network
- Pre-training strategy for solving evolution equations based on physics-informed neural networks
- Weak form theory-guided neural network (TgNN-wf) for deep learning of subsurface single- and two-phase flow
- A neural network multigrid solver for the Navier-Stokes equations
- Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
- The deep learning Galerkin method for the general Stokes equations
- A hybrid data-driven-physics-constrained Gaussian process regression framework with deep kernel for uncertainty quantification
- Solving elliptic equations with Brownian motion: bias reduction and temporal difference learning
- DeepParticle: learning invariant measure by a deep neural network minimizing Wasserstein distance on data generated from an interacting particle method
- Error estimates and physics informed augmentation of neural networks for thermally coupled incompressible Navier Stokes equations
- The novel graph transformer-based surrogate model for learning physical systems
- Artificial neural networks for solving elliptic differential equations with boundary layer
- Wavelet neural operator for solving parametric partial differential equations in computational mechanics problems
- Stochastic projection based approach for gradient free physics informed learning
- Solving Kolmogorov PDEs without the curse of dimensionality via deep learning and asymptotic expansion with Malliavin calculus
- A novel sequential method to train physics informed neural networks for Allen Cahn and Cahn Hilliard equations
- WAN discretization of PDEs: best approximation, stabilization, and essential boundary conditions
- Solution of time‐fractional stochastic nonlinear sine‐Gordon equation via finite difference and meshfree techniques
- Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks
- On the eigenvector bias of Fourier feature networks: from regression to solving multi-scale PDEs with physics-informed neural networks
- A Chebyshev Polynomial Neural Network Solver for Boundary Value Problems of Elliptic Equations
- Data-driven modeling of partially observed biological systems
- Gradient auxiliary physics-informed neural network for nonlinear biharmonic equation
- Extended dynamic mode decomposition for inhomogeneous problems
- PhyGeoNet: physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain
- Physics informed WNO
- Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
Describes a project that uses
Uses Software
This page was built for publication: Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2223019)
