Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data

DOI10.1016/j.jcp.2019.05.024zbMath1452.68172arXiv1901.06314OpenAlexW2908541468WikidataQ127843943 ScholiaQ127843943MaRDI QIDQ2222275

Phaedon-Stelios Koutsourelakis, Yinhao Zhu, Paris Perdikaris, Nicholas Zabaras

Publication date: 26 January 2021

Published in: Journal of Computational Physics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1901.06314

zbMATH Keywords

uncertainty quantification surrogate modeling normalizing flow conditional generative model physics-constrained reverse Kullback-Leibler divergence

Mathematics Subject Classification ID

Probabilistic methods, particle methods, etc. for boundary value problems involving PDEs (65N75) Artificial neural networks and deep learning (68T07) Flows in porous media; filtration; seepage (76S05) Dependence of solutions to PDEs on initial and/or boundary data and/or on parameters of PDEs (35B30)

Related Items (only showing first 100 items - show all)

DRIPS: a framework for dimension reduction and interpolation in parameter space ⋮ Implicit integration of nonlinear evolution equations on tensor manifolds ⋮ VI-DGP: a variational inference method with deep generative prior for solving high-dimensional inverse problems ⋮ PhySR: physics-informed deep super-resolution for spatiotemporal data ⋮ Deep Surrogate Accelerated Delayed-Acceptance Hamiltonian Monte Carlo for Bayesian Inference of Spatio-Temporal Heat Fluxes in Rotating Disc Systems ⋮ Probabilistic partition of unity networks for high‐dimensional regression problems ⋮ Three ways to solve partial differential equations with neural networks — A review ⋮ Hybrid analysis and modeling, eclecticism, and multifidelity computing toward digital twin revolution ⋮ Machine learning for material characterization with an application for predicting mechanical properties ⋮ Deep capsule encoder–decoder network for surrogate modeling and uncertainty quantification ⋮ Adaptive deep density approximation for fractional Fokker-Planck equations ⋮ On the use of graph neural networks and shape‐function‐based gradient computation in the deep energy method ⋮ Fully probabilistic deep models for forward and inverse problems in parametric PDEs ⋮ On the use of neural networks for full waveform inversion ⋮ Data-driven vortex solitons and parameter discovery of 2D generalized nonlinear Schrödinger equations with a \(\mathcal{PT}\)-symmetric optical lattice ⋮ Finite element interpolated neural networks for solving forward and inverse problems ⋮ Physics informed WNO ⋮ An extreme learning machine-based method for computational PDEs in higher dimensions ⋮ Physics-based self-learning spiking neural network enhanced time-integration scheme for computing viscoplastic structural finite element response ⋮ Deep convolutional Ritz method: parametric PDE surrogates without labeled data ⋮ SeismicNET: physics-informed neural networks for seismic wave modeling in semi-infinite domain ⋮ A Variational Neural Network Approach for Glacier Modelling with Nonlinear Rheology ⋮ Label-free learning of elliptic partial differential equation solvers with generalizability across boundary value problems ⋮ Physics-informed information field theory for modeling physical systems with uncertainty quantification ⋮ NeuralUQ: A Comprehensive Library for Uncertainty Quantification in Neural Differential Equations and Operators ⋮ Bayesian Deep Learning Framework for Uncertainty Quantification in Stochastic Partial Differential Equations ⋮ Scalable conditional deep inverse Rosenblatt transports using tensor trains and gradient-based dimension reduction ⋮ Physics-informed variational inference for uncertainty quantification of stochastic differential equations ⋮ Bi-fidelity modeling of uncertain and partially unknown systems using DeepONets ⋮ Embedding physical knowledge in deep neural networks for predicting the phonon dispersion curves of cellular metamaterials ⋮ Accelerating stochastic sequential quadratic programming for equality constrained optimization using predictive variance reduction ⋮ Finite basis physics-informed neural networks (FBPINNs): a scalable domain decomposition approach for solving differential equations ⋮ Learning the random variables in Monte Carlo simulations with stochastic gradient descent: Machine learning for parametric PDEs and financial derivative pricing ⋮ A neural network finite element method for contact mechanics ⋮ Energy-dissipative evolutionary deep operator neural networks ⋮ A hybrid data-driven-physics-constrained Gaussian process regression framework with deep kernel for uncertainty quantification ⋮ Deep Importance Sampling Using Tensor Trains with Application to a Priori and a Posteriori Rare Events ⋮ Dual order-reduced Gaussian process emulators (DORGP) for quantifying high-dimensional uncertain crack growth using limited and noisy data ⋮ AONN: An Adjoint-Oriented Neural Network Method for All-At-Once Solutions of Parametric Optimal Control Problems ⋮ Physics-informed ConvNet: learning physical field from a shallow neural network ⋮ Bi-fidelity variational auto-encoder for uncertainty quantification ⋮ GINNs: graph-informed neural networks for multiscale physics ⋮ Solving inverse problems using conditional invertible neural networks ⋮ A probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observables ⋮ Dynamic tensor approximation of high-dimensional nonlinear PDEs ⋮ A derivative-free method for solving elliptic partial differential equations with deep neural networks ⋮ Physics-informed semantic inpainting: application to geostatistical modeling ⋮ Transfer learning based multi-fidelity physics informed deep neural network ⋮ Convergence of Physics-Informed Neural Networks Applied to Linear Second-Order Elliptic Interface Problems ⋮ Deep learning of free boundary and Stefan problems ⋮ PhyGeoNet: physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain ⋮ Bayesian sparse learning with preconditioned stochastic gradient MCMC and its applications ⋮ Solving the linear transport equation by a deep neural network approach ⋮ Physics-Driven Learning of the Steady Navier-Stokes Equations using Deep Convolutional Neural Networks ⋮ Accelerated reactive transport simulations in heterogeneous porous media using Reaktoro and Firedrake ⋮ A Helmholtz equation solver using unsupervised learning: application to transcranial ultrasound ⋮ DeepM\&Mnet: inferring the electroconvection multiphysics fields based on operator approximation by neural networks ⋮ Weak form theory-guided neural network (TgNN-wf) for deep learning of subsurface single- and two-phase flow ⋮ Using neural networks to accelerate the solution of the Boltzmann equation ⋮ Mutual information for explainable deep learning of multiscale systems ⋮ Mesh-Conv: convolution operator with mesh resolution independence for flow field modeling ⋮ MIM: a deep mixed residual method for solving high-order partial differential equations ⋮ Clustered active-subspace based local Gaussian process emulator for high-dimensional and complex computer models ⋮ A fast and accurate physics-informed neural network reduced order model with shallow masked autoencoder ⋮ Learning time-dependent PDEs with a linear and nonlinear separate convolutional neural network ⋮ Adaptive deep density approximation for Fokker-Planck equations ⋮ When and why PINNs fail to train: a neural tangent kernel perspective ⋮ Simulation of the 3D hyperelastic behavior of ventricular myocardium using a finite-element based neural-network approach ⋮ A sample-efficient deep learning method for multivariate uncertainty qualification of acoustic-vibration interaction problems ⋮ Learning finite element convergence with the multi-fidelity graph neural network ⋮ Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network ⋮ Solving elliptic equations with Brownian motion: bias reduction and temporal difference learning ⋮ Scientific machine learning through physics-informed neural networks: where we are and what's next ⋮ Physics-informed PointNet: a deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries ⋮ Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data ⋮ Surrogate modeling of high-dimensional problems via data-driven polynomial chaos expansions and sparse partial least square ⋮ Physics-informed Karhunen-Loéve and neural network approximations for solving inverse differential equation problems ⋮ slimTrain---A Stochastic Approximation Method for Training Separable Deep Neural Networks ⋮ Physics and equality constrained artificial neural networks: application to forward and inverse problems with multi-fidelity data fusion ⋮ DeepParticle: learning invariant measure by a deep neural network minimizing Wasserstein distance on data generated from an interacting particle method ⋮ A survey of unsupervised learning methods for high-dimensional uncertainty quantification in black-box-type problems ⋮ The deep learning Galerkin method for the general Stokes equations ⋮ AMS-Net: Adaptive Multiscale Sparse Neural Network with Interpretable Basis Expansion for Multiphase Flow Problems ⋮ A physically constrained variational autoencoder for geochemical pattern recognition ⋮ Solving Time Dependent Fokker-Planck Equations via Temporal Normalizing Flow ⋮ DAS-PINNs: a deep adaptive sampling method for solving high-dimensional partial differential equations ⋮ A metalearning approach for physics-informed neural networks (PINNs): application to parameterized PDEs ⋮ Long-time integration of parametric evolution equations with physics-informed DeepONets ⋮ Isogeometric neural networks: a new deep learning approach for solving parameterized partial differential equations ⋮ Physics-Informed Probabilistic Learning of Linear Embeddings of Nonlinear Dynamics with Guaranteed Stability ⋮ Parameter estimation with the Markov chain Monte Carlo method aided by evolutionary neural networks in a water hammer model ⋮ opPINN: physics-informed neural network with operator learning to approximate solutions to the Fokker-Planck-Landau equation ⋮ An overview on deep learning-based approximation methods for partial differential equations ⋮ Forecasting of nonlinear dynamics based on symbolic invariance ⋮ A physics-aware, probabilistic machine learning framework for coarse-graining high-dimensional systems in the small data regime ⋮ A mesh-free method for interface problems using the deep learning approach ⋮ Modeling the dynamics of PDE systems with physics-constrained deep auto-regressive networks ⋮ Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks ⋮ Dynamically orthogonal tensor methods for high-dimensional nonlinear PDEs ⋮ Coercing machine learning to output physically accurate results

Uses Software

Cites Work

This page was built for publication: Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data