B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data

DOI10.1016/J.JCP.2020.109913OpenAlexW3010849941MaRDI QIDQ2123977

Yanyan Li

Publication date: 14 April 2022

Published in: Journal of Computational Physics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2003.06097

zbMATH Keywords

noisy datanonlinear PDEsvariational inferenceHamiltonian Monte CarloBayesian physics-informed neural networks

Mathematics Subject Classification ID

Statistics (62-XX) Partial differential equations (35-XX)

Related Items (only showing first 100 items - show all)

An efficient neural network method with plane wave activation functions for solving Helmholtz equation ⋮ Multi-fidelity Bayesian neural networks: algorithms and applications ⋮ Eigenfunction martingale estimating functions and filtered data for drift estimation of discretely observed multiscale diffusions ⋮ Deep learning of free boundary and Stefan problems ⋮ Theory-guided hard constraint projection (HCP): a knowledge-based data-driven scientific machine learning method ⋮ Simple computational strategies for more effective physics-informed neural networks modeling of turbulent natural convection ⋮ Multifidelity modeling for physics-informed neural networks (PINNs) ⋮ A two-stage physics-informed neural network method based on conserved quantities and applications in localized wave solutions ⋮ Learning functional priors and posteriors from data and physics ⋮ Variational inference at glacier scale ⋮ Multi-variance replica exchange SGMCMC for inverse and forward problems via Bayesian PINN ⋮ A general neural particle method for hydrodynamics modeling ⋮ A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data ⋮ Unsteady flow prediction from sparse measurements by compressed sensing reduced order modeling ⋮ Meta-learning PINN loss functions ⋮ Learning generative neural networks with physics knowledge ⋮ Scientific machine learning through physics-informed neural networks: where we are and what's next ⋮ Data-driven rogue waves and parameters discovery in nearly integrable \(\mathcal{PT}\)-symmetric Gross-Pitaevskii equations via PINNs deep learning ⋮ Stochastic physics-informed neural ordinary differential equations ⋮ Deep neural networks based temporal-difference methods for high-dimensional parabolic partial differential equations ⋮ Fractional Chebyshev deep neural network (FCDNN) for solving differential models ⋮ A hybrid MGA-MSGD ANN training approach for approximate solution of linear elliptic PDEs ⋮ A-PINN: auxiliary physics informed neural networks for forward and inverse problems of nonlinear integro-differential equations ⋮ Wasserstein generative adversarial uncertainty quantification in physics-informed neural networks ⋮ DeepParticle: learning invariant measure by a deep neural network minimizing Wasserstein distance on data generated from an interacting particle method ⋮ Scalable uncertainty quantification for deep operator networks using randomized priors ⋮ Improved deep neural networks with domain decomposition in solving partial differential equations ⋮ The deep learning Galerkin method for the general Stokes equations ⋮ Uncertainty quantification for nonlinear solid mechanics using reduced order models with Gaussian process regression ⋮ Efficient Bayesian inference with latent Hamiltonian neural networks in no-U-turn sampling ⋮ De Rham compatible deep neural network FEM ⋮ Deep Surrogate Accelerated Delayed-Acceptance Hamiltonian Monte Carlo for Bayesian Inference of Spatio-Temporal Heat Fluxes in Rotating Disc Systems ⋮ VC-PINN: variable coefficient physics-informed neural network for forward and inverse problems of PDEs with variable coefficient ⋮ Bayesian physics informed neural networks for real-world nonlinear dynamical systems ⋮ Enforcing continuous symmetries in physics-informed neural network for solving forward and inverse problems of partial differential equations ⋮ Adaptive deep density approximation for fractional Fokker-Planck equations ⋮ Solving Time Dependent Fokker-Planck Equations via Temporal Normalizing Flow ⋮ Adaptive weighting of Bayesian physics informed neural networks for multitask and multiscale forward and inverse problems ⋮ A framework based on symbolic regression coupled with eXtended physics-informed neural networks for gray-box learning of equations of motion from data ⋮ Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons ⋮ A metalearning approach for physics-informed neural networks (PINNs): application to parameterized PDEs ⋮ Airfoil-based convolutional autoencoder and long short-term memory neural network for predicting coherent structures evolution around an airfoil ⋮ FDM-PINN: Physics-informed neural network based on fictitious domain method ⋮ An extended physics informed neural network for preliminary analysis of parametric optimal control problems ⋮ A method for computing inverse parametric PDE problems with random-weight neural networks ⋮ A structure-preserving neural differential operator with embedded Hamiltonian constraints for modeling structural dynamics ⋮ Learning black- and gray-box chemotactic PDEs/closures from agent based Monte Carlo simulation data ⋮ Solving an inverse source problem by deep neural network method with convergence and error analysis ⋮ Physics-informed neural networks combined with polynomial interpolation to solve nonlinear partial differential equations ⋮ Error convergence and engineering-guided hyperparameter search of PINNs: towards optimized I-FENN performance ⋮ Surrogate modeling for Bayesian inverse problems based on physics-informed neural networks ⋮ Conditional Karhunen-Loève regression model with basis adaptation for high-dimensional problems: uncertainty quantification and inverse modeling ⋮ A Bayesian defect-based physics-guided neural network model for probabilistic fatigue endurance limit evaluation ⋮ HomPINNs: homotopy physics-informed neural networks for solving the inverse problems of nonlinear differential equations with multiple solutions ⋮ Isogeometric neural networks: a new deep learning approach for solving parameterized partial differential equations ⋮ Projection pursuit adaptation on polynomial chaos expansions ⋮ Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios ⋮ Physics-informed neural network methods based on Miura transformations and discovery of new localized wave solutions ⋮ Loss-attentional physics-informed neural networks ⋮ A new method for solving nonlinear partial differential equations based on liquid time-constant networks ⋮ Physics-informed neural networks with two weighted loss function methods for interactions of two-dimensional oceanic internal solitary waves ⋮ Variational inference in neural functional prior using normalizing flows: application to differential equation and operator learning problems ⋮ A Variational Neural Network Approach for Glacier Modelling with Nonlinear Rheology ⋮ Investigation of Low and High-Speed Fluid Dynamics Problems Using Physics-Informed Neural Network ⋮ Label-free learning of elliptic partial differential equation solvers with generalizability across boundary value problems ⋮ Physics-informed information field theory for modeling physical systems with uncertainty quantification ⋮ MC-Nonlocal-PINNs: Handling Nonlocal Operators in PINNs Via Monte Carlo Sampling ⋮ PI-VEGAN: Physics Informed Variational Embedding Generative Adversarial Networks for Stochastic Differential Equations ⋮ NeuralUQ: A Comprehensive Library for Uncertainty Quantification in Neural Differential Equations and Operators ⋮ Bayesian Deep Learning Framework for Uncertainty Quantification in Stochastic Partial Differential Equations ⋮ Physics-informed variational inference for uncertainty quantification of stochastic differential equations ⋮ Bi-fidelity modeling of uncertain and partially unknown systems using DeepONets ⋮ Deep neural operator for learning transient response of interpenetrating phase composites subject to dynamic loading ⋮ Bounded nonlinear forecasts of partially observed geophysical systems with physics-constrained deep learning ⋮ Finite basis physics-informed neural networks (FBPINNs): a scalable domain decomposition approach for solving differential equations ⋮ Adaptive Learning Rate Residual Network Based on Physics-Informed for Solving Partial Differential Equations ⋮ Variationally mimetic operator networks ⋮ Discovering a reaction-diffusion model for Alzheimer's disease by combining PINNs with symbolic regression ⋮ Multi-output physics-informed neural network for one- and two-dimensional nonlinear time distributed-order models ⋮ Bayesian deep learning for partial differential equation parameter discovery with sparse and noisy data ⋮ Numerical Analysis for Convergence of a Sample-Wise Backpropagation Method for Training Stochastic Neural Networks ⋮ Gradient-enhanced physics-informed neural networks based on transfer learning for inverse problems of the variable coefficient differential equations ⋮ An Adaptive Physics-Informed Neural Network with Two-Stage Learning Strategy to Solve Partial Differential Equations ⋮ Time difference physics-informed neural network for fractional water wave models ⋮ Resolution-independent generative models based on operator learning for physics-constrained Bayesian inverse problems ⋮ PDE-constrained models with neural network terms: optimization and global convergence ⋮ Hidden physics model for parameter estimation of elastic wave equations ⋮ A seamless multiscale operator neural network for inferring bubble dynamics ⋮ Bayesian neural networks for uncertainty quantification in data-driven materials modeling ⋮ A fast multi-fidelity method with uncertainty quantification for complex data correlations: application to vortex-induced vibrations of marine risers ⋮ Flow over an espresso cup: inferring 3-D velocity and pressure fields from tomographic background oriented Schlieren via physics-informed neural networks ⋮ Constructive deep ReLU neural network approximation ⋮ At the crossroads of simulation and data analytics ⋮ A generalized probabilistic learning approach for multi-fidelity uncertainty quantification in complex physical simulations ⋮ NH-PINN: neural homogenization-based physics-informed neural network for multiscale problems ⋮ Error analysis for physics-informed neural networks (PINNs) approximating Kolmogorov PDEs ⋮ Optimal control of PDEs using physics-informed neural networks ⋮ Theory-guided physics-informed neural networks for boundary layer problems with singular perturbation ⋮ The nonlinear wave solutions and parameters discovery of the Lakshmanan-Porsezian-Daniel based on deep learning ⋮ A super-real-time three-dimension computing method of digital twins in space nuclear power

Uses Software

• Adam
• DeepXDE
• PPINN

Cites Work

• Unnamed Item
• Unnamed Item
• Inferring solutions of differential equations using noisy multi-fidelity data
• Machine learning of linear differential equations using Gaussian processes
• Physics-informed neural networks for high-speed flows
• Adaptive multi-fidelity polynomial chaos approach to Bayesian inference in inverse problems
• Data-driven discovery of PDEs in complex datasets
• Neural-net-induced Gaussian process regression for function approximation and PDE solution
• Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
• A composite neural network that learns from multi-fidelity data: application to function approximation and inverse PDE problems
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• Adaptive Construction of Surrogates for the Bayesian Solution of Inverse Problems
• Data-Driven Science and Engineering
• Model selection for dynamical systems via sparse regression and information criteria
• Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations

This page was built for publication: B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data