When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?

DOI10.1137/21M1447039zbMath1498.65183arXiv2109.09444MaRDI QIDQ5043367

Ameya D. Jagtap, Kenji Kawaguchi, Zheyuan Hu, George Em. Karniadakis

Publication date: 21 October 2022

Published in: SIAM Journal on Scientific Computing (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2109.09444

zbMATH Keywords

generalizationdeep learningextended physics-informed neural network (XPINN)

Mathematics Subject Classification ID

Computational learning theory (68Q32) Learning and adaptive systems in artificial intelligence (68T05) Multigrid methods; domain decomposition for initial value and initial-boundary value problems involving PDEs (65M55) Numerical methods for partial differential equations, initial value and time-dependent initial-boundary value problems (65M99)

Related Items (19)

A unified scalable framework for causal sweeping strategies for physics-informed neural networks (PINNs) and their temporal decompositions ⋮ Deep learning-accelerated computational framework based on physics informed neural network for the solution of linear elasticity ⋮ Physics-informed neural networks with parameter asymptotic strategy for learning singularly perturbed convection-dominated problem ⋮ Physics-Informed Neural Networks for Solving Dynamic Two-Phase Interface Problems ⋮ Physics-informed neural networks for approximating dynamic (hyperbolic) PDEs of second order in time: error analysis and algorithms ⋮ A framework based on symbolic regression coupled with eXtended physics-informed neural networks for gray-box learning of equations of motion from data ⋮ wPINNs: Weak Physics Informed Neural Networks for Approximating Entropy Solutions of Hyperbolic Conservation Laws ⋮ Physical informed neural networks with soft and hard boundary constraints for solving advection-diffusion equations using Fourier expansions ⋮ A peridynamic-informed neural network for continuum elastic displacement characterization ⋮ An unsupervised latent/output physics-informed convolutional-LSTM network for solving partial differential equations using peridynamic differential operator ⋮ An overview on deep learning-based approximation methods for partial differential equations ⋮ Mixed formulation of physics-informed neural networks for thermo-mechanically coupled systems and heterogeneous domains ⋮ Bright-dark rogue wave transition in coupled ab system via the physics-informed neural networks method ⋮ Domain decomposition learning methods for solving elliptic problems ⋮ Generalization of PINNs for elliptic interface problems ⋮ Enhancing training of physics-informed neural networks using domain decomposition-based preconditioning strategies ⋮ Tackling the curse of dimensionality in fractional and tempered fractional PDEs with physics-informed neural networks ⋮ Improving weak PINNs for hyperbolic conservation laws: dual norm computation, boundary conditions and systems ⋮ Data-driven prediction of soliton solutions of the higher-order NLSE via the strongly-constrained PINN method

Uses Software

• L-BFGS
• Adam
• XPINNs
• NSFnets

Cites Work

• Handbook of numerical methods for hyperbolic problems. Basic and fundamental issues
• On the limited memory BFGS method for large scale optimization
• Non-invasive inference of thrombus material properties with physics-informed neural networks
• NSFnets (Navier-Stokes flow nets): physics-informed neural networks for the incompressible Navier-Stokes equations
• Conservative physics-informed neural networks on discrete domains for conservation laws: applications to forward and inverse problems
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• A priori estimates of the population risk for two-layer neural networks
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• Flow over an espresso cup: inferring 3-D velocity and pressure fields from tomographic background oriented Schlieren via physics-informed neural networks
• 10.1162/153244303321897690
• Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations
• On the Convergence of Physics Informed Neural Networks for Linear Second-Order Elliptic and Parabolic Type PDEs
• Rayleigh‐Ritz‐Galerkin methods for dirichlet's problem using subspaces without boundary conditions
• Generalization in Deep Learning

This page was built for publication: When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?