PPINN: parareal physics-informed neural network for time-dependent PDEs
From MaRDI portal
Publication:2020276
DOI10.1016/J.CMA.2020.113250zbMATH Open1506.65181arXiv1909.10145OpenAlexW3041682155WikidataQ114196915 ScholiaQ114196915MaRDI QIDQ2020276FDOQ2020276
Authors: Xuhui Meng, Zhen Li, Dongkun Zhang, George Em Karniadakis 
Publication date: 23 April 2021
Published in: Computer Methods in Applied Mechanics and Engineering (Search for Journal in Brave)
Abstract: Physics-informed neural networks (PINNs) encode physical conservation laws and prior physical knowledge into the neural networks, ensuring the correct physics is represented accurately while alleviating the need for supervised learning to a great degree. While effective for relatively short-term time integration, when long time integration of the time-dependent PDEs is sought, the time-space domain may become arbitrarily large and hence training of the neural network may become prohibitively expensive. To this end, we develop a parareal physics-informed neural network (PPINN), hence decomposing a long-time problem into many independent short-time problems supervised by an inexpensive/fast coarse-grained (CG) solver. In particular, the serial CG solver is designed to provide approximate predictions of the solution at discrete times, while initiate many fine PINNs simultaneously to correct the solution iteratively. There is a two-fold benefit from training PINNs with small-data sets rather than working on a large-data set directly, i.e., training of individual PINNs with small-data is much faster, while training the fine PINNs can be readily parallelized. Consequently, compared to the original PINN approach, the proposed PPINN approach may achieve a significant speedup for long-time integration of PDEs, assuming that the CG solver is fast and can provide reasonable predictions of the solution, hence aiding the PPINN solution to converge in just a few iterations. To investigate the PPINN performance on solving time-dependent PDEs, we first apply the PPINN to solve the Burgers equation, and subsequently we apply the PPINN to solve a two-dimensional nonlinear diffusion-reaction equation. Our results demonstrate that PPINNs converge in a couple of iterations with significant speed-ups proportional to the number of time-subdomains employed.
Full work available at URL: https://arxiv.org/abs/1909.10145
Recommendations
- fPINNs: Fractional Physics-Informed Neural Networks
- Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks
- PhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs
Parallel numerical computation (65Y05) Artificial neural networks and deep learning (68T07) Numerical methods for partial differential equations, initial value and time-dependent initial-boundary value problems (65M99)
Cites Work
- Adaptive subgradient methods for online learning and stochastic optimization
- fPINNs: Fractional Physics-Informed Neural Networks
- Time-decomposed parallel time-integrators: theory and feasibility studies for fluid, structure, and fluid-structure applications
- The Parareal in Time Iterative Solver: a Further Direction to Parallel Implementation
- Finite difference methods for two-dimensional fractional dispersion equation
- Inexact and truncated parareal-in-time Krylov subspace methods for parabolic optimal control problems
- A micro-macro parareal algorithm: application to singularly perturbed ordinary differential equations
- An asymptotic parallel-in-time method for highly oscillatory PDEs
- 50 years of time parallel time integration
- Title not available (Why is that?)
- A Parareal in Time Semi-implicit Approximation of the Navier-Stokes Equations
- A parareal in time procedure for the control of partial differential equations
- Neural‐network‐based approximations for solving partial differential equations
- Implicit parallel time integrators
- A parallel space-time algorithm
- A multiresolution strategy for reduction of elliptic PDEs and eigenvalue problems
- Title not available (Why is that?)
- Parareal in time 3D numerical solver for the LWR benchmark neutron diffusion transient model
- Adversarial uncertainty quantification in physics-informed neural networks
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
- Optimization methods for large-scale machine learning
- ConvPDE-UQ: convolutional neural networks with quantified uncertainty for heterogeneous elliptic partial differential equations on varied domains
- Supervised parallel-in-time algorithm for long-time Lagrangian simulations of stochastic dynamics: application to hydrodynamics
Cited In (68)
- Prediction of optical solitons using an improved physics-informed neural network method with the conservation law constraint
- GParareal: a time-parallel ODE solver using Gaussian process emulation
- Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons
- Learning stochastic dynamics with statistics-informed neural network
- Deep learning of free boundary and Stefan problems
- A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data
- Fractional Chebyshev deep neural network (FCDNN) for solving differential models
- A nonlocal physics-informed deep learning framework using the peridynamic differential operator
- Label-free learning of elliptic partial differential equation solvers with generalizability across boundary value problems
- Kolmogorov n-width and Lagrangian physics-informed neural networks: a causality-conforming manifold for convection-dominated PDEs
- Multifidelity modeling for physics-informed neural networks (PINNs)
- Boundary-safe PINNs extension: application to non-linear parabolic PDEs in counterparty credit risk
- Numerical solution of the Fokker-Planck equation using physics-based mixture models
- An overview on deep learning-based approximation methods for partial differential equations
- A unified scalable framework for causal sweeping strategies for physics-informed neural networks (PINNs) and their temporal decompositions
- Physics-informed neural networks for the shallow-water equations on the sphere
- Discretizationnet: a machine-learning based solver for Navier-Stokes equations using finite volume discretization
- Local parameter identification with neural ordinary differential equations
- Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
- Unsteady flow prediction from sparse measurements by compressed sensing reduced order modeling
- Neural network architectures using min-plus algebra for solving certain high-dimensional optimal control problems and Hamilton-Jacobi PDEs
- A metalearning approach for physics-informed neural networks (PINNs): application to parameterized PDEs
- Solving multi-material problems in solid mechanics using physics-informed neural networks based on domain decomposition technology
- Data-driven rogue waves and parameters discovery in nearly integrable \(\mathcal{PT}\)-symmetric Gross-Pitaevskii equations via PINNs deep learning
- Comparative studies on mesh-free deep neural network approach versus finite element method for solving coupled nonlinear hyperbolic/wave equations
- Enforcing continuous symmetries in physics-informed neural network for solving forward and inverse problems of partial differential equations
- Physics-informed PointNet: a deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries
- A hybrid MGA-MSGD ANN training approach for approximate solution of linear elliptic PDEs
- Numerical wave propagation aided by deep learning
- Interpretable machine learning: fundamental principles and 10 grand challenges
- An extended physics informed neural network for preliminary analysis of parametric optimal control problems
- A-PINN: auxiliary physics informed neural networks for forward and inverse problems of nonlinear integro-differential equations
- Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
- A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
- Physics-informed neural networks combined with polynomial interpolation to solve nonlinear partial differential equations
- Long-time integration of parametric evolution equations with physics-informed DeepONets
- Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
- Combining machine learning and domain decomposition methods for the solution of partial differential equations—A review
- Solving free-surface problems for non-shallow water using boundary and initial conditions-free physics-informed neural network (bif-PINN)
- Mosaic flows: a transferable deep learning framework for solving PDEs on unseen domains
- PhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
- Monte Carlo fPINNs: deep learning method for forward and inverse problems involving high dimensional fractional partial differential equations
- Parallel physics-informed neural networks via domain decomposition
- Scientific machine learning through physics-informed neural networks: where we are and what's next
- Learning elliptic partial differential equations with randomized linear algebra
- Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation
- Variable linear transformation improved physics-informed neural networks to solve thin-layer flow problems
- Loss-attentional physics-informed neural networks
- CEENs: causality-enforced evolutional networks for solving time-dependent partial differential equations
- An introduction to programming physics-informed neural network-based computational solid mechanics
- Physics-informed neural networks and functional interpolation for stiff chemical kinetics
- Bright-dark rogue wave transition in coupled ab system via the physics-informed neural networks method
- DNN-HDG: a deep learning hybridized discontinuous Galerkin method for solving some elliptic problems
- Ml-GLE: a machine learning enhanced generalized Langevin equation framework for transient anomalous diffusion in polymer dynamics
- Advanced physics-informed neural networks for numerical approximation of the coupled Schrödinger-KdV equation
- Deep learning in computational mechanics: a review
- A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networks
- Multistep asymptotic pre-training strategy based on PINNs for solving steep boundary singular perturbation problems
- f-PICNN: a physics-informed convolutional neural network for partial differential equations with space-time domain
- SMS: spiking marching scheme for efficient long time integration of differential equations
- Spectral operator learning for parametric PDEs without data reliance
- Higher-order multi-scale physics-informed neural network (HOMS-PINN) method and its convergence analysis for solving elastic problems of authentic composite materials
- AsPINN: Adaptive symmetry-recomposition physics-informed neural networks
- High-order space-time parallel computing of the Navier-Stokes equations
- Adaptive deep density approximation for stochastic dynamical systems
- An immersed interface neural network for elliptic interface problems
- A deep learning method for incompressible fluid equations and the coupling problems
- PDNNs: the parallel deep neural networks for the Navier-Stokes equations coupled with heat equation
Uses Software
This page was built for publication: PPINN: parareal physics-informed neural network for time-dependent PDEs
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2020276)
