PPINN: parareal physics-informed neural network for time-dependent PDEs
From MaRDI portal
Publication:2020276
Abstract: Physics-informed neural networks (PINNs) encode physical conservation laws and prior physical knowledge into the neural networks, ensuring the correct physics is represented accurately while alleviating the need for supervised learning to a great degree. While effective for relatively short-term time integration, when long time integration of the time-dependent PDEs is sought, the time-space domain may become arbitrarily large and hence training of the neural network may become prohibitively expensive. To this end, we develop a parareal physics-informed neural network (PPINN), hence decomposing a long-time problem into many independent short-time problems supervised by an inexpensive/fast coarse-grained (CG) solver. In particular, the serial CG solver is designed to provide approximate predictions of the solution at discrete times, while initiate many fine PINNs simultaneously to correct the solution iteratively. There is a two-fold benefit from training PINNs with small-data sets rather than working on a large-data set directly, i.e., training of individual PINNs with small-data is much faster, while training the fine PINNs can be readily parallelized. Consequently, compared to the original PINN approach, the proposed PPINN approach may achieve a significant speedup for long-time integration of PDEs, assuming that the CG solver is fast and can provide reasonable predictions of the solution, hence aiding the PPINN solution to converge in just a few iterations. To investigate the PPINN performance on solving time-dependent PDEs, we first apply the PPINN to solve the Burgers equation, and subsequently we apply the PPINN to solve a two-dimensional nonlinear diffusion-reaction equation. Our results demonstrate that PPINNs converge in a couple of iterations with significant speed-ups proportional to the number of time-subdomains employed.
Recommendations
- fPINNs: Fractional Physics-Informed Neural Networks
- Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks
- PhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs
Cites work
- scientific article; zbMATH DE number 1827892 (Why is no real title available?)
- scientific article; zbMATH DE number 5208485 (Why is no real title available?)
- 50 years of time parallel time integration
- A Parareal in Time Semi-implicit Approximation of the Navier-Stokes Equations
- A micro-macro parareal algorithm: application to singularly perturbed ordinary differential equations
- A multiresolution strategy for reduction of elliptic PDEs and eigenvalue problems
- A parallel space-time algorithm
- A parareal in time procedure for the control of partial differential equations
- Adaptive subgradient methods for online learning and stochastic optimization
- Adversarial uncertainty quantification in physics-informed neural networks
- An asymptotic parallel-in-time method for highly oscillatory PDEs
- ConvPDE-UQ: convolutional neural networks with quantified uncertainty for heterogeneous elliptic partial differential equations on varied domains
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Finite difference methods for two-dimensional fractional dispersion equation
- Implicit parallel time integrators
- Inexact and truncated parareal-in-time Krylov subspace methods for parabolic optimal control problems
- Neural‐network‐based approximations for solving partial differential equations
- Optimization methods for large-scale machine learning
- Parareal in time 3D numerical solver for the LWR benchmark neutron diffusion transient model
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
- Supervised parallel-in-time algorithm for long-time Lagrangian simulations of stochastic dynamics: application to hydrodynamics
- The Parareal in Time Iterative Solver: a Further Direction to Parallel Implementation
- Time-decomposed parallel time-integrators: theory and feasibility studies for fluid, structure, and fluid-structure applications
- fPINNs: Fractional Physics-Informed Neural Networks
Cited in
(68)- A hybrid MGA-MSGD ANN training approach for approximate solution of linear elliptic PDEs
- Combining machine learning and domain decomposition methods for the solution of partial differential equations—A review
- Label-free learning of elliptic partial differential equation solvers with generalizability across boundary value problems
- Unsteady flow prediction from sparse measurements by compressed sensing reduced order modeling
- A-PINN: auxiliary physics informed neural networks for forward and inverse problems of nonlinear integro-differential equations
- Scientific machine learning through physics-informed neural networks: where we are and what's next
- Solving multi-material problems in solid mechanics using physics-informed neural networks based on domain decomposition technology
- An overview on deep learning-based approximation methods for partial differential equations
- Multifidelity modeling for physics-informed neural networks (PINNs)
- Solving free-surface problems for non-shallow water using boundary and initial conditions-free physics-informed neural network (bif-PINN)
- Data-driven rogue waves and parameters discovery in nearly integrable \(\mathcal{PT}\)-symmetric Gross-Pitaevskii equations via PINNs deep learning
- Numerical wave propagation aided by deep learning
- GParareal: a time-parallel ODE solver using Gaussian process emulation
- Boundary-safe PINNs extension: application to non-linear parabolic PDEs in counterparty credit risk
- Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons
- Physics-informed neural networks for the shallow-water equations on the sphere
- Monte Carlo fPINNs: deep learning method for forward and inverse problems involving high dimensional fractional partial differential equations
- Kolmogorov n-width and Lagrangian physics-informed neural networks: a causality-conforming manifold for convection-dominated PDEs
- Discretizationnet: a machine-learning based solver for Navier-Stokes equations using finite volume discretization
- Learning stochastic dynamics with statistics-informed neural network
- Interpretable machine learning: fundamental principles and 10 grand challenges
- Neural network architectures using min-plus algebra for solving certain high-dimensional optimal control problems and Hamilton-Jacobi PDEs
- Numerical solution of the Fokker-Planck equation using physics-based mixture models
- Local parameter identification with neural ordinary differential equations
- An extended physics informed neural network for preliminary analysis of parametric optimal control problems
- Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
- A nonlocal physics-informed deep learning framework using the peridynamic differential operator
- A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
- Physics-informed neural networks combined with polynomial interpolation to solve nonlinear partial differential equations
- Long-time integration of parametric evolution equations with physics-informed DeepONets
- Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
- Deep learning of free boundary and Stefan problems
- Mosaic flows: a transferable deep learning framework for solving PDEs on unseen domains
- PhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
- A metalearning approach for physics-informed neural networks (PINNs): application to parameterized PDEs
- Learning elliptic partial differential equations with randomized linear algebra
- Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation
- A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data
- Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
- Enforcing continuous symmetries in physics-informed neural network for solving forward and inverse problems of partial differential equations
- Loss-attentional physics-informed neural networks
- Prediction of optical solitons using an improved physics-informed neural network method with the conservation law constraint
- Parallel physics-informed neural networks via domain decomposition
- Variable linear transformation improved physics-informed neural networks to solve thin-layer flow problems
- Comparative studies on mesh-free deep neural network approach versus finite element method for solving coupled nonlinear hyperbolic/wave equations
- A unified scalable framework for causal sweeping strategies for physics-informed neural networks (PINNs) and their temporal decompositions
- Physics-informed PointNet: a deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries
- Fractional Chebyshev deep neural network (FCDNN) for solving differential models
- Ml-GLE: a machine learning enhanced generalized Langevin equation framework for transient anomalous diffusion in polymer dynamics
- Advanced physics-informed neural networks for numerical approximation of the coupled Schrödinger-KdV equation
- Adaptive deep density approximation for stochastic dynamical systems
- A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networks
- Multistep asymptotic pre-training strategy based on PINNs for solving steep boundary singular perturbation problems
- CEENs: causality-enforced evolutional networks for solving time-dependent partial differential equations
- High-order space-time parallel computing of the Navier-Stokes equations
- AsPINN: Adaptive symmetry-recomposition physics-informed neural networks
- f-PICNN: a physics-informed convolutional neural network for partial differential equations with space-time domain
- SMS: spiking marching scheme for efficient long time integration of differential equations
- DNN-HDG: a deep learning hybridized discontinuous Galerkin method for solving some elliptic problems
- Bright-dark rogue wave transition in coupled ab system via the physics-informed neural networks method
- PDNNs: the parallel deep neural networks for the Navier-Stokes equations coupled with heat equation
- Spectral operator learning for parametric PDEs without data reliance
- Deep learning in computational mechanics: a review
- An introduction to programming physics-informed neural network-based computational solid mechanics
- Physics-informed neural networks and functional interpolation for stiff chemical kinetics
- Higher-order multi-scale physics-informed neural network (HOMS-PINN) method and its convergence analysis for solving elastic problems of authentic composite materials
- An immersed interface neural network for elliptic interface problems
- A deep learning method for incompressible fluid equations and the coupling problems
This page was built for publication: PPINN: parareal physics-informed neural network for time-dependent PDEs
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2020276)
