PPINN: parareal physics-informed neural network for time-dependent PDEs
From MaRDI portal
Publication:2020276
Abstract: Physics-informed neural networks (PINNs) encode physical conservation laws and prior physical knowledge into the neural networks, ensuring the correct physics is represented accurately while alleviating the need for supervised learning to a great degree. While effective for relatively short-term time integration, when long time integration of the time-dependent PDEs is sought, the time-space domain may become arbitrarily large and hence training of the neural network may become prohibitively expensive. To this end, we develop a parareal physics-informed neural network (PPINN), hence decomposing a long-time problem into many independent short-time problems supervised by an inexpensive/fast coarse-grained (CG) solver. In particular, the serial CG solver is designed to provide approximate predictions of the solution at discrete times, while initiate many fine PINNs simultaneously to correct the solution iteratively. There is a two-fold benefit from training PINNs with small-data sets rather than working on a large-data set directly, i.e., training of individual PINNs with small-data is much faster, while training the fine PINNs can be readily parallelized. Consequently, compared to the original PINN approach, the proposed PPINN approach may achieve a significant speedup for long-time integration of PDEs, assuming that the CG solver is fast and can provide reasonable predictions of the solution, hence aiding the PPINN solution to converge in just a few iterations. To investigate the PPINN performance on solving time-dependent PDEs, we first apply the PPINN to solve the Burgers equation, and subsequently we apply the PPINN to solve a two-dimensional nonlinear diffusion-reaction equation. Our results demonstrate that PPINNs converge in a couple of iterations with significant speed-ups proportional to the number of time-subdomains employed.
Recommendations
- fPINNs: Fractional Physics-Informed Neural Networks
- Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks
- PhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEs
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs
Cites work
- scientific article; zbMATH DE number 1827892 (Why is no real title available?)
- scientific article; zbMATH DE number 5208485 (Why is no real title available?)
- 50 years of time parallel time integration
- A Parareal in Time Semi-implicit Approximation of the Navier-Stokes Equations
- A micro-macro parareal algorithm: application to singularly perturbed ordinary differential equations
- A multiresolution strategy for reduction of elliptic PDEs and eigenvalue problems
- A parallel space-time algorithm
- A parareal in time procedure for the control of partial differential equations
- Adaptive subgradient methods for online learning and stochastic optimization
- Adversarial uncertainty quantification in physics-informed neural networks
- An asymptotic parallel-in-time method for highly oscillatory PDEs
- ConvPDE-UQ: convolutional neural networks with quantified uncertainty for heterogeneous elliptic partial differential equations on varied domains
- Deep UQ: learning deep neural network surrogate models for high dimensional uncertainty quantification
- Finite difference methods for two-dimensional fractional dispersion equation
- Implicit parallel time integrators
- Inexact and truncated parareal-in-time Krylov subspace methods for parabolic optimal control problems
- Neural‐network‐based approximations for solving partial differential equations
- Optimization methods for large-scale machine learning
- Parareal in time 3D numerical solver for the LWR benchmark neutron diffusion transient model
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems
- Supervised parallel-in-time algorithm for long-time Lagrangian simulations of stochastic dynamics: application to hydrodynamics
- The Parareal in Time Iterative Solver: a Further Direction to Parallel Implementation
- Time-decomposed parallel time-integrators: theory and feasibility studies for fluid, structure, and fluid-structure applications
- fPINNs: Fractional Physics-Informed Neural Networks
Cited in
(only showing first 100 items - show all)- An immersed interface neural network for elliptic interface problems
- A deep learning method for incompressible fluid equations and the coupling problems
- Parallel physics-informed neural networks via domain decomposition
- Scientific machine learning through physics-informed neural networks: where we are and what's next
- Generalized Kuramoto-Sivashinsky equation solving by B-splines based neural network
- Learning elliptic partial differential equations with randomized linear algebra
- PDNNs: the parallel deep neural networks for the Navier-Stokes equations coupled with heat equation
- Solving nonlinear Boussinesq equation of second-order time derivatives with physics-informed neural networks
- BINet: learn to solve partial differential equations with boundary integral networks
- Physics-informed neural networks for solving forward and inverse flow problems via the Boltzmann-BGK formulation
- Hammering at the entropy: a GENERIC-guided approach to learning polymeric rheological constitutive equations using PINNs
- Variable linear transformation improved physics-informed neural networks to solve thin-layer flow problems
- Singular layer PINN methods for steep reaction-diffusion equations in a smooth convex domain
- Physics-informed neural networks for tsunami inundation modeling
- Loss-attentional physics-informed neural networks
- Adaptive trajectories sampling for solving PDEs with deep learning methods
- CEENs: causality-enforced evolutional networks for solving time-dependent partial differential equations
- IS-PINN: integrating mathematical principles to solve inhomogeneous wave equations via physics-informed neural networks
- Prediction of optical solitons using an improved physics-informed neural network method with the conservation law constraint
- GParareal: a time-parallel ODE solver using Gaussian process emulation
- Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons
- Learning stochastic dynamics with statistics-informed neural network
- A Physics-Informed, Deep Double Reservoir Network for Forecasting Boundary Layer Velocity
- An introduction to programming physics-informed neural network-based computational solid mechanics
- Physics-informed neural networks and functional interpolation for stiff chemical kinetics
- Deep learning of free boundary and Stefan problems
- A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data
- Fractional Chebyshev deep neural network (FCDNN) for solving differential models
- A symmetric difference data enhancement physics-informed neural network for the solving of discrete nonlinear lattice equations
- Solving partial differential equations based on preconditioning-pretraining physics-informed neural network
- A nonlocal physics-informed deep learning framework using the peridynamic differential operator
- Bright-dark rogue wave transition in coupled ab system via the physics-informed neural networks method
- Kolmogorov n-width and Lagrangian physics-informed neural networks: a causality-conforming manifold for convection-dominated PDEs
- Label-free learning of elliptic partial differential equation solvers with generalizability across boundary value problems
- Multi-objective loss balancing for physics-informed deep learning
- Data-driven two-dimensional stationary quantum droplets and wave propagations in the amended Gross-Pitaevskii equation with two potentials via deep neural networks learning
- Semi-analytic PINN methods for singularly perturbed boundary value problems
- VW-PINNs: a volume weighting method for PDE residuals in physics-informed neural networks
- Multifidelity modeling for physics-informed neural networks (PINNs)
- Numerical solution of the Fokker-Planck equation using physics-based mixture models
- Finite element operator network for solving elliptic-type parametric PDEs
- Boundary-safe PINNs extension: application to non-linear parabolic PDEs in counterparty credit risk
- DNN-HDG: a deep learning hybridized discontinuous Galerkin method for solving some elliptic problems
- An overview on deep learning-based approximation methods for partial differential equations
- Ml-GLE: a machine learning enhanced generalized Langevin equation framework for transient anomalous diffusion in polymer dynamics
- Advanced physics-informed neural networks for numerical approximation of the coupled Schrödinger-KdV equation
- The deep finite element method: a deep learning framework integrating the physics-informed neural networks with the finite element method
- MC-CDNNs: the Monte Carlo-coupled deep neural networks approach for stochastic dual-porosity-Stokes flow coupled model
- Physics-informed neural networks for the shallow-water equations on the sphere
- Discretizationnet: a machine-learning based solver for Navier-Stokes equations using finite volume discretization
- Deep learning in computational mechanics: a review
- A unified scalable framework for causal sweeping strategies for physics-informed neural networks (PINNs) and their temporal decompositions
- Local parameter identification with neural ordinary differential equations
- Higher-order multi-scale deep Ritz method (HOMS-DRM) and its convergence analysis for solving thermal transfer problems of composite materials
- A hybrid collocation method for long-time simulation of heat conduction in anisotropic functionally graded materials
- Surrogate and inverse modeling for two-phase flow in porous media via theory-guided convolutional neural network
- Unsteady flow prediction from sparse measurements by compressed sensing reduced order modeling
- Deep neural network for oscillation dynamics of capillary rise
- Neural network architectures using min-plus algebra for solving certain high-dimensional optimal control problems and Hamilton-Jacobi PDEs
- A comprehensive and FAIR comparison between MLP and KAN representations for differential equations and operator networks
- Multistep asymptotic pre-training strategy based on PINNs for solving steep boundary singular perturbation problems
- A metalearning approach for physics-informed neural networks (PINNs): application to parameterized PDEs
- f-PICNN: a physics-informed convolutional neural network for partial differential equations with space-time domain
- SMS: spiking marching scheme for efficient long time integration of differential equations
- Modified physics-informed neural networks: data-driven rogue-wave dynamics and parameter identifications for the Newell-type long-short wave system
- R-PINN: recovery-type a-posteriori estimator enhanced adaptive PINN
- Data-driven rogue waves and parameters discovery in nearly integrable \(\mathcal{PT}\)-symmetric Gross-Pitaevskii equations via PINNs deep learning
- Error analyses of the single hidden layer neural network based on the extreme learning machine for solving differential equations
- Approximate solution of KdV-Burgers equation using improved PINNs algorithm
- Forward and inverse solutions of coupled ODEs using AI: Lotka-Volterra system
- Solving multi-material problems in solid mechanics using physics-informed neural networks based on domain decomposition technology
- Comparative studies on mesh-free deep neural network approach versus finite element method for solving coupled nonlinear hyperbolic/wave equations
- Efficient numerical wave propagation enhanced by an end-to-end deep learning model
- Score-based physics-informed learning framework for stochastic dynamics
- IG-PINNs: interface-gated physics-informed neural networks for solving elliptic interface problems
- Spectral operator learning for parametric PDEs without data reliance
- Enforcing continuous symmetries in physics-informed neural network for solving forward and inverse problems of partial differential equations
- Higher-order multi-scale physics-informed neural network (HOMS-PINN) method and its convergence analysis for solving elastic problems of authentic composite materials
- Hybrid PCA-PINN framework for accurate and transparent ECG arrhythmia detection
- Physics-informed PointNet: a deep learning solver for steady-state incompressible flows and thermal fields on multiple sets of irregular geometries
- A hybrid MGA-MSGD ANN training approach for approximate solution of linear elliptic PDEs
- Weak minimization-sampling network for solving PDEs
- Interpretable machine learning: fundamental principles and 10 grand challenges
- Numerical wave propagation aided by deep learning
- Incremental distillation physics-informed neural network (IDPINN) accurately models the evolution of optical solitons
- Machine learning approaches to the nonlinear Schrödinger equation with harmonic potentials and Gaussian nonlinearities
- An extended physics informed neural network for preliminary analysis of parametric optimal control problems
- A physics-informed piecewise continuity network for solving the non-linear jerk equation: PiPC-Net
- Cross-time causal physics-informed neural networks for dynamic time-dependent problems
- Nonlinear interaction multi-domain physics-informed neural networks for the hybrid rogue wave and breather solutions of the nonlinear Schrödinger equation
- A-PINN: auxiliary physics informed neural networks for forward and inverse problems of nonlinear integro-differential equations
- Gradient-enhanced physics-informed neural networks for forward and inverse PDE problems
- AsPINN: Adaptive symmetry-recomposition physics-informed neural networks
- A comprehensive study of non-adaptive and residual-based adaptive sampling for physics-informed neural networks
- Physics-informed neural networks combined with polynomial interpolation to solve nonlinear partial differential equations
- Long-time integration of parametric evolution equations with physics-informed DeepONets
- Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
- High-order space-time parallel computing of the Navier-Stokes equations
- Solving free-surface problems for non-shallow water using boundary and initial conditions-free physics-informed neural network (bif-PINN)
- Nearest neighbors GParareal: improving scalability of Gaussian processes for parallel-in-time solvers
This page was built for publication: PPINN: parareal physics-informed neural network for time-dependent PDEs
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2020276)
