Error analysis for physics-informed neural networks (PINNs) approximating Kolmogorov PDEs
From MaRDI portal
Publication:2095545
Heat equation (35K05) Nonlinear parabolic equations (35K55) KdV equations (Korteweg-de Vries equations) (35Q53) Error bounds for initial value and initial-boundary value problems involving PDEs (65M15) Numerical methods for partial differential equations, initial value and time-dependent initial-boundary value problems (65M99) Artificial neural networks and deep learning (68T07) Derivative securities (option pricing, hedging, etc.) (91G20)
Abstract: Physics informed neural networks approximate solutions of PDEs by minimizing pointwise residuals. We derive rigorous bounds on the error, incurred by PINNs in approximating the solutions of a large class of linear parabolic PDEs, namely Kolmogorov equations that include the heat equation and Black-Scholes equation of option pricing, as examples. We construct neural networks, whose PINN residual (generalization error) can be made as small as desired. We also prove that the total -error can be bounded by the generalization error, which in turn is bounded in terms of the training error, provided that a sufficient number of randomly chosen training (collocation) points is used. Moreover, we prove that the size of the PINNs and the number of training samples only grow polynomially with the underlying dimension, enabling PINNs to overcome the curse of dimensionality in this context. These results enable us to provide a comprehensive error analysis for PINNs in approximating Kolmogorov PDEs.
Recommendations
- On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs
- A Rate of Convergence of Physics Informed Neural Networks for the Linear Second Order Elliptic PDEs
- Error estimates and physics informed augmentation of neural networks for thermally coupled incompressible Navier Stokes equations
- Control of partial differential equations via physics-informed neural networks
- Physics informed neural networks (PINNs) for approximating nonlinear dispersive PDEs
Cites work
- Analysis of the generalization error: empirical risk minimization over deep artificial neural networks overcomes the curse of dimensionality in the numerical approximation of Black-Scholes partial differential equations
- Approximation rates for neural networks with encodable weights in smoothness spaces
- B-PINNs: Bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data
- Conservative physics-informed neural networks on discrete domains for conservation laws: applications to forward and inverse problems
- Deep learning in high dimension: neural network expression rates for generalized polynomial chaos expansions in UQ
- Deep learning observables in computational fluid dynamics
- Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
- DeepXDE: a deep learning library for solving differential equations
- Error bounds for approximations with deep ReLU neural networks in \(W^{s , p}\) norms
- Error estimates for DeepONets: a deep learning framework in infinite dimensions
- Estimates on the generalization error of physics-informed neural networks for approximating a class of inverse problems for PDEs
- Extended Physics-Informed Neural Networks (XPINNs): A Generalized Space-Time Domain Decomposition Based Deep Learning Framework for Nonlinear Partial Differential Equations
- fPINNs: Fractional Physics-Informed Neural Networks
- Hidden physics models: machine learning of nonlinear partial differential equations
- scientific article; zbMATH DE number 5946386 (Why is no real title available?)
- scientific article; zbMATH DE number 3090541 (Why is no real title available?)
- Iterative surrogate model optimization (ISMO): an active learning algorithm for PDE constrained optimization with deep neural networks
- Neural‐network‐based approximations for solving partial differential equations
- On the approximation of functions by tanh neural networks
- Physics informed neural networks (PINNs) for approximating nonlinear dispersive PDEs
- Physics-informed neural networks for high-speed flows
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Stochastic differential equations. An introduction with applications.
Cited in
(47)- Solving PDEs by variational physics-informed neural networks: an a posteriori error analysis
- Control of partial differential equations via physics-informed neural networks
- Greedy training algorithms for neural networks and applications to PDEs
- When do extended physics-informed neural networks (XPINNs) improve generalization?
- Physics informed neural networks (PINNs) for approximating nonlinear dispersive PDEs
- Uniform error estimates for artificial neural network approximations for heat equations
- On the convergence of physics informed neural networks for linear second-order elliptic and parabolic type PDEs
- Physics-informed neural networks for approximating dynamic (hyperbolic) PDEs of second order in time: error analysis and algorithms
- Reliable extrapolation of deep neural operators informed by physics or sparse observations
- A New Certified Hierarchical and Adaptive RB-ML-ROM Surrogate Model for Parametrized PDEs
- Error estimates and physics informed augmentation of neural networks for thermally coupled incompressible Navier Stokes equations
- Higher-order error estimates for physics-informed neural networks approximating the primitive equations
- A theoretical case study of the generalization of machine-learned potentials
- Boundary-safe PINNs extension: application to non-linear parabolic PDEs in counterparty credit risk
- Meshless methods for American option pricing through physics-informed neural networks
- Mobility Estimation for Langevin Dynamics Using Control Variates
- wPINNs: Weak Physics Informed Neural Networks for Approximating Entropy Solutions of Hyperbolic Conservation Laws
- Render unto numerics: orthogonal polynomial neural operator for PDEs with nonperiodic boundary conditions
- Solving Poisson problems in polygonal domains with singularity enriched physics informed neural networks
- Decoupling numerical method based on deep neural network for nonlinear degenerate interface problems
- Generalization of PINNs for elliptic interface problems
- Numerical analysis of physics-informed neural networks and related models in physics-informed machine learning
- Recent developments in machine learning methods for stochastic control and games
- Binary structured physics-informed neural networks for solving equations with rapidly changing solutions
- A short note on solving partial differential equations using convolutional neural networks
- Error estimates for physics-informed neural networks approximating the Navier-Stokes equations
- Deep adaptive sampling for surrogate modeling without labeled data
- Error estimates of physics-informed neural networks for initial value problems
- Error analysis of kernel/GP methods for nonlinear and parametric PDEs
- Generalization error analysis of deep backward dynamic programming for solving nonlinear PDEs
- A unified framework for the error analysis of physics-informed neural networks
- Bounds on the approximation error for deep neural networks applied to dispersive models: nonlinear waves
- Optimizing the optimizer for physics-informed neural networks and Kolmogorov-Arnold networks
- Fredholm neural networks
- Neural network solutions to the critical SQG equations via approximating nonlocal periodic operators
- Automatic differentiation is essential in training neural networks for solving differential equations
- Interpolating between BSDEs and PINNs: deep learning for elliptic and parabolic boundary value problems
- Physics-informed neural network for vibration analysis of large membranes
- On the convergence of PINNs
- Investigating neural networks with groundwater flow equation loss
- A certified wavelet-based physics-informed neural network for the solution of parameterized partial differential equations
- History-matching of imbibition flow in fractured porous media using physics-informed neural networks (PINNs)
- Unveiling the optimization process of physics informed neural networks: how accurate and competitive can PINNs be?
- Physics-informed deep learning and compressive collocation for high-dimensional diffusion-reaction equations: practical existence theory and numerics
- Error Estimates in Physics-Informed Neural Networks to Heat-Wave Fluid-Structure Interactive System
- Global error estimators for parametric monotone nonlinearities and neural approximations
- Convergence of kernel and neural-network methods for Hamilton--Jacobi--Bellman equations on unbounded domains
This page was built for publication: Error analysis for physics-informed neural networks (PINNs) approximating Kolmogorov PDEs
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2095545)
