Convergence Analysis of a Quasi-Monte CarloBased Deep Learning Algorithm for Solving Partial Differential Equations
From MaRDI portal
Publication:6151262
Abstract: Deep learning methods have achieved great success in solving partial differential equations (PDEs), where the loss is often defined as an integral. The accuracy and efficiency of these algorithms depend greatly on the quadrature method. We propose to apply quasi-Monte Carlo (QMC) methods to the Deep Ritz Method (DRM) for solving the Neumann problems for the Poisson equation and the static Schr"{o}dinger equation. For error estimation, we decompose the error of using the deep learning algorithm to solve PDEs into the generalization error, the approximation error and the training error. We establish the upper bounds and prove that QMC-based DRM achieves an asymptotically smaller error bound than DRM. Numerical experiments show that the proposed method converges faster in all cases and the variances of the gradient estimators of randomized QMC-based DRM are much smaller than those of DRM, which illustrates the superiority of QMC in deep learning over MC.
Cites work
- A QMC-Deep Learning Method for Diffusivity Estimation in Random Domains
- A quasi-Monte Carlo data compression algorithm for machine learning
- Approximation rates for neural networks with encodable weights in smoothness spaces
- Convergence rate analysis for deep Ritz method
- Convergence rates for the stochastic gradient descent method for non-convex objective functions
- DGM: a deep learning algorithm for solving partial differential equations
- Enhancing Accuracy of Deep Learning Algorithms by Training with Low-Discrepancy Sequences
- First-order methods in optimization
- Foundations of machine learning
- High-dimensional statistics. A non-asymptotic viewpoint
- Higher-order quasi-Monte Carlo training of deep neural networks
- scientific article; zbMATH DE number 5797591 (Why is no real title available?)
- scientific article; zbMATH DE number 53679 (Why is no real title available?)
- scientific article; zbMATH DE number 1790423 (Why is no real title available?)
- Machine learning and computational mathematics
- On the distribution of points in a cube and the approximate evaluation of integrals
- One more experiment on estimating high-dimensional integrals by quasi-Monte Carlo methods
- Optimization methods for large-scale machine learning
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Quasi-Monte Carlo finite element methods for a class of elliptic partial differential equations with random coefficients
- Quasi-Monte Carlo methods with applications in finance
- Quasi-Monte Carlo sampling for solving partial differential equations by deep neural networks
- Quasi-Monte Carlo: a high-dimensional experiment
- Solving high-dimensional partial differential equations using deep learning
- The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems
- The effective dimension and quasi-Monte Carlo integration
- Variance with alternative scramblings of digital nets
This page was built for publication: Convergence Analysis of a Quasi-Monte CarloBased Deep Learning Algorithm for Solving Partial Differential Equations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6151262)
