Dosnet as a non-black-box PDE solver: when deep learning meets operator splitting

DOI10.1016/J.JCP.2023.112343arXiv2212.05571MaRDI QIDQ6095076FDOQ6095076

Authors:

Publication date: 27 November 2023

Published in: Journal of Computational Physics (Search for Journal in Brave)

Abstract: Deep neural networks (DNNs) recently emerged as a promising tool for analyzing and solving complex differential equations arising in science and engineering applications. Alternative to traditional numerical schemes, learning-based solvers utilize the representation power of DNNs to approximate the input-output relations in an automated manner. However, the lack of physics-in-the-loop often makes it difficult to construct a neural network solver that simultaneously achieves high accuracy, low computational burden, and interpretability. In this work, focusing on a class of evolutionary PDEs characterized by having decomposable operators, we show that the classical ``operator splitting numerical scheme of solving these equations can be exploited to design neural network architectures. This gives rise to a learning-based PDE solver, which we name Deep Operator-Splitting Network (DOSnet). Such non-black-box network design is constructed from the physical rules and operators governing the underlying dynamics contains learnable parameters, and is thus more flexible than the standard operator splitting scheme. Once trained, it enables the fast solution of the same type of PDEs. To validate the special structure inside DOSnet, we take the linear PDEs as the benchmark and give the mathematical explanation for the weight behavior. Furthermore, to demonstrate the advantages of our new AI-enhanced PDE solver, we train and validate it on several types of operator-decomposable differential equations. We also apply DOSnet to nonlinear Schr"odinger equations (NLSE) which have important applications in the signal processing for modern optical fiber transmission systems, and experimental results show that our model has better accuracy and lower computational complexity than numerical schemes and the baseline DNNs.

Full work available at URL: https://arxiv.org/abs/2212.05571

Recommendations

• Deep-HyROMnet: a deep learning-based operator approximation for hyper-reduction of nonlinear parametrized PDEs
• DeepSets and their derivative networks for solving symmetric PDEs
• DeLISA: deep learning based iteration scheme approximation for solving PDEs
• Improved deep neural networks with domain decomposition in solving partial differential equations
• MOD-Net: a machine learning approach via model-operator-data network for solving PDEs
• A finite element based deep learning solver for parametric PDEs
• PDE-Net 2.0: learning PDEs from data with a numeric-symbolic hybrid deep network
• A deep Fourier residual method for solving PDEs using neural networks
• SONets: sub-operator learning enhanced neural networks for solving parametric partial differential equations
• DGM: a deep learning algorithm for solving partial differential equations

zbMATH Keywords

deep learningoperator splittingneural network architectureevolutionary PDEsSchrödinger equations

Mathematics Subject Classification ID

Parabolic equations and parabolic systems (35Kxx) Numerical methods for partial differential equations, initial value and time-dependent initial-boundary value problems (65Mxx) Physiological, cellular and medical topics (92Cxx)

Cites Work

• Topics in noncommutative algebra. The theorem of Campbell, Baker, Hausdorff and Dynkin
• Splitting methods
• Split-Step Methods for the Solution of the Nonlinear Schrödinger Equation
• On the Construction and Comparison of Difference Schemes
• Solving high-dimensional partial differential equations using deep learning
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• The phase field method for geometric moving interfaces and their numerical approximations

Cited In (1)

• Double-well net for image segmentation

This page was built for publication: Dosnet as a non-black-box PDE solver: when deep learning meets operator splitting

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6095076)