Subspace decomposition based DNN algorithm for elliptic type multi-scale PDEs

DOI10.1016/J.JCP.2023.112242MaRDI QIDQ6162913zbMATH OpenFDO

Authors Xian Li, Zhi-Qin John Xu, Lei Zhang

Publication date 16 June 2023

Published in Journal of Computational Physics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2112.06660

zbMATH Keywords

activation functionmulti-scaleFourierDNNsubspace-decomposed

Mathematics Subject Classification ID

Artificial intelligence (68Txx) Numerical methods for partial differential equations, boundary value problems (65Nxx) Elliptic equations and elliptic systems (35Jxx)

Abstract: While deep learning algorithms demonstrate a great potential in scientific computing, its application to multi-scale problems remains to be a big challenge. This is manifested by the "frequency principle" that neural networks tend to learn low frequency components first. Novel architectures such as multi-scale deep neural network (MscaleDNN) were proposed to alleviate this problem to some extent. In this paper, we construct a subspace decomposition based DNN (dubbed SD${}^2$NN) architecture for a class of multi-scale problems by combining traditional numerical analysis ideas and MscaleDNN algorithms. The proposed architecture includes one low frequency normal DNN submodule, and one (or a few) high frequency MscaleDNN submodule(s), which are designed to capture the smooth part and the oscillatory part of the multi-scale solutions, respectively. In addition, a novel trigonometric activation function is incorporated in the SD${}^2$NN model. We demonstrate the performance of the SD${}^2$NN architecture through several benchmark multi-scale problems in regular or irregular geometric domains. Numerical results show that the SD${}^2$NN model is superior to existing models such as MscaleDNN.

Recommendations

• A multi-scale DNN algorithm for nonlinear elliptic equations with multiple scales
• Deep neural network approximation for high-dimensional elliptic PDEs with boundary conditions
• A non-gradient method for solving elliptic partial differential equations with deep neural networks
• A derivative-free method for solving elliptic partial differential equations with deep neural networks
• Numerical Homogenization of Elliptic Multiscale Problems by Subspace Decomposition
• Solving multiscale elliptic problems by sparse radial basis function neural networks
• Multi-scale fusion network: a new deep learning structure for elliptic interface problems
• DNN-HDG: a deep learning hybridized discontinuous Galerkin method for solving some elliptic problems
• scientific article; zbMATH DE number 1047492
• Improved deep neural networks with domain decomposition in solving partial differential equations

Cites work

• scientific article; zbMATH DE number 3627589 (Why is no real title available?)
• scientific article; zbMATH DE number 3638921 (Why is no real title available?)
• scientific article; zbMATH DE number 1350773 (Why is no real title available?)
• A localized orthogonal decomposition method for semi-linear elliptic problems
• A multi-scale DNN algorithm for nonlinear elliptic equations with multiple scales
• A multiscale finite element method for elliptic problems in composite materials and porous media
• A phase shift deep neural network for high frequency approximation and wave problems
• A proposal on machine learning via dynamical systems
• Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
• Adaptivity and variational stabilization for convection-diffusion equations
• An adaptive generalized multiscale discontinuous Galerkin method for high-contrast flow problems
• Analysis of the heterogeneous multiscale method for elliptic homogenization problems
• Anomalous slow diffusion from perpetual homogenization.
• Bayesian numerical homogenization
• DGM: a deep learning algorithm for solving partial differential equations
• Deep Potential: A General Representation of a Many-Body Potential Energy Surface
• Deep learning
• Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
• Fast eigenpairs computation with operator adapted wavelets and hierarchical subspace correction
• Flux norm approach to finite-dimensional homogenization approximations with non-separated scales and high contrast
• Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks
• Generalized multiscale finite element methods (GMsFEM)
• Generalized rough polyharmonic splines for multiscale PDEs with rough coefficients
• Homogenization of Parabolic Equations with a Continuum of Space and Time Scales
• Inferring solutions of differential equations using noisy multi-fidelity data
• Introduction to the network approximation method for materials modeling.
• Iterative Methods by Space Decomposition and Subspace Correction
• Kernel flows: from learning kernels from data into the abyss
• Localization of elliptic multiscale problems
• Machine learning and computational mathematics
• Machine learning from a continuous viewpoint. I
• Multi-Scale Deep Neural Network (MscaleDNN) Methods for Oscillatory Stokes Flows in Complex Domains
• Multi-scale deep neural network (MscaleDNN) for solving Poisson-Boltzmann equation in complex domains
• Multigrid with Rough Coefficients and Multiresolution Operator Decomposition from Hierarchical Information Games
• Multiscale Finite Element Methods
• Numerical homogenization of the acoustic wave equations with a continuum of scales
• Numerical mathematics.
• On the eigenvector bias of Fourier feature networks: from regression to solving multi-scale PDEs with physics-informed neural networks
• Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
• Polyharmonic homogenization, rough polyharmonic splines and sparse super-localization
• The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems
• The heterogeneous multiscale methods
• The variational multiscale method -- a paradigm for computational mechanics
• Variational multiscale residual-based turbulence modeling for large eddy simulation of incompressible flows
• Weak adversarial networks for high-dimensional partial differential equations

Cited in

(3)

• Loss jump during loss switch in solving PDEs with neural networks
• Solving multiscale elliptic problems by sparse radial basis function neural networks
• Higher-order multi-scale physics-informed neural network (HOMS-PINN) method and its convergence analysis for solving elastic problems of authentic composite materials

This page was built for publication: Subspace decomposition based DNN algorithm for elliptic type multi-scale PDEs

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6162913)