An Augmented Lagrangian Deep Learning Method for Variational Problems with Essential Boundary Conditions
From MaRDI portal
(Redirected from Publication:5065200)
augmented Lagrangian methoddeep learningessential boundary conditionssaddle point problemsvariational problems
Numerical methods for eigenvalue problems for boundary value problems involving PDEs (65N25) Finite element, Rayleigh-Ritz and Galerkin methods for boundary value problems involving PDEs (65N30) Numerical methods for partial differential equations, boundary value problems (65N99) Artificial neural networks and deep learning (68T07)
Abstract: This paper is concerned with a novel deep learning method for variational problems with essential boundary conditions. To this end, we first reformulate the original problem into a minimax problem corresponding to a feasible augmented Lagrangian, which can be solved by the augmented Lagrangian method in an infinite dimensional setting. Based on this, by expressing the primal and dual variables with two individual deep neural network functions, we present an augmented Lagrangian deep learning method for which the parameters are trained by the stochastic optimization method together with a projection technique. Compared to the traditional penalty method, the new method admits two main advantages: i) the choice of the penalty parameter is flexible and robust, and ii) the numerical solution is more accurate in the same magnitude of computational cost. As typical applications, we apply the new approach to solve elliptic problems and (nonlinear) eigenvalue problems with essential boundary conditions, and numerical experiments are presented to show the effectiveness of the new method.
Recommendations
- Deep neural networks and adaptive quadrature for solving variational problems
- The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems
- A Deep Learning Method for Elliptic Hemivariational Inequalities
- Deep solution operators for variational inequalities via proximal neural networks
- Multigrid-Augmented Deep Learning Preconditioners for the Helmholtz Equation
- Deep neural network structures solving variational inequalities
- A finite element based deep learning solver for parametric PDEs
- Deep neural network approximation for high-dimensional elliptic PDEs with boundary conditions
- A deep learning Galerkin method for the second-order linear elliptic equations
- Deep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEs
Cites work
- A priori estimates of the population risk for two-layer neural networks
- Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
- Deep network approximation characterized by number of neurons
- Deep Nitsche Method: Deep Ritz Method with Essential Boundary Conditions
- DGM: a deep learning algorithm for solving partial differential equations
- scientific article; zbMATH DE number 45081 (Why is no real title available?)
- scientific article; zbMATH DE number 3491650 (Why is no real title available?)
- scientific article; zbMATH DE number 3596197 (Why is no real title available?)
- scientific article; zbMATH DE number 613872 (Why is no real title available?)
- scientific article; zbMATH DE number 5060482 (Why is no real title available?)
- Int-Deep: a deep learning initialized iterative method for nonlinear problems
- Large-scale machine learning with stochastic gradient descent
- Learning in Modal Space: Solving Time-Dependent Stochastic PDEs Using Physics-Informed Neural Networks
- Lectures on optimization - theory and algorithms. Notes by M. K. V. Murthy
- Linear and nonlinear functional analysis with applications. With 401 problems and 52 figures
- Machine learning and computational mathematics
- Multi-scale deep neural network (MscaleDNN) for solving Poisson-Boltzmann equation in complex domains
- Multilayer feedforward networks are universal approximators
- Neural algorithm for solving differential equations
- Neural‐network‐based approximations for solving partial differential equations
- Nonlinear analysis and semilinear elliptic problems
- Numerical analysis of nonlinear eigenvalue problems
- On some techniques for approximating boundary conditions in the finite element method
- PFNN: a penalty-free neural network method for solving a class of second-order boundary-value problems on complex geometries
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- ReLU deep neural networks and linear finite elements
- Robust Stochastic Approximation Approach to Stochastic Programming
- Solving high-dimensional partial differential equations using deep learning
- The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems
- Universal approximation bounds for superpositions of a sigmoidal function
- Weak adversarial networks for high-dimensional partial differential equations
- Über ein Variationsprinzip zur Lösung von Dirichlet-Problemen bei Verwendung von Teilräumen, die keinen Randbedingungen unterworfen sind. (On a variational principle for solving Dirichlet problems less boundary conditions using subspaces)
Cited in
(22)- The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems
- Monte Carlo fPINNs: deep learning method for forward and inverse problems involving high dimensional fractional partial differential equations
- A-PINN: auxiliary physics informed neural networks for forward and inverse problems of nonlinear integro-differential equations
- Solving time dependent Fokker-Planck equations via temporal normalizing flow
- A Chebyshev Polynomial Neural Network Solver for Boundary Value Problems of Elliptic Equations
- A Hybrid Method for Three-Dimensional Semi-Linear Elliptic Equations
- Failure-Informed Adaptive Sampling for PINNs
- Feature engineering with regularity structures
- An Adaptive Physics-Informed Neural Network with Two-Stage Learning Strategy to Solve Partial Differential Equations
- Less Emphasis on Hard Regions: Curriculum Learning of PINNs for Singularly Perturbed Convection-Diffusion-Reaction Problems
- Render unto numerics: orthogonal polynomial neural operator for PDEs with nonperiodic boundary conditions
- Domain decomposition learning methods for solving elliptic problems
- Machine learning algorithm for the Monge-Ampère equation with transport boundary conditions
- MHDnet: physics-preserving learning for solving magnetohydrodynamics problems
- Analysis of deep Ritz methods for semilinear elliptic equations
- Efficiently training physics-informed neural networks via anomaly-aware optimization
- Weak minimization-sampling network for solving PDEs
- A natural deep Ritz method for essential boundary value problems
- A hybrid iterative method for elliptic variational inequalities of the second kind
- IB-UQ: information bottleneck based uncertainty quantification for neural function regression and neural operator learning
- Weak adversarial networks for interface optimal design problems under physical constraints
- The augmented Lagrangian methods: overview and recent advances
This page was built for publication: An Augmented Lagrangian Deep Learning Method for Variational Problems with Essential Boundary Conditions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5065200)
