The Deep Ritz Method: a deep learning-based numerical algorithm for solving variational problems

From MaRDI portal
Publication:1744192

DOI10.1007/s40304-018-0127-zzbMath1392.35306arXiv1710.00211OpenAlexW2760972773MaRDI QIDQ1744192

Bing Yu, E. Weinan

Publication date: 16 April 2018

Published in: Communications in Mathematics and Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1710.00211




Related Items

Stationary Density Estimation of Itô Diffusions Using Deep LearningA Regularity Theory for Static Schrödinger Equations on \(\boldsymbol{\mathbb{R}}\)d in Spectral Barron SpacesAsymptotic-preserving schemes for multiscale physical problemsA Proof that Artificial Neural Networks Overcome the Curse of Dimensionality in the Numerical Approximation of Black–Scholes Partial Differential EquationsLearning-based local weighted least squares for algebraic multigrid methodJAX-DIPS: neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuitiesNeural Networks with Local Converging Inputs (NNLCI) for Solving Conservation Laws, Part I: 1D ProblemsNeural networks based on power method and inverse power method for solving linear eigenvalue problemsSolving multiscale elliptic problems by sparse radial basis function neural networksOn a neural network approach for solving potential control problem of the semiclassical Schrödinger equationDe Rham compatible deep neural network FEMRandomized neural network with Petrov-Galerkin methods for solving linear and nonlinear partial differential equationsAn introduction to the mathematics of deep learningThree ways to solve partial differential equations with neural networks — A reviewCombining machine learning and domain decomposition methods for the solution of partial differential equations—A reviewVC-PINN: variable coefficient physics-informed neural network for forward and inverse problems of PDEs with variable coefficientArtificial neural networks for solving elliptic differential equations with boundary layerSome elliptic second order problems and neural network solutions: existence and error estimatesA priori generalization error analysis of two-layer neural networks for solving high dimensional Schrödinger eigenvalue problemsA nonlocal energy‐informed neural network for isotropic elastic solids with cracks under thermomechanical loadsPhase-field DeepONet: physics-informed deep operator neural network for fast simulations of pattern formation governed by gradient flows of free-energy functionalsSolving nonconvex energy minimization problems in martensitic phase transitions with a mesh-free deep learning approachAdaptive deep density approximation for fractional Fokker-Planck equationsThe deep minimizing movement schemePhysics-informed neural networks for approximating dynamic (hyperbolic) PDEs of second order in time: error analysis and algorithmsThe Random Feature Method for Time-Dependent ProblemsOn the use of graph neural networks and shape‐function‐based gradient computation in the deep energy methodBINN: a deep learning approach for computational mechanics problems based on boundary integral equationsA cusp-capturing PINN for elliptic interface problemsSolving Elliptic Problems with Singular Sources Using Singularity Splitting Deep Ritz MethodDeep Ritz method with adaptive quadrature for linear elasticityA New Certified Hierarchical and Adaptive RB-ML-ROM Surrogate Model for Parametrized PDEsExponential ReLU neural network approximation rates for point and edge singularitiesData-driven vortex solitons and parameter discovery of 2D generalized nonlinear Schrödinger equations with a \(\mathcal{PT}\)-symmetric optical latticeThe robust physics-informed neural networks for a typical fourth-order phase field modelExponential Convergence of Deep Operator Networks for Elliptic Partial Differential EquationsFriedrichs Learning: Weak Solutions of Partial Differential Equations via Deep LearningDeep learning discrete calculus (DLDC): a family of discrete numerical methods by universal approximation for STEM education to frontier researchA Chebyshev Polynomial Neural Network Solver for Boundary Value Problems of Elliptic EquationsA Hybrid Method for Three-Dimensional Semi-Linear Elliptic EquationsAn Efficient Neural-Network and Finite-Difference Hybrid Method for Elliptic Interface Problems with ApplicationsInvestigating and Mitigating Failure Modes in Physics-Informed Neural Networks (PINNs)A Correction and Comments on “Multi-Scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains CiCP, 28(5):1970–2001,2020”Finite element interpolated neural networks for solving forward and inverse problemsCapturing the diffusive behavior of the multiscale linear transport equations by asymptotic-preserving convolutional deeponetsPseudo-Hamiltonian neural networks for learning partial differential equationsAn extreme learning machine-based method for computational PDEs in higher dimensionsLimitations of neural network training due to numerical instability of backpropagationTransferable neural networks for partial differential equationsWeak adversarial networks for solving forward and inverse problems involving 2D incompressible Navier-Stokes equationsA conservative hybrid deep learning method for Maxwell-Ampère-Nernst-Planck equationsDeep learning-based schemes for singularly perturbed convection-diffusion problemsA new method for solving nonlinear partial differential equations based on liquid time-constant networksRandom vibration of hysteretic systems under Poisson white noise excitationsVariational inference in neural functional prior using normalizing flows: application to differential equation and operator learning problemsDeep convolutional Ritz method: parametric PDE surrogates without labeled dataA dive into spectral inference networks: improved algorithms for self-supervised learning of continuous spectral representationsA posteriori error control of approximate solutions to boundary value problems found by neural networksA Rate of Convergence of Weak Adversarial Neural Networks for the Second Order Parabolic PDEsA Novel Deep Neural Network Algorithm for the Helmholtz Scattering Problem In the Unbounded DomainLearning Specialized Activation Functions for Physics-Informed Neural NetworksNeural Networks with Local Converging Inputs (NNLCI) for Solving Conservation Laws, Part II: 2D ProblemsA Variational Neural Network Approach for Glacier Modelling with Nonlinear RheologyDeep neural networks learning forward and inverse problems of two-dimensional nonlinear wave equations with rational solitonsA Data-Assisted Two-Stage Method for the Inverse Random Source Problem\(r\)-adaptive deep learning method for solving partial differential equationsError analysis of deep Ritz methods for elliptic equationsConvergence Analysis of a Quasi-Monte CarloBased Deep Learning Algorithm for Solving Partial Differential EquationsMC-Nonlocal-PINNs: Handling Nonlocal Operators in PINNs Via Monte Carlo SamplingHRW: Hybrid Residual and Weak Form Loss for Solving Elliptic Interface Problems with Neural NetworkImproved Analysis of PINNs: Alleviate the CoD for Compositional SolutionsStochastic dynamics and data scienceSolving the Boltzmann Equation with a Neural Sparse RepresentationPhysics-informed variational inference for uncertainty quantification of stochastic differential equationsA deep neural network-based method for solving obstacle problemsDNN-HDG: a deep learning hybridized discontinuous Galerkin method for solving some elliptic problemsAsymptotic-preserving neural networks for multiscale time-dependent linear transport equationsNumerical computation of partial differential equations by hidden-layer concatenated extreme learning machineReLU neural network Galerkin BEMHiDeNN-FEM: a seamless machine learning approach to nonlinear finite element analysisAnalytical derivatives of neural networksSubspace decomposition based DNN algorithm for elliptic type multi-scale PDEsNeural Network Method for Integral Fractional Laplace EquationsMachine learning architectures for price formation modelsAutomatic boundary fitting framework of boundary dependent physics-informed neural network solving partial differential equation with complex boundary conditionsA symmetry group based supervised learning method for solving partial differential equationsExact Dirichlet boundary physics-informed neural network EPINN for solid mechanicsAdaptive Learning Rate Residual Network Based on Physics-Informed for Solving Partial Differential EquationsA Scalable Deep Learning Approach for Solving High-Dimensional Dynamic Optimal TransportFailure-Informed Adaptive Sampling for PINNsApproximation properties of residual neural networks for fractional differential equationsA Neural Network Approach for Homogenization of Multiscale ProblemsLearning the random variables in Monte Carlo simulations with stochastic gradient descent: Machine learning for parametric PDEs and financial derivative pricingA priori error estimate of deep mixed residual method for elliptic PDEsDeep Ritz method for elliptical multiple eigenvalue problemsLocal randomized neural networks with discontinuous Galerkin methods for diffusive-viscous wave equationMulti-level neural networks for accurate solutions of boundary-value problemsHigh Order Deep Domain Decomposition Method for Solving High Frequency Interface ProblemsAn Adaptive Physics-Informed Neural Network with Two-Stage Learning Strategy to Solve Partial Differential EquationsAnalysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black--Scholes Partial Differential EquationsDeep Adaptive Basis Galerkin Method for High-Dimensional Evolution Equations With Oscillatory SolutionsPFNN-2: A Domain Decomposed Penalty-Free Neural Network Method for Solving Partial Differential EquationsGeneralization Error Analysis of Neural Networks with Gradient Based RegularizationDeep Domain Decomposition Methods: Helmholtz EquationMIONet: Learning Multiple-Input Operators via Tensor ProductA deep neural network-based numerical method for solving contact problemsHigh Order Deep Neural Network for Solving High Frequency Partial Differential EquationsVPVnet: A Velocity-Pressure-Vorticity Neural Network Method for the Stokes’ Equations under Reduced RegularityAn Augmented Lagrangian Deep Learning Method for Variational Problems with Essential Boundary ConditionsA Deep Learning Method for Elliptic Hemivariational InequalitiesApproximations with deep neural networks in Sobolev time-spaceConvergence Rate Analysis for Deep Ritz MethodDeep Unfitted Nitsche Method for Elliptic Interface ProblemsA Rate of Convergence of Physics Informed Neural Networks for the Linear Second Order Elliptic PDEsA Consensus-Based Global Optimization Method with Adaptive Momentum EstimationImaging conductivity from current density magnitude using neural networks*Discovering phase field models from image data with the pseudo-spectral physics informed neural networksLeast-squares ReLU neural network (LSNN) method for scalar nonlinear hyperbolic conservation lawA finite element based deep learning solver for parametric PDEsA physics-informed variational DeepONet for predicting crack path in quasi-brittle materialsAdaptive deep neural networks methods for high-dimensional partial differential equationsTowards fast weak adversarial training to solve high dimensional parabolic partial differential equations using XNODE-WANOn computing the hyperparameter of extreme learning machines: algorithm and application to computational PDEs, and comparison with classical and high-order finite elementsPhysics and equality constrained artificial neural networks: application to forward and inverse problems with multi-fidelity data fusionA deep learning energy method for hyperelasticity and viscoelasticityStructure preservation for the deep neural network multigrid solverSurrogate convolutional neural network models for steady computational fluid dynamics simulationsDeepParticle: learning invariant measure by a deep neural network minimizing Wasserstein distance on data generated from an interacting particle methodDeep Neural Network Surrogates for Nonsmooth Quantities of Interest in Shape Uncertainty QuantificationImproved deep neural networks with domain decomposition in solving partial differential equationsNonlocal kernel network (NKN): a stable and resolution-independent deep neural networkA shallow Ritz method for elliptic problems with singular sourcesA discontinuity capturing shallow neural network for elliptic interface problemsIntegrated finite element neural network (I-FENN) for non-local continuum damage mechanicsGalerkin neural network approximation of singularly-perturbed elliptic systemsNeural control of discrete weak formulations: Galerkin, least squares \& minimal-residual methods with quasi-optimal weightsA deep first-order system least squares method for solving elliptic PDEsData-driven soliton mappings for integrable fractional nonlinear wave equations via deep learning with Fourier neural operatorMOD-Net: A Machine Learning Approach via Model-Operator-Data Network for Solving PDEsSolving Time Dependent Fokker-Planck Equations via Temporal Normalizing FlowDAS-PINNs: a deep adaptive sampling method for solving high-dimensional partial differential equationsSurrogate modeling for Bayesian inverse problems based on physics-informed neural networksActive learning based sampling for high-dimensional nonlinear partial differential equationsLong-time integration of parametric evolution equations with physics-informed DeepONetsSpace-time error estimates for deep neural network approximations for differential equationsADLGM: an efficient adaptive sampling deep learning Galerkin methodA deep double Ritz method (\(\mathrm{D^2RM}\)) for solving partial differential equations using neural networksNeural network architectures using min-plus algebra for solving certain high-dimensional optimal control problems and Hamilton-Jacobi PDEsData-driven forward and inverse problems for chaotic and hyperchaotic dynamic systems based on two machine learning architecturesMulti-scale fusion network: a new deep learning structure for elliptic interface problemsDeep energy method in topology optimization applicationsControl of partial differential equations via physics-informed neural networksApproximation properties of residual neural networks for Kolmogorov PDEsAn overview on deep learning-based approximation methods for partial differential equationsGreedy training algorithms for neural networks and applications to PDEsSolving traveltime tomography with deep learningNeural network-based variational methods for solving quadratic porous medium equations in high dimensionsBI-GreenNet: learning Green's functions by boundary integral networkA Phase Shift Deep Neural Network for High Frequency Approximation and Wave ProblemsDeep ReLU networks and high-order finite element methodsError bounds for approximations with deep ReLU neural networks in Ws,p normsNumerical solution of inverse problems by weak adversarial networksDeepXDE: A Deep Learning Library for Solving Differential EquationsA physics-guided neural network framework for elastic plates: comparison of governing equations-based and energy-based approachesLearning constitutive models from microstructural simulations via a non-intrusive reduced basis methodParametric deep energy approach for elasticity accounting for strain gradient effectsLocal extreme learning machines and domain decomposition for solving linear and nonlinear partial differential equationsConditional physics informed neural networksOvercoming the curse of dimensionality in the numerical approximation of semilinear parabolic partial differential equationsBetter Approximations of High Dimensional Smooth Functions by Deep Neural Networks with Rectified Power UnitsFinite Neuron Method and Convergence AnalysisFrequency Principle: Fourier Analysis Sheds Light on Deep Neural NetworksA Multi-Scale DNN Algorithm for Nonlinear Elliptic Equations with Multiple ScalesMulti-Scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex DomainsOn the Convergence of Physics Informed Neural Networks for Linear Second-Order Elliptic and Parabolic Type PDEsNumerical Simulations for Full History Recursive Multilevel Picard Approximations for Systems of High-Dimensional Partial Differential EquationsMulti-Scale Deep Neural Network (MscaleDNN) Methods for Oscillatory Stokes Flows in Complex DomainsLearning to Discretize: Solving 1D Scalar Conservation Laws via Deep Reinforcement LearningTrain Like a (Var)Pro: Efficient Training of Neural Networks with Variable ProjectionSolving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural NetworksDeep Nitsche Method: Deep Ritz Method with Essential Boundary ConditionsUnnamed ItemUnnamed ItemDeep Splitting Method for Parabolic PDEsA deep energy method for finite deformation hyperelasticityThe Random Feature Model for Input-Output Maps between Banach SpacesA machine learning framework for data driven acceleration of computations of differential equationsVariational Monte Carlo -- bridging concepts of machine learning and high-dimensional partial differential equationsAn energy approach to the solution of partial differential equations in computational mechanics via machine learning: concepts, implementation and applicationsSolving for high-dimensional committor functions using artificial neural networksSwitchNet: A Neural Network Model for Forward and Inverse Scattering ProblemsThe Gap between Theory and Practice in Function Approximation with Deep Neural NetworksSemiglobal optimal feedback stabilization of autonomous systems via deep neural network approximationEnhancing Accuracy of Deep Learning Algorithms by Training with Low-Discrepancy SequencesGalerkin Neural Networks: A Framework for Approximating Variational Equations with Error ControlMultilevel Fine-Tuning: Closing Generalization Gaps in Approximation of Solution Maps under a Limited Budget for Training DataA multi-level procedure for enhancing accuracy of machine learning algorithmsA Local Deep Learning Method for Solving High Order Partial Differential EquationsAlgorithms for solving high dimensional PDEs: from nonlinear Monte Carlo to machine learningDNN-MG: a hybrid neural network/finite element method with applications to 3D simulations of the Navier-Stokes equationsPhysics-informed graph neural network emulation of soft-tissue mechanicsThe random feature method for solving interface problemsConvergence Analysis of the Deep Galerkin Method for Weak SolutionsAONN: An Adjoint-Oriented Neural Network Method for All-At-Once Solutions of Parametric Optimal Control ProblemsNeural Control of Parametric Solutions for High-Dimensional Evolution PDEsOptimal Dirichlet boundary control by Fourier neural operators applied to nonlinear opticsA Reduced Order Schwarz Method for Nonlinear Multiscale Elliptic Equations Based on Two-Layer Neural NetworksIs the neural tangent kernel of PINNs deep learning general partial differential equations always convergent?The mathematics of artificial intelligenceSolving inverse problems with deep learningData-driven Whitney forms for structure-preserving control volume analysisOperator approximation of the wave equation based on deep learning of Green's functionPhysical informed neural networks with soft and hard boundary constraints for solving advection-diffusion equations using Fourier expansionsError assessment of an adaptive finite elements -- neural networks method for an elliptic parametric PDEDeep learning approximations for non-local nonlinear PDEs with Neumann boundary conditionsConvergence rate of DeepONets for learning operators arising from advection-diffusion equationsA method for representing periodic functions and enforcing exactly periodic boundary conditions with deep neural networksAdaptive two-layer ReLU neural network. II: Ritz approximation to elliptic PDEsSolving high-dimensional eigenvalue problems using deep neural networks: a diffusion Monte Carlo like approachOn some neural network architectures that can represent viscosity solutions of certain high dimensional Hamilton-Jacobi partial differential equationsA probabilistic generative model for semi-supervised training of coarse-grained surrogates and enforcing physical constraints through virtual observablesStructure probing neural network deflationDeep least-squares methods: an unsupervised learning-based numerical method for solving elliptic PDEsA derivative-free method for solving elliptic partial differential equations with deep neural networksInt-Deep: a deep learning initialized iterative method for nonlinear problemsSolving high-dimensional Hamilton-Jacobi-Bellman PDEs using neural networks: perspectives from the theory of controlled diffusions and measures on path spacePFNN: a penalty-free neural network method for solving a class of second-order boundary-value problems on complex geometriesBayesian sparse learning with preconditioned stochastic gradient MCMC and its applicationsMachine learning from a continuous viewpoint. IA Helmholtz equation solver using unsupervised learning: application to transcranial ultrasoundSelectNet: self-paced learning for high-dimensional partial differential equationsUsing neural networks to accelerate the solution of the Boltzmann equationA modified batch intrinsic plasticity method for pre-training the random coefficients of extreme learning machinesSPINN: sparse, physics-based, and partially interpretable neural networks for PDEsSolving and learning nonlinear PDEs with Gaussian processesMIM: a deep mixed residual method for solving high-order partial differential equationsA variational framework for computing Wannier functions using dictionary learningMeta-mgnet: meta multigrid networks for solving parameterized partial differential equationsSelf-adaptive deep neural network: numerical approximation to functions and PDEsThe mixed deep energy method for resolving concentration features in finite strain hyperelasticityA fast and accurate physics-informed neural network reduced order model with shallow masked autoencoderA semigroup method for high dimensional elliptic PDEs and eigenvalue problems based on neural networksAdaptive deep density approximation for Fokker-Planck equationsThermodynamically consistent physics-informed neural networks for hyperbolic systemsA deep learning framework for constitutive modeling based on temporal convolutional networkSimulation of the 3D hyperelastic behavior of ventricular myocardium using a finite-element based neural-network approachA neural network multigrid solver for the Navier-Stokes equationsOn quadrature rules for solving partial differential equations using neural networksNeural networks enforcing physical symmetries in nonlinear dynamical lattices: the case example of the Ablowitz-Ladik modelSolving Fredholm integral equations using deep learningComputing the invariant distribution of randomly perturbed dynamical systems using deep learningDiscovery of subdiffusion problem with noisy data via deep learningDeep neural network approximations for solutions of PDEs based on Monte Carlo algorithmsSolving eigenvalue PDEs of metastable diffusion processes using artificial neural networksSolving elliptic equations with Brownian motion: bias reduction and temporal difference learningSolving multiscale steady radiative transfer equation using neural networks with uniform stabilityUniform approximation rates and metric entropy of shallow neural networksLagrangian dual framework for conservative neural network solutions of kinetic equationsNumerical approximation of partial differential equations by a variable projection method with artificial neural networksLearning deep implicit Fourier neural operators (IFNOs) with applications to heterogeneous material modelingOvercoming the curse of dimensionality in the numerical approximation of parabolic partial differential equations with gradient-dependent nonlinearitiesScientific machine learning through physics-informed neural networks: where we are and what's nextMultilevel Picard approximations of high-dimensional semilinear partial differential equations with locally monotone coefficient functionsDeep neural networks based temporal-difference methods for high-dimensional parabolic partial differential equationsHomPINNs: Homotopy physics-informed neural networks for learning multiple solutions of nonlinear elliptic differential equationsSurrogate modeling for fluid flows based on physics-constrained deep learning without simulation dataDeep global model reduction learning in porous media flow simulationA proof that rectified deep neural networks overcome the curse of dimensionality in the numerical approximation of semilinear heat equationsPhysics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled dataA mesh-free method for interface problems using the deep learning approachModeling the dynamics of PDE systems with physics-constrained deep auto-regressive networksSolving electrical impedance tomography with deep learningSimulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networksDeep multiscale model learningAn immersed boundary neural network for solving elliptic equations with singular forces on arbitrary domainsOn the mixed boundary value problem for semilinear elliptic equationsSciANN: a Keras/Tensorflow wrapper for scientific computations and physics-informed deep learning using artificial neural networks\textit{hp}-VPINNs: variational physics-informed neural networks with domain decompositionOvercoming the curse of dimensionality in the numerical approximation of Allen-Cahn partial differential equations via truncated full-history recursive multilevel Picard approximationsEfficient approximation of solutions of parametric linear transport equations by ReLU DNNsA neural network-based policy iteration algorithm with global \(H^2\)-superlinear convergence for stochastic games on domainsTopological properties of the set of functions generated by neural networks of fixed sizeHierarchical deep-learning neural networks: finite elements and beyondA machine-learning minimal-residual (ML-MRes) framework for goal-oriented finite element discretizationsDeep autoencoder based energy method for the bending, vibration, and buckling analysis of Kirchhoff plates with transfer learningA deep learning improved numerical method for the simulation of rogue waves of nonlinear Schrödinger equationNumerical solution of the parametric diffusion equation by deep neural networksModel reduction and neural networks for parametric PDEsSolving the Kolmogorov PDE by means of deep learningApproximation rates for neural networks with encodable weights in smoothness spacesExact imposition of boundary conditions with distance functions in physics-informed deep neural networksPhyCRNet: physics-informed convolutional-recurrent network for solving spatiotemporal PDEsHiDeNN-TD: reduced-order hierarchical deep learning neural networksMosaic flows: a transferable deep learning framework for solving PDEs on unseen domainsPhysics-informed graph neural Galerkin networks: a unified framework for solving PDE-governed forward and inverse problemsDeep learning observables in computational fluid dynamicsWeak adversarial networks for high-dimensional partial differential equationsVariational training of neural network approximations of solution maps for physical modelsData driven approximation of parametrized PDEs by reduced basis and neural networksOvercoming the curse of dimensionality for some Hamilton-Jacobi partial differential equations via neural network architecturesCENN: conservative energy method based on neural networks with subdomains for solving variational problems involving heterogeneous and complex geometriesMonte Carlo fPINNs: deep learning method for forward and inverse problems involving high dimensional fractional partial differential equationsLearning phase field mean curvature flows with neural networksINN: interfaced neural networks as an accessible meshless approach for solving interface PDE problemsA priori and a posteriori error estimates for the deep Ritz method applied to the Laplace and Stokes problemEfficient coupled deep neural networks for the time-dependent coupled Stokes-Darcy problemsLookback option pricing under the double Heston model using a deep learning algorithmCommittor functions via tensor networksA non-gradient method for solving elliptic partial differential equations with deep neural networksPhysics-informed neural networks for shell structuresDiscrete gradient flow approximations of high dimensional evolution partial differential equations via deep neural networksUniform convergence guarantees for the deep Ritz method for nonlinear problemsOn stability and regularization for data-driven solution of parabolic inverse source problemsA deep domain decomposition method based on Fourier featuresTool path optimization of selective laser sintering processes using deep learningDNN expression rate analysis of high-dimensional PDEs: application to option pricing


Uses Software


Cites Work