Deep Learning: An Introduction for Applied Mathematicians

DOI10.1137/18M1165748zbMath1440.68214arXiv1801.05894OpenAlexW2963459284WikidataQ126836083 ScholiaQ126836083MaRDI QIDQ5243183

Catherine F. Higham, Desmond J. Higham

Publication date: 15 November 2019

Published in: SIAM Review (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1801.05894

zbMATH Keywords

sigmoid convolution neural network supervised learning backpropagation chain rule image classification overfitting stochastic gradient method

Mathematics Subject Classification ID

Artificial neural networks and deep learning (68T07) Numerical optimization and variational techniques (65K10) Learning and adaptive systems in artificial intelligence (68T05) Algorithms for approximation of functions (65D15)

Related Items (36)

On a multilevel Levenberg–Marquardt method for the training of artificial neural networks and its application to the solution of partial differential equations ⋮ Uniformly convex neural networks and non-stationary iterated network Tikhonov (iNETT) method ⋮ PFNN: a penalty-free neural network method for solving a class of second-order boundary-value problems on complex geometries ⋮ Generalization Error Analysis of Neural Networks with Gradient Based Regularization ⋮ Machine learning and reduced order computation of a friction stir welding model ⋮ Physics-informed neural networks for the shallow-water equations on the sphere ⋮ \(S\)-frame discrepancy correction models for data-informed Reynolds stress closure ⋮ Machine learning moment closure models for the radiative transfer equation. I: Directly learning a gradient based closure ⋮ Deep Unfitted Nitsche Method for Elliptic Interface Problems ⋮ A data-driven shock capturing approach for discontinuous Galerkin methods ⋮ Discovering phase field models from image data with the pseudo-spectral physics informed neural networks ⋮ Sublinear Convergence of a Tamed Stochastic Gradient Descent Method in Hilbert Space ⋮ Control on the manifolds of mappings with a view to the deep learning ⋮ An introduction to deep generative modeling ⋮ A literature survey of matrix methods for data science ⋮ Deep limits of residual neural networks ⋮ Neural control of discrete weak formulations: Galerkin, least squares \& minimal-residual methods with quasi-optimal weights ⋮ Deep CNNs as universal predictors of elasticity tensors in homogenization ⋮ Using deep neural networks for detecting spurious oscillations in discontinuous Galerkin solutions of convection-dominated convection-diffusion equations ⋮ Time discretization in the solution of parabolic PDEs with ANNs ⋮ Physics-informed deep learning for simultaneous surrogate modeling and PDE-constrained optimization of an airfoil geometry ⋮ Uncertainty quantification in scientific machine learning: methods, metrics, and comparisons ⋮ A deep learning approach to the inversion of borehole resistivity measurements ⋮ Knowledge-informed neuro-integrators for aggregation kinetics ⋮ DeepBND: a machine learning approach to enhance multiscale solid mechanics ⋮ Machine learning architectures for price formation models ⋮ Adaptive non-intrusive reduced order modeling for compressible flows ⋮ Solving Allen-Cahn and Cahn-Hilliard Equations using the Adaptive Physics Informed Neural Networks ⋮ A machine-learning minimal-residual (ML-MRes) framework for goal-oriented finite element discretizations ⋮ Deep learning as optimal control problems: models and numerical methods ⋮ Classification with Runge-Kutta networks and feature space augmentation ⋮ Solving inverse problems using data-driven models ⋮ LSPIA, (stochastic) gradient descent, and parameter correction ⋮ Neural ODEs as the deep limit of ResNets with constant weights ⋮ Bilevel optimization, deep learning and fractional Laplacian regularization with applications in tomography ⋮ Matching Component Analysis for Transfer Learning

Uses Software

Cites Work

This page was built for publication: Deep Learning: An Introduction for Applied Mathematicians