An introduction to the mathematics of deep learning
Asymptotic expansions of solutions to PDEs (35C20) Rate of convergence, degree of approximation (41A25) Approximation by other special function classes (41A30) General harmonic expansions, frames (42C15) Numerical aspects of computer graphics, image analysis, and computational geometry (65D18) Numerical solution to inverse problems in abstract spaces (65J22) Artificial neural networks and deep learning (68T07)
Summary: Despite the outstanding success of deep neural networks in real-world applications, ranging from science to public life, most of the related research is empirically driven and a comprehensive mathematical foundation is still missing. At the same time, these methods have already shown their impressive potential in mathematical research areas such as imaging sciences, inverse problems, or numerical analysis of partial differential equations, sometimes by far outperforming classical mathematical approaches for particular problem classes. The goal of this paper, which is based on a plenary lecture at the 8th European Congress of Mathematics in 2021, is to first provide an introduction into this new vibrant research area. We will then showcase some recent advances in two directions, namely the development of a mathematical foundation of deep learning and the introduction of novel deep learning-based approaches to solve inverse problems and partial differential equations. For the entire collection see [Zbl 1519.00033].
- The Modern Mathematics of Deep Learning
- Mathematical Aspects of Deep Learning
- Deep learning for inverse problems. Abstracts from the workshop held March 7--13, 2021 (hybrid meeting)
- Mini-workshop: Deep learning and inverse problems. Abstracts from the mini-workshop held March 4--10, 2018
- Selection dynamics for deep neural networks
- A logical calculus of the ideas immanent in nervous activity
- A theoretical analysis of deep neural networks and parametric PDEs
- Approximation by superpositions of a sigmoidal function
- Compactly supported shearlets are optimally sparse
- Deep Convolutional Neural Network for Inverse Problems in Imaging
- Extraction of digital wavefront sets using applied harmonic analysis and deep neural networks
- Introduction to shearlets
- Learning the invisible: a hybrid deep learning-shearlet framework for limited angle computed tomography
- Multilayer feedforward networks are universal approximators
- New tight frames of curvelets and optimal representations of objects with piecewise C2 singularities
- Numerical solution of the parametric diffusion equation by deep neural networks
- Optimal approximation with sparsely connected deep neural networks
- Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
- Resolution of the wavefront set using continuous shearlets
- Solving high-dimensional partial differential equations using deep learning
- Solving ill-posed inverse problems using iterative deep neural networks
- Sparse components of images and optimal atomic decompositions
- Ten Lectures on Wavelets
- The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems
- The Little Engine that Could: Regularization by Denoising (RED)
- Mini-workshop: Deep learning and inverse problems. Abstracts from the mini-workshop held March 4--10, 2018
- Special issue on the mathematical foundations of deep learning in imaging science
- Deep neural networks motivated by partial differential equations
- Selection dynamics for deep neural networks
- Deep learning for inverse problems. Abstracts from the workshop held March 7--13, 2021 (hybrid meeting)
- Deep Neural Networks in a Mathematical Framework
- Structure-preserving deep learning
- Mathematical Aspects of Deep Learning
- Topological approaches to deep learning
- Machine learning and computational mathematics
- Guide to Deep Learning Basics
- Deep learning: an introduction for applied mathematicians
- The Modern Mathematics of Deep Learning
- Fit without fear: remarkable mathematical phenomena of deep learning through the prism of interpolation
- A mathematical perspective of machine learning
- Deep learning and geometric deep learning: An introduction for mathematicians and physicists
- Connections between Operator-Splitting Methods and Deep Neural Networks with Applications in Image Segmentation
- The mathematics of artificial intelligence
- Differential equations for continuous-time deep learning
This page was built for publication: An introduction to the mathematics of deep learning
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6064555)
