Provable approximation properties for deep neural networks
From MaRDI portal
Publication:1742817
DOI10.1016/j.acha.2016.04.003zbMath1390.68553arXiv1509.07385OpenAlexW2267573953MaRDI QIDQ1742817
Alexander Cloninger, Uri Shaham, Ronald R. Coifman
Publication date: 12 April 2018
Published in: Applied and Computational Harmonic Analysis (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1509.07385
Learning and adaptive systems in artificial intelligence (68T05) Numerical methods for wavelets (65T60)
Related Items (62)
Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black--Scholes Partial Differential Equations ⋮ A Proof that Artificial Neural Networks Overcome the Curse of Dimensionality in the Numerical Approximation of Black–Scholes Partial Differential Equations ⋮ Approximations with deep neural networks in Sobolev time-space ⋮ Deep ReLU Networks Overcome the Curse of Dimensionality for Generalized Bandlimited Functions ⋮ Surgery of frames in Hilbert spaces ⋮ Full error analysis for the training of deep neural networks ⋮ Machine learning based data retrieval for inverse scattering problems with incomplete data ⋮ A note on the applications of one primary function in deep neural networks ⋮ Wavelet neural networks functional approximation and application ⋮ Theory of deep convolutional neural networks: downsampling ⋮ A deep network construction that adapts to intrinsic dimensionality beyond the domain ⋮ Theory of deep convolutional neural networks. III: Approximating radial functions ⋮ Rates of approximation by ReLU shallow neural networks ⋮ Deep learning methods for partial differential equations and related parameter identification problems ⋮ Approximation Analysis of Convolutional Neural Networks ⋮ Overall error analysis for the training of deep neural networks via stochastic gradient descent with random initialisation ⋮ Rapid estimation of permeability from digital rock using 3D convolutional neural network ⋮ Limitations of neural network training due to numerical instability of backpropagation ⋮ Analysis of time-frequency scattering transforms ⋮ Unnamed Item ⋮ Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on Hölder Class ⋮ Deep nonparametric estimation of intrinsic data structures by chart autoencoders: generalization error and robustness ⋮ Side effects of learning from low-dimensional data embedded in a Euclidean space ⋮ Neural network approximation and estimation of classifiers with classification boundary in a Barron class ⋮ Approximation of nonlinear functionals using deep ReLU networks ⋮ Quadratic Neural Networks for Solving Inverse Problems ⋮ Designing universal causal deep learning models: The geometric (Hyper)transformer ⋮ Error assessment of an adaptive finite elements -- neural networks method for an elliptic parametric PDE ⋮ Approximation with one-bit polynomials in Bernstein form ⋮ Deep ReLU networks and high-order finite element methods ⋮ Error bounds for approximations with deep ReLU neural networks in Ws,p norms ⋮ Approximation in shift-invariant spaces with deep ReLU neural networks ⋮ Product formalisms for measures on spaces with binary tree structures: representation, visualization, and multiscale noise ⋮ PDE-Net 2.0: learning PDEs from data with a numeric-symbolic hybrid deep network ⋮ Approximation Properties of Ridge Functions and Extreme Learning Machines ⋮ Unnamed Item ⋮ Deep Network Approximation Characterized by Number of Neurons ⋮ Multi-Scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains ⋮ Efficient approximation of solutions of parametric linear transport equations by ReLU DNNs ⋮ Numerical solution of the parametric diffusion equation by deep neural networks ⋮ Universality of deep convolutional neural networks ⋮ Gabor neural networks with proven approximation properties ⋮ Equivalence of approximation by convolutional neural networks and fully-connected networks ⋮ Error bounds for deep ReLU networks using the Kolmogorov-Arnold superposition theorem ⋮ Approximation rates for neural networks with encodable weights in smoothness spaces ⋮ Theory of deep convolutional neural networks. II: Spherical analysis ⋮ MgNet: a unified framework of multigrid and convolutional neural network ⋮ Deep hedging ⋮ Deep neural networks for rotation-invariance approximation and learning ⋮ Construct Deep Neural Networks based on Direct Sampling Methods for Solving Electrical Impedance Tomography ⋮ The construction and approximation of ReLU neural network operators ⋮ Deep learning volatility: a deep neural network perspective on pricing and calibration in (rough) volatility models ⋮ Stable recovery of entangled weights: towards robust identification of deep neural networks from minimal samples ⋮ A measure theoretical approach to the mean-field maximum principle for training NeurODEs ⋮ Optimal Approximation with Sparsely Connected Deep Neural Networks ⋮ Deep neural networks can stably solve high-dimensional, noisy, non-linear inverse problems ⋮ A theoretical analysis of deep neural networks and parametric PDEs ⋮ Nonlinear approximation and (deep) ReLU networks ⋮ Depth separations in neural networks: what is actually being separated? ⋮ Approximation spaces of deep neural networks ⋮ Robust and resource-efficient identification of two hidden layer neural networks ⋮ A New Function Space from Barron Class and Application to Neural Network Approximation
Cites Work
- Unnamed Item
- Networks and the best approximation property
- On the tractability of multivariate integration and approximation by neural networks
- Harmonic analysis on spaces of homogeneous type. With a preface by Yves Meyer
- An introduction to manifolds
- Approximation and learning by greedy algorithms
- Universal approximation bounds for superpositions of a sigmoidal function
- Comparison of worst case errors in linear and neural network approximation
- Approximation by superpositions of a sigmoidal function
This page was built for publication: Provable approximation properties for deep neural networks
