Provable approximation properties for deep neural networks

DOI10.1016/j.acha.2016.04.003zbMath1390.68553arXiv1509.07385MaRDI QIDQ1742817

Alexander Cloninger, Uri Shaham, Ronald R. Coifman

Publication date: 12 April 2018

Published in: Applied and Computational Harmonic Analysis (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1509.07385

zbMATH Keywords

wavelets; neural nets; function approximation

Mathematics Subject Classification ID

68T05: Learning and adaptive systems in artificial intelligence

65T60: Numerical methods for wavelets

Related Items

Unnamed Item, Unnamed Item, Construct Deep Neural Networks based on Direct Sampling Methods for Solving Electrical Impedance Tomography, Deep learning volatility: a deep neural network perspective on pricing and calibration in (rough) volatility models, Optimal Approximation with Sparsely Connected Deep Neural Networks, Analysis of the Generalization Error: Empirical Risk Minimization over Deep Artificial Neural Networks Overcomes the Curse of Dimensionality in the Numerical Approximation of Black--Scholes Partial Differential Equations, Approximations with deep neural networks in Sobolev time-space, Deep ReLU Networks Overcome the Curse of Dimensionality for Generalized Bandlimited Functions, Surgery of frames in Hilbert spaces, Full error analysis for the training of deep neural networks, A note on the applications of one primary function in deep neural networks, Wavelet neural networks functional approximation and application, Deep ReLU networks and high-order finite element methods, Error bounds for approximations with deep ReLU neural networks in Ws,p norms, Product formalisms for measures on spaces with binary tree structures: representation, visualization, and multiscale noise, Approximation Properties of Ridge Functions and Extreme Learning Machines, Deep Network Approximation Characterized by Number of Neurons, Multi-Scale Deep Neural Network (MscaleDNN) for Solving Poisson-Boltzmann Equation in Complex Domains, Equivalence of approximation by convolutional neural networks and fully-connected networks, Deep hedging, Deep neural networks for rotation-invariance approximation and learning, Deep neural networks can stably solve high-dimensional, noisy, non-linear inverse problems, A New Function Space from Barron Class and Application to Neural Network Approximation, A Proof that Artificial Neural Networks Overcome the Curse of Dimensionality in the Numerical Approximation of Black–Scholes Partial Differential Equations, A deep network construction that adapts to intrinsic dimensionality beyond the domain, Theory of deep convolutional neural networks. III: Approximating radial functions, Rates of approximation by ReLU shallow neural networks, Deep learning methods for partial differential equations and related parameter identification problems, Approximation Analysis of Convolutional Neural Networks, Overall error analysis for the training of deep neural networks via stochastic gradient descent with random initialisation, Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on Hölder Class, Neural network approximation and estimation of classifiers with classification boundary in a Barron class, Approximation of nonlinear functionals using deep ReLU networks, Approximation in shift-invariant spaces with deep ReLU neural networks, Efficient approximation of solutions of parametric linear transport equations by ReLU DNNs, Numerical solution of the parametric diffusion equation by deep neural networks, Gabor neural networks with proven approximation properties, Error bounds for deep ReLU networks using the Kolmogorov-Arnold superposition theorem, Approximation rates for neural networks with encodable weights in smoothness spaces, Theory of deep convolutional neural networks. II: Spherical analysis, The construction and approximation of ReLU neural network operators, Stable recovery of entangled weights: towards robust identification of deep neural networks from minimal samples, A measure theoretical approach to the mean-field maximum principle for training NeurODEs, A theoretical analysis of deep neural networks and parametric PDEs, Nonlinear approximation and (deep) ReLU networks, Depth separations in neural networks: what is actually being separated?, Approximation spaces of deep neural networks, Robust and resource-efficient identification of two hidden layer neural networks, Theory of deep convolutional neural networks: downsampling, Rapid estimation of permeability from digital rock using 3D convolutional neural network, PDE-Net 2.0: learning PDEs from data with a numeric-symbolic hybrid deep network, Universality of deep convolutional neural networks, MgNet: a unified framework of multigrid and convolutional neural network, Analysis of time-frequency scattering transforms, Machine learning based data retrieval for inverse scattering problems with incomplete data, Side effects of learning from low-dimensional data embedded in a Euclidean space, Approximation with one-bit polynomials in Bernstein form

Cites Work