Error bounds for approximations with deep ReLU networks
From MaRDI portal
Publication:2292227
DOI10.1016/j.neunet.2017.07.002zbMath1429.68260arXiv1610.01145OpenAlexW2528305538WikidataQ52559995 ScholiaQ52559995MaRDI QIDQ2292227
Publication date: 3 February 2020
Published in: Neural Networks (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1610.01145
Artificial neural networks and deep learning (68T07) Rate of convergence, degree of approximation (41A25)
Related Items (only showing first 100 items - show all)
Embedding Learning ⋮ Coupled Generation ⋮ Sharp Bounds for the Number of Regions of Maxout Networks and Vertices of Minkowski Sums ⋮ Low-rank approximation of continuous functions in Sobolev spaces with dominating mixed smoothness ⋮ Neural network approximation ⋮ A Proof that Artificial Neural Networks Overcome the Curse of Dimensionality in the Numerical Approximation of Black–Scholes Partial Differential Equations ⋮ Finite-Sample Two-Group Composite Hypothesis Testing via Machine Learning ⋮ Discretization of parameter identification in PDEs using neural networks ⋮ A deep learning approach to Reduced Order Modelling of parameter dependent partial differential equations ⋮ High-Dimensional Learning Under Approximate Sparsity with Applications to Nonsmooth Estimation and Regularized Neural Networks ⋮ High Order Deep Neural Network for Solving High Frequency Partial Differential Equations ⋮ Analysis of a Dynamical System Modeling Lasers and Applications for Optical Neural Networks ⋮ Theoretical issues in deep networks ⋮ Quantitative Approximation Results for Complex-Valued Neural Networks ⋮ Approximations with deep neural networks in Sobolev time-space ⋮ Convergence Rate Analysis for Deep Ritz Method ⋮ Deep ReLU Networks Overcome the Curse of Dimensionality for Generalized Bandlimited Functions ⋮ Full error analysis for the training of deep neural networks ⋮ Neural network interpolation operators activated by smooth ramp functions ⋮ Neural Parametric Fokker--Planck Equation ⋮ A note on the applications of one primary function in deep neural networks ⋮ Approximation bounds for norm constrained neural networks with applications to regression and GANs ⋮ Simultaneous neural network approximation for smooth functions ⋮ Deep Neural Networks for Solving Large Linear Systems Arising from High-Dimensional Problems ⋮ Neural network approximation: three hidden layers are enough ⋮ A deep network construction that adapts to intrinsic dimensionality beyond the domain ⋮ On the approximation of functions by tanh neural networks ⋮ Theory of deep convolutional neural networks. III: Approximating radial functions ⋮ Approximation capabilities of neural networks on unbounded domains ⋮ On the capacity of deep generative networks for approximating distributions ⋮ Getting away with more network pruning: from sparsity to geometry and linear regions ⋮ De Rham compatible deep neural network FEM ⋮ Randomized neural network with Petrov-Galerkin methods for solving linear and nonlinear partial differential equations ⋮ Deep ReLU neural network approximation in Bochner spaces and applications to parametric PDEs ⋮ Approximating smooth and sparse functions by deep neural networks: optimal approximation rates and saturation ⋮ Rates of approximation by ReLU shallow neural networks ⋮ Probabilistic partition of unity networks for high‐dimensional regression problems ⋮ Three ways to solve partial differential equations with neural networks — A review ⋮ A Neural Network Approach to High-Dimensional Optimal Switching Problems with Jumps in Energy Markets ⋮ Deep learning methods for partial differential equations and related parameter identification problems ⋮ A convergent deep learning algorithm for approximation of polynomials ⋮ Approximation theory of tree tensor networks: tensorized univariate functions ⋮ Neural network interpolation operators optimized by Lagrange polynomial ⋮ Convergence of deep convolutional neural networks ⋮ Fast convergence rates of deep neural networks for classification ⋮ On decision regions of narrow deep neural networks ⋮ Statistical guarantees for regularized neural networks ⋮ Deep ReLU neural networks in high-dimensional approximation ⋮ Neural network representation of time integrators ⋮ ReLU neural networks of polynomial size for exact maximum flow computation ⋮ Approximating Probability Distributions by Using Wasserstein Generative Adversarial Networks ⋮ Solving Elliptic Problems with Singular Sources Using Singularity Splitting Deep Ritz Method ⋮ Towards Lower Bounds on the Depth of ReLU Neural Networks ⋮ Exponential ReLU neural network approximation rates for point and edge singularities ⋮ DeepBHCP: deep neural network algorithm for solving backward heat conduction problems ⋮ Unnamed Item ⋮ Overall error analysis for the training of deep neural networks via stochastic gradient descent with random initialisation ⋮ Efficient estimation of average derivatives in NPIV models: simulation comparisons of neural network estimators ⋮ Deep Learning in High Dimension: Neural Network Expression Rates for Analytic Functions in \(\pmb{L^2(\mathbb{R}^d,\gamma_d)}\) ⋮ Learning sparse and smooth functions by deep sigmoid nets ⋮ Consistent Sparse Deep Learning: Theory and Computation ⋮ Error convergence and engineering-guided hyperparameter search of PINNs: towards optimized I-FENN performance ⋮ A mathematical perspective of machine learning ⋮ Data augmentation for Bayesian deep learning ⋮ Limitations of neural network training due to numerical instability of backpropagation ⋮ SignReLU neural network and its approximation ability ⋮ Deep Neural Networks with ReLU-Sine-Exponential Activations Break Curse of Dimensionality in Approximation on Hölder Class ⋮ Neural network interpolation operators of multivariate functions ⋮ Deep neural network classifier for multidimensional functional data ⋮ A Variational Neural Network Approach for Glacier Modelling with Nonlinear Rheology ⋮ Deep nonparametric estimation of intrinsic data structures by chart autoencoders: generalization error and robustness ⋮ A multivariate Riesz basis of ReLU neural networks ⋮ Collocation approximation by deep neural ReLU networks for parametric and stochastic PDEs with lognormal inputs ⋮ Improved Analysis of PINNs: Alleviate the CoD for Compositional Solutions ⋮ Connections between Operator-Splitting Methods and Deep Neural Networks with Applications in Image Segmentation ⋮ Error bounds for approximations using multichannel deep convolutional neural networks with downsampling ⋮ Lower bounds for artificial neural network approximations: a proof that shallow neural networks fail to overcome the curse of dimensionality ⋮ Meshless methods for American option pricing through physics-informed neural networks ⋮ Unnamed Item ⋮ Machine learning, alignment of covariant Lyapunov vectors, and predictability in Rikitake’s geomagnetic dynamo model ⋮ Deep ReLU networks and high-order finite element methods ⋮ Error bounds for approximations with deep ReLU neural networks in Ws,p norms ⋮ Rectified deep neural networks overcome the curse of dimensionality for nonsmooth value functions in zero-sum games of nonlinear stiff systems ⋮ Deep neural network expression of posterior expectations in Bayesian PDE inversion ⋮ Deep Network Approximation for Smooth Functions ⋮ Plateau Phenomenon in Gradient Descent Training of RELU Networks: Explanation, Quantification, and Avoidance ⋮ Better Approximations of High Dimensional Smooth Functions by Deep Neural Networks with Rectified Power Units ⋮ Dying ReLU and Initialization: Theory and Numerical Examples ⋮ Deep Network Approximation Characterized by Number of Neurons ⋮ Butterfly-Net: Optimal Function Representation Based on Convolutional Neural Networks ⋮ A Multi-Scale DNN Algorithm for Nonlinear Elliptic Equations with Multiple Scales ⋮ Non-Intrusive Reduced Order Modeling of Convection Dominated Flows Using Artificial Neural Networks with Application to Rayleigh-Taylor Instability ⋮ Equivalence of approximation by convolutional neural networks and fully-connected networks ⋮ Deep neural networks for rotation-invariance approximation and learning ⋮ Learnable Descent Algorithm for Nonsmooth Nonconvex Image Reconstruction ⋮ Deep ReLU neural networks overcome the curse of dimensionality for partial integrodifferential equations ⋮ Deep neural networks can stably solve high-dimensional, noisy, non-linear inverse problems ⋮ Approximating functions with multi-features by deep convolutional neural networks ⋮ Spline representation and redundancies of one-dimensional ReLU neural network models ⋮ Bi-fidelity modeling of uncertain and partially unknown systems using DeepONets
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Optimal nonlinear approximation
- Approximation properties of a multilayered feedforward artificial neural network
- Bounding the Vapnik-Chervonenkis dimension of concept classes parameterized by real numbers
- On the near optimality of the stochastic approximation of smooth functions by neural networks
- On the Uniform Convergence of Relative Frequencies of Events to Their Probabilities
- On the Expressive Power of Deep Architectures
- Lower Bounds for Approximation by Nonlinear Manifolds
This page was built for publication: Error bounds for approximations with deep ReLU networks
