On deep learning as a remedy for the curse of dimensionality in nonparametric regression

DOI10.1214/18-AOS1747zbMath1421.62036OpenAlexW2946302218WikidataQ127815529 ScholiaQ127815529MaRDI QIDQ2313286

Michael Kohler, Benedikt Bauer

Publication date: 18 July 2019

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://projecteuclid.org/euclid.aos/1558425645

zbMATH Keywords

rate of convergenceneural networksnonparametric regressioncurse of dimensionality

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20)

Related Items

Statistical inference in sparse high-dimensional additive models, Mathematical foundations of machine learning. Abstracts from the workshop held March 21--27, 2021 (hybrid meeting), Convergence rates of deep ReLU networks for multiclass classification, Deep learning for the partially linear Cox model, Scientific machine learning through physics-informed neural networks: where we are and what's next, Intrinsic Dimension Adaptive Partitioning for Kernel Methods, Estimation of a regression function on a manifold by fully connected deep neural networks, A deep network construction that adapts to intrinsic dimensionality beyond the domain, A Deep Generative Approach to Conditional Sampling, The Kolmogorov-Arnold representation theorem revisited, Asymptotic properties of neural network sieve estimators, Sparse regression for low-dimensional time-dynamic varying coefficient models with application to air quality data, Consistent Sparse Deep Learning: Theory and Computation, Data augmentation for Bayesian deep learning, Drift estimation for a multi-dimensional diffusion process using deep neural networks, Convergence rates for shallow neural networks learned by gradient descent, Deep neural network classifier for multidimensional functional data, Individualized risk assessment of preoperative opioid use by interpretable neural network regression, Deep nonparametric regression on approximate manifolds: nonasymptotic error bounds with polynomial prefactors, On Learning and Convergence of RBF Networks in Regression Estimation and Classification, Deep learning for inverse problems with unknown operator, Can a Machine Correct Option Pricing Models?, Causal inference of general treatment effects using neural networks with a diverging number of confounders, Analysis of the rate of convergence of two regression estimates defined by neural features which are easy to implement, Intrinsic and extrinsic deep learning on manifolds, Multiclass classification for multidimensional functional data through deep neural networks, On the rate of convergence of a deep recurrent neural network estimate in a regression problem with dependent data, Unnamed Item, Nonparametric regression using deep neural networks with ReLU activation function, Analysis of the rate of convergence of fully connected deep neural network regression estimates with smooth activation function, Approximating smooth functions by deep neural networks with sigmoid activation function, Over-parametrized deep neural networks minimizing the empirical risk do not generalize well, Learning sparse deep neural networks with a spike-and-slab prior, A selective overview of deep learning, Estimation of an improved surrogate model in uncertainty quantification by neural networks, On the rate of convergence of fully connected deep neural network regression estimates, On deep learning as a remedy for the curse of dimensionality in nonparametric regression, Unnamed Item, On the rate of convergence of image classifiers based on convolutional neural networks, Measurement error models: from nonparametric methods to deep neural networks, High-performance statistical computing in the computing environments of the 2020s, Robust deep neural network estimation for multi-dimensional functional data, A new deep neural network algorithm for multiple stopping with applications in options pricing, Error bounds for ReLU networks with depth and width parameters, Analysis of convolutional neural network image classifiers in a hierarchical max-pooling model with additional local pooling, Approximating functions with multi-features by deep convolutional neural networks

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Additive regression and other nonparametric models
• Approximation and estimation bounds for artificial neural networks
• The use of polynomial splines and their tensor products in multivariate function estimation. (With discussion)
• Radial basis functions for the multivariate interpolation of large scattered data sets
• Optimal global rates of convergence for nonparametric regression
• A distribution-free theory of nonparametric regression
• Nonparametric regression using deep neural networks with ReLU activation function
• On deep learning as a remedy for the curse of dimensionality in nonparametric regression
• Optimal smoothing in single-index models
• Rate-optimal estimation for a general class of nonparametric regression models with unknown link functions
• Deep vs. shallow networks: An approximation theory perspective
• Adaptive regression estimation with multilayer feedforward neural networks
• Investigating Smooth Multiple Regression by the Method of Average Derivatives
• Variable selection for the single-index model
• Universal approximation bounds for superpositions of a sigmoidal function
• Penalized Spline Estimation for Partially Linear Single-Index Models
• Nonparametric estimation via empirical risk minimization
• Neural Network Learning
• Estimation of a Regression Function by Maxima of Minima of Linear Functions
• Nonparametric Regression Based on Hierarchical Interaction Models