Regression in Tensor Product Spaces by the Method of Sieves
From MaRDI portal
(Redirected from Publication:104871)
Abstract: Estimation of a conditional mean (linking a set of features to an outcome of interest) is a fundamental statistical task. While there is an appeal to flexible nonparametric procedures, effective estimation in many classical nonparametric function spaces (e.g., multivariate Sobolev spaces) can be prohibitively difficult -- both statistically and computationally -- especially when the number of features is large. In this paper, we present (penalized) sieve estimators for regression in nonparametric tensor product spaces: These spaces are more amenable to multivariate regression, and allow us to, in-part, avoid the curse of dimensionality. Our estimators can be easily applied to multivariate nonparametric problems and have appealing statistical and computational properties. Moreover, they can effectively leverage additional structures such as feature sparsity. In this manuscript, we give theoretical guarantees, indicating that the predictive performance of our estimators scale favorably in dimension. In addition, we also present numerical examples to compare the finite-sample performance of the proposed estimators with several popular machine learning methods.
Cites work
- scientific article; zbMATH DE number 3168214 (Why is no real title available?)
- scientific article; zbMATH DE number 5654889 (Why is no real title available?)
- scientific article; zbMATH DE number 45848 (Why is no real title available?)
- scientific article; zbMATH DE number 1822311 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 6438182 (Why is no real title available?)
- A local maximal inequality under uniform entropy
- A sieve stochastic gradient descent estimator for online nonparametric regression in Sobolev ellipsoids
- All of Nonparametric Statistics
- An Online Projection Estimator for Nonparametric Regression in Reproducing Kernel Hilbert Spaces
- Approximation of mixed order Sobolev functions on the \(d\)-torus: asymptotics, preasymptotics, and \(d\)-dependence
- Consistency of cross validation for comparing regression procedures
- Convergence rates of least squares regression estimators with heavy-tailed errors
- Curve fitting by polynomial-trigonometric regression
- Estimation and testing under sparsity. École d'Été de Probabilités de Saint-Flour XLV -- 2015
- From high oscillation to rapid approximation. IV: Accelerating convergence
- Function spaces with dominating mixed smoothness
- High-dimensional probability. An introduction with applications in data science
- High-dimensional statistics. A non-asymptotic viewpoint
- Hyperbolic cross approximation. Lecture notes given at the courses on constructive approximation and harmonic analysis, Barcelona, Spain, May 30 -- June 3, 2016
- Introduction to analytic and probabilistic number theory. Transl. from the 3rd French edition by Patrick D. F. Ion
- Introduction to nonparametric estimation
- Isotropic and dominating mixed Besov spaces: A comparison
- Kernel-based approximation methods using MATLAB
- Layer-wise learning strategy for nonparametric tensor product smoothing spline regression and graphical models
- Mercer's theorem on general domains: on the interaction between measures, kernels, and RKHSs
- Minimax Rates of Estimation for High-Dimensional Linear Regression Over $\ell_q$-Balls
- Minimax-optimal nonparametric regression in high dimensions
- Minimax-optimal rates for sparse additive models over kernel classes via convex programming
- Multivariate adaptive regression splines
- Multivariate approximation
- New reproducing kernel functions in the reproducing kernel Sobolev spaces
- Nonparametric curve estimation. Methods, theory, and applications
- Number of lattice points in the hyperbolic cross
- On the entropy numbers of the mixed smoothness function classes
- On the mathematical foundations of learning
- Optimal estimation in additive regression models
- Optimal global rates of convergence for nonparametric regression
- Probability in Banach spaces. Isoperimetry and processes
- Recent developments in the theory of function spaces with dominating mixed smoothness.
- Smoothing Spline ANOVA for Multivariate Bernoulli Observations With Application to Ophthalmology Data
- Smoothing spline ANOVA for exponential families, with application to the Wisconsin epidemiological study of diabetic retinopathy. (The 1994 Neyman Memorial Lecture)
- Smoothing spline ANOVA models for large data sets with Bernoulli observations and the randomized GACV.
- Sparse grids
- Spline interpolation on sparse grids
- Support Vector Machines
- Tensor product space ANOVA models.
- Tensor products of Sobolev-Besov spaces and applications to approximation from the hyperbolic cross
- Weak convergence and empirical processes. With applications to statistics
This page was built for publication: Regression in Tensor Product Spaces by the Method of Sieves
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q104871)
