Rodeo: Sparse, greedy nonparametric regression
From MaRDI portal
Publication:2477052
Abstract: We present a greedy method for simultaneously performing local bandwidth selection and variable selection in nonparametric regression. The method starts with a local linear estimator with large bandwidths, and incrementally decreases the bandwidth of variables for which the gradient of the estimator with respect to bandwidth is large. The method--called rodeo (regularization of derivative expectation operator)--conducts a sequence of hypothesis tests to threshold derivatives, and is easy to implement. Under certain assumptions on the regression function and sampling density, it is shown that the rodeo applied to local linear smoothing avoids the curse of dimensionality, achieving near optimal minimax rates of convergence in the number of relevant variables, as if these variables were isolated in advance.
Recommendations
Cites work
- 10.1162/15324430152748236
- A distribution-free theory of nonparametric regression
- Advances in neural information processing systems 17. Proceedings of the 2004 conference, Vancouver, BC, Canada, December 13--16, 2004.
- Asymptotics for Lasso-type estimators.
- Bandwidth choice for nonparametric regression
- Component Identification and Estimation in Nonlinear High-Dimensional Regression Models by Structural Adaptation
- Design-adaptive Nonparametric Regression
- Empirical-Bias Bandwidths for Local Polynomial Nonparametric Regression and Density Estimation
- For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution
- Greed is Good: Algorithmic Results for Sparse Approximation
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 1034042 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Just relax: convex programming methods for identifying sparse signals in noise
- Least angle regression. (With discussion)
- Model-Free Variable Selection
- Multivariate adaptive regression splines
- Multivariate locally weighted least squares regression
- Nonconcave penalized likelihood with a diverging number of parameters.
- Nonlinear estimation in anisotropic multi-index denoising
- Optimal spatial adaptation to inhomogeneous smoothness: An approach based on kernel estimates with variable bandwidth selectors
- Polynomial splines and their tensor products in extended linear modeling. (With discussions)
- Sparse boosting
- Structure adaptive approach for dimension reduction.
- The elements of statistical learning. Data mining, inference, and prediction
- Variable Selection and Model Building via Likelihood Basis Pursuit
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(42)- Fast Bayesian model assessment for nonparametric additive regression
- Variable selection of high-dimensional non-parametric nonlinear systems by derivative averaging to avoid the curse of dimensionality
- Variable selection with Hamming loss
- Selection of variables and dimension reduction in high-dimensional non-parametric regression
- Variable selection consistency of Gaussian process regression
- GRID: a variable selection and structure discovery method for high dimensional nonparametric regression
- Challenging the curse of dimensionality in multivariate local linear regression
- On robust cross-validation for nonparametric smoothing
- Minimax-optimal nonparametric regression in high dimensions
- Bandwidth matrix selectors for kernel regression
- Lazy lasso for local regression
- Sharp variable selection of a sparse submatrix in a high-dimensional noisy matrix
- Local polynomials for variable selection
- Sparse nonparametric model for regression with functional covariate
- Locally modelled regression and functional data
- Learning sparse gradients for variable selection and dimension reduction
- On the RODEO Method for Variable Selection
- scientific article; zbMATH DE number 7008335 (Why is no real title available?)
- A nonparametric procedure for linear and nonlinear variable screening
- Variable selection in heteroscedastic single-index quantile regression
- Kernel estimation of regression function gradient
- Kernel meets sieve: post-regularization confidence bands for sparse additive model
- Moving least squares regression for high-dimensional stochastic simulation metamodeling
- Minimal conditions for consistent variable selection in high dimension
- Input variable selection in neural network models
- Sparse nonparametric graphical models
- A spectral series approach to high-dimensional nonparametric regression
- An Outer-Product-of-Gradient Approach to Dimension Reduction and its Application to Classification in High Dimensional Space
- High-dimensional local polynomial regression with variable selection and dimension reduction
- Variable Selection Via Thompson Sampling
- Linear and nonlinear signal detection and estimation in high-dimensional nonparametric regression under weak sparsity
- High-dimensional local linear regression under sparsity and convex losses
- Contraction rates and projection subspace estimation with Gaussian process priors in high dimension
- Symmetry: a general structure in nonparametric regression
- Nonparametric additive value functions: interpretable reinforcement learning with an application to surgical recovery
- Adaptive Bayesian regression on data with low intrinsic dimensionality
- Variational Bayes neural networks for high-dimensional non parametric regression: Minimax optimality and adaptivity
- Inference with Mondrian random forests
- Linear and nonlinear variable selection by a non-penalized approach in ultra-high dimensions
- Tight conditions for consistency of variable selection in the context of high dimensionality
- Bias-corrected inference for multivariate nonparametric regression: model selection and oracle property
- Additive prediction and boosting for functional data
This page was built for publication: Rodeo: Sparse, greedy nonparametric regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2477052)
