Inference for sparse linear regression based on the leave-one-covariate-out solution path
From MaRDI portal
Abstract: We propose a new measure of variable importance in high-dimensional regression based on the change in the LASSO solution path when one covariate is left out. The proposed procedure provides a novel way to calculate variable importance and conduct variable screening. In addition, our procedure allows for the construction of P-values for testing whether each coefficient is equal to zero as well as for testing hypotheses involving multiple regression coefficients simultaneously; bootstrap techniques are used to construct the null distribution. For low-dimensional linear models, our method can achieve higher power than the -test. Extensive simulations are provided to show the effectiveness of our method. In the high-dimensional setting, our proposed solution path based test achieves greater power than some other recently developed high-dimensional inference methods.
Cites work
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A significance test for the lasso
- Bootstrapping Lasso estimators
- Comparison of Discrimination Methods for the Classification of Tumors Using Gene Expression Data
- Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
- Confidence intervals for low dimensional parameters in high dimensional linear models
- Covariate assisted screening and estimation
- Distribution-free predictive inference for regression
- High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
- High-dimensional variable screening and bias in subsequent inference, with an empirical comparison
- High-dimensional variable selection
- Nearly unbiased variable selection under minimax concave penalty
- Nonparametric independence screening in sparse ultra-high-dimensional additive models
- On asymptotically optimal confidence regions and tests for high-dimensional models
- On the existence of maximum likelihood estimates in logistic regression models
- Pathwise coordinate optimization
- Perturbation bootstrap in adaptive Lasso
- Random forests
- Rates of convergence of the adaptive LASSO estimators to the oracle distribution and higher order refinements by the bootstrap
- Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
- Sure independence screening in generalized linear models with NP-dimensionality
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
- \(p\)-values for high-dimensional regression
This page was built for publication: Inference for sparse linear regression based on the leave-one-covariate-out solution path
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6164734)