Regularization after retention in ultrahigh dimensional linear regression models
From MaRDI portal
Abstract: In ultrahigh dimensional setting, independence screening has been both theoretically and empirically proved a useful variable selection framework with low computation cost. In this work, we propose a two-step framework by using marginal information in a different perspective from independence screening. In particular, we retain significant variables rather than screening out irrelevant ones. The new method is shown to be model selection consistent in the ultrahigh dimensional linear regression model. To improve the finite sample performance, we then introduce a three-step version and characterize its asymptotic behavior. Simulations and real data analysis show advantages of our method over independence screening and its iterative variants in certain regimes.
Recommendations
- Profile regularization after retention variable selection for ultrahigh dimensional partially linear models
- Regularization After Marginal Learning for Ultra-High Dimensional Regression Models
- High-dimensional linear regression via implicit regularization
- Max-linear regression models with regularization
- Regularization of linear regression problems
- Dimensionality Reduction, Regularization, and Generalization in Overparameterized Regressions
- Universality of regularized regression estimators in high dimensions
- On constrained and regularized high-dimensional regression
- Learning a high-dimensional linear structural equation model via _1-regularized regression
- High-dimensional linear regression with hard thresholding regularization: theory and algorithm
Cited in
(9)- Which bridge estimator is the best for variable selection?
- Nonparametric screening under conditional strictly convex loss for ultrahigh dimensional sparse data
- Partitioned Approach for High-dimensional Confidence Intervals with Large Split Sizes
- Variable Selection With Second-Generation P-Values
- Profile regularization after retention variable selection for ultrahigh dimensional partially linear models
- A weak‐signal‐assisted procedure for variable selection and statistical inference with an informative subsample
- RaSE: A Variable Screening Framework via Random Subspace Ensembles
- Sequential Scaled Sparse Factor Regression
- Targeting Predictors Via Partial Distance Correlation With Applications to Financial Forecasting
This page was built for publication: Regularization after retention in ultrahigh dimensional linear regression models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4626695)
