Post selection shrinkage estimation for high-dimensional data analysis
From MaRDI portal
(Redirected from Publication:4620187)
Abstract: In high-dimensional data settings where , many penalized regularization approaches were studied for simultaneous variable selection and estimation. However, with the existence of covariates with weak effect, many existing variable selection methods, including Lasso and its generations, cannot distinguish covariates with weak and no contribution. Thus, prediction based on a subset model of selected covariates only can be inefficient. In this paper, we propose a post selection shrinkage estimation strategy to improve the prediction performance of a selected subset model. Such a post selection shrinkage estimator (PSE) is data-adaptive and constructed by shrinking a post selection weighted ridge estimator in the direction of a selected candidate subset. Under an asymptotic distributional quadratic risk criterion, its prediction performance is explored analytically. We show that the proposed post selection PSE performs better than the post selection weighted ridge estimator. More importantly, it improves the prediction performance of any candidate subset model selected from most existing Lasso-type variable selection methods significantly. The relative performance of the post selection PSE is demonstrated by both simulation studies and real data analysis.
Recommendations
- Rejoinder to ``Post-selection shrinkage estimation for high-dimensional data analysis
- Efficient adaptive estimation strategies in high-dimensional partially linear regression models
- Prediction weighted maximum frequency selection
- scientific article; zbMATH DE number 7108807
- High dimensional thresholded regression and shrinkage effect
Cited in
(17)- Shrinkage estimation of semi-parametric spatial autoregressive panel data model with fixed effects
- High-dimensional causal mediation analysis based on partial linear structural equation models
- Rejoinder to ``Post-selection shrinkage estimation for high-dimensional data analysis
- A sufficient condition for the MSE dominance of the positive-part shrinkage estimator when each individual regression coefficient is estimated in a misspecified linear regression model
- Robust gene–environment interaction analysis using penalized trimmed regression
- Estimation of semiparametric regression model with right-censored high-dimensional data
- A bootstrap Lasso+partial ridge method to construct confidence intervals for parameters in high-dimensional sparse linear models
- Weak signals in high-dimensional regression: detection, estimation and prediction
- Likelihood adaptively modified penalties
- Shrinkage Estimation Strategies in Generalised Ridge Regression Models: Low/High‐Dimension Regime
- Penalised, post‐pretest, and post‐shrinkage strategies in nonlinear growth models
- A weak‐signal‐assisted procedure for variable selection and statistical inference with an informative subsample
- Pretest and shrinkage estimation of the regression parameter vector of the marginal model with multinomial responses
- A two-stage bridge estimator for regression models with endogeneity based on control function method
- Post high-dimensional shrinkage estimation for sparse generalized linear models
- Efficient and improved ridge-type shrinkage estimators in low and high dimensional Cox proportional hazards regression model
- Shrinkage estimation in linear mixed models for longitudinal data
This page was built for publication: Post selection shrinkage estimation for high-dimensional data analysis
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4620187)
