The loss rank criterion for variable selection in linear regression analysis
From MaRDI portal
Abstract: Lasso and other regularization procedures are attractive methods for variable selection, subject to a proper choice of shrinkage parameter. Given a set of potential subsets produced by a regularization algorithm, a consistent model selection criterion is proposed to select the best one among this preselected set. The approach leads to a fast and efficient procedure for variable selection, especially in high-dimensional settings. Model selection consistency of the suggested criterion is proven when the number of covariates d is fixed. Simulation studies suggest that the criterion still enjoys model selection consistency when d is much larger than the sample size. The simulations also show that our approach for variable selection works surprisingly well in comparison with existing competitors. The method is also applied to a real data set.
Recommendations
Cites work
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 46873 (Why is no real title available?)
- scientific article; zbMATH DE number 1034037 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A note on the Lasso and related procedures in model selection
- Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation
- Estimating the dimension of a model
- High-dimensional graphs and variable selection with the Lasso
- Invariance principles for sums of Banach space valued random elements and empirical processes
- Least angle regression. (With discussion)
- Model Selection and Multimodel Inference
- Model selection and error estimation
- Model selection with the loss rank principle
- On the ``degrees of freedom of the lasso
- On the distribution of penalized maximum likelihood estimators: the LASSO, SCAD, and thresholding
- Penalized maximum likelihood principle for choosing ridge parameter
- Rademacher penalties and structural risk minimization
- Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation
- Testing the order of a model
- The Adaptive Lasso and Its Oracle Properties
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Tuning parameter selectors for the smoothly clipped absolute deviation method
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(11)- Variable selection for functional regression models via the \(L_1\) regularization
- Application of shrinkage estimation in linear regression models with autoregressive errors
- Shrinkage, pretest, and penalty estimators in generalized linear models
- A loss-based prior for variable selection in linear regression methods
- A note on the Lasso and related procedures in model selection
- Improved variable selection with forward-lasso adaptive shrinkage
- Improved loss estimation for the lasso: a variable selection tool
- Variable selection and parameter estimation with the Atan regularization method
- Model selection with mixed variables on the Lasso path
- Consistent model selection criteria for quadratically supported risks
- The Loss Rank Principle for Model Selection
This page was built for publication: The loss rank criterion for variable selection in linear regression analysis
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2911677)
