On the ``degrees of freedom of the lasso
From MaRDI portal
Publication:2466686
Abstract: We study the effective degrees of freedom of the lasso in the framework of Stein's unbiased risk estimation (SURE). We show that the number of nonzero coefficients is an unbiased estimate for the degrees of freedom of the lasso--a conclusion that requires no special assumption on the predictors. In addition, the unbiased estimator is shown to be asymptotically consistent. With these results on hand, various model selection criteria--, AIC and BIC--are available, which, along with the LARS algorithm, provide a principled and efficient approach to obtaining the optimal lasso fit with the computational effort of a single ordinary least-squares fit.
Recommendations
Cites work
- A new approach to variable selection in least squares problems
- Adapting to Unknown Smoothness via Wavelet Shrinkage
- Adaptive Model Selection
- Asymptotics for Lasso-type estimators.
- Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation
- Efficient Computation and Model Selection for the Support Vector Regression
- Estimating the dimension of a model
- Estimation of the mean of a multivariate normal distribution
- scientific article; zbMATH DE number 47282 (Why is no real title available?)
- scientific article; zbMATH DE number 1034037 (Why is no real title available?)
- scientific article; zbMATH DE number 3444596 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Least angle regression. (With discussion)
- Nonconcave penalized likelihood with a diverging number of parameters.
- On Measuring and Correcting the Effects of Data Mining and Model Selection
- On the degrees of freedom in shape-restricted regression.
- Optimal Model Assessment, Selection, and Combination
- Some Comments on C P
- Statistical challenges with high dimensionality: feature selection in knowledge discovery
- The elements of statistical learning. Data mining, inference, and prediction
- The Estimation of Prediction Error
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(only showing first 100 items - show all)- An algebraic characterization of the optimum of regularized kernel methods
- Penalized solutions to functional regression problems
- On the degrees of freedom in shrinkage estimation
- A nonlinear multi-dimensional variable selection method for high dimensional data: sparse MAVE
- The composite absolute penalties family for grouped and hierarchical variable selection
- An automated approach towards sparse single-equation cointegration modelling
- Estimator selection in the Gaussian setting
- Estimating treatment effect heterogeneity in randomized program evaluation
- Tuning parameter selection in sparse regression modeling
- Estimation of an oblique structure via penalized likelihood factor analysis
- Variable selection in general multinomial logit models
- Degrees of freedom for piecewise Lipschitz estimators
- Simultaneous dimension reduction and variable selection in modeling high dimensional data
- Variable selection and parameter estimation with the Atan regularization method
- Iteratively reweighted adaptive Lasso for conditional heteroscedastic time series with applications to AR-ARCH type processes
- The dual and degrees of freedom of linearly constrained generalized Lasso
- Generalized network psychometrics: combining network and latent variable models
- Variable selection and estimation using a continuous approximation to the \(L_0\) penalty
- Fast state-space methods for inferring dendritic synaptic connectivity
- Spatial weights matrix selection and model averaging for spatial autoregressive models
- Variable selection via generalized SELO-penalized Cox regression models
- Review: Reversed low-rank ANOVA model for transforming high dimensional genetic data into low dimension
- Regularization parameter selection for penalized empirical likelihood estimator
- On the sensitivity of the Lasso to the number of predictor variables
- On the exponentially weighted aggregate with the Laplace prior
- Least angle regression. (With discussion)
- Model selection via standard error adjusted adaptive Lasso
- LAD variable selection for linear models with randomly censored data
- Variable selection and parameter estimation for partially linear models via Dantzig selector
- Sparse least trimmed squares regression for analyzing high-dimensional large data sets
- Penalized wavelets: embedding wavelets into semiparametric regression
- Scale-constrained approaches for maximum likelihood estimation and model selection of clusterwise linear regression models
- Sparsity-promoting elastic net method with rotations for high-dimensional nonlinear inverse problem
- Debiasing the Lasso: optimal sample size for Gaussian designs
- On the degrees of freedom of mixed matrix regression
- Generalized \(\ell_1\)-penalized quantile regression with linear constraints
- A century of economic policy uncertainty through the French-Canadian Lens
- Boosted nonparametric hazards with time-dependent covariates
- Degrees of freedom for regularized regression with Huber loss and linear constraints
- Information criteria bias correction for group selection
- On the grouping effect of the \(l_{1-2}\) models
- High-dimensional asymptotics of likelihood ratio tests in the Gaussian sequence model under convex constraints
- Aggregated hold out for sparse linear regression with a robust loss function
- De-biasing the Lasso with degrees-of-freedom adjustment
- Degrees of freedom for off-the-grid sparse estimation
- Computing the degrees of freedom of rank-regularized estimators and cousins
- Generalized co-clustering analysis via regularized alternating least squares
- Prediction error after model search
- Best subset, forward stepwise or Lasso? Analysis and recommendations based on extensive comparisons
- On rereading Stein's lemma: its intrinsic connection with Cramér-Rao identity and some new identities
- Sparse regression for large data sets with outliers
- A significance test for the lasso
- Discussion: ``A significance test for the lasso
- Rejoinder: ``A significance test for the lasso
- Local behavior of sparse analysis regularization: applications to risk estimation
- From simple structure to sparse components: a review
- Discriminative variable selection for clustering with the sparse Fisher-EM algorithm
- Functional concurrent linear regression model for spatial images
- Estimating the rate constant from biosensor data via an adaptive variational Bayesian approach
- Degrees of freedom in submodular regularization: a computational perspective of Stein's unbiased risk estimate
- Effective new methods for automated parameter selection in regularized inverse problems
- AIC for the group Lasso in generalized linear models
- A note on the forward-Douglas-Rachford splitting for monotone inclusion and convex optimization
- Non-concave penalization in linear mixed-effect models and regularized selection of fixed effects
- Approximated penalized maximum likelihood for exploratory factor analysis: an orthogonal case
- A note on rank reduction in sparse multivariate regression
- Model-based clustering with sparse covariance matrices
- Lasso-type penalization in the framework of generalized additive models for location, scale and shape
- Generalized cross validation in variable selection with and without shrinkage
- Variable selection and estimation for semi-parametric multiple-index models
- Improved loss estimation for the lasso: a variable selection tool
- A penalty approach to differential item functioning in Rasch models
- Case influence diagnostics in the lasso regression
- SURE-tuned tapering estimation of large covariance matrices
- On the adaptive elastic net with a diverging number of parameters
- The degrees of freedom of partly smooth regularizers
- AIC for the non-concave penalized likelihood method
- A descent method for least absolute deviation Lasso problems
- Penalized model-based clustering
- Shrinkage estimation of partially linear single-index models
- Robust variable selection for nonlinear models with diverging number of parameters
- A sparse large margin semi-supervised learning method
- Lazy lasso for local regression
- Leave-one-out cross-validation is risk consistent for Lasso
- Some properties of generalized fused Lasso and its applications to high dimensional data
- Sparse estimation via nonconcave penalized likelihood in factor analysis model
- Wavelet-based gradient boosting
- On generalized degrees of freedom with application in linear mixed models selection
- On improved loss estimation for shrinkage estimators
- Greedy algorithms for prediction
- Parametric PSF estimation based on recursive SURE for sparse deconvolution
- Group-wise shrinkage estimation in penalized model-based clustering
- Quantile regression for single-index-coefficient regression models
- Weighted composite quantile regression for single-index models
- Low complexity regularization of linear inverse problems
- Bridge estimation for linear regression models with mixing properties
- Variable selection via the weighted group Lasso for factor analysis models
- Variable selection and estimation in generalized linear models with the seamless L₀ penalty
- Efficiency for Regularization Parameter Selection in Penalized Likelihood Estimation of Misspecified Models
- High-dimensional heteroscedastic regression with an application to eQTL data analysis
This page was built for publication: On the ``degrees of freedom of the lasso
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2466686)
