Degrees of freedom in lasso problems

DOI10.1214/12-AOS1003zbMath1274.62469arXiv1111.0653OpenAlexW3098272239MaRDI QIDQ447864

Ryan J. Tibshirani, Jonathan E. Taylor

Publication date: 29 August 2012

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1111.0653

zbMATH Keywords

Lasso high-dimensional degrees of freedom generalized Lasso

Mathematics Subject Classification ID

Ridge regression; shrinkage estimators (Lasso) (62J07) Optimality conditions and duality in mathematical programming (90C46)

Related Items (78)

High-dimensional asymptotics of likelihood ratio tests in the Gaussian sequence model under convex constraints ⋮ Greedy algorithms for prediction ⋮ On cross-validated Lasso in high dimensions ⋮ P-splines with an \(\ell_1\) penalty for repeated measures ⋮ Investigating competition in financial markets: a sparse autologistic model for dynamic network data ⋮ Structured regularization for conditional Gaussian graphical models ⋮ Testing conditional mean through regression model sequence using Yanai's generalized coefficient of determination ⋮ Aggregated hold out for sparse linear regression with a robust loss function ⋮ De-biasing the Lasso with degrees-of-freedom adjustment ⋮ Degrees of freedom for off-the-grid sparse estimation ⋮ On generalized degrees of freedom with application in linear mixed models selection ⋮ Recursive SURE for iterative reweighted least square algorithms ⋮ A deconvolution path for mixtures ⋮ Detection of multiple undocumented change-points using adaptive Lasso ⋮ Parameter choices for sparse regularization with the ℓ1 norm ^* ⋮ A Pliable Lasso ⋮ Spectrally Sparse Nonparametric Regression via Elastic Net Regularized Smoothers ⋮ Degrees of freedom for piecewise Lipschitz estimators ⋮ False Discovery Rate Smoothing ⋮ Homogeneity detection for the high-dimensional generalized linear model ⋮ A lasso for hierarchical interactions ⋮ Parametric PSF estimation based on recursive SURE for sparse deconvolution ⋮ The geometry of least squares in the 21st century ⋮ Selection model for domains across time: application to labour force survey by economic activities ⋮ The degrees of freedom of partly smooth regularizers ⋮ On the distribution, model selection properties and uniqueness of the Lasso estimator in low and high dimensions ⋮ Computing the degrees of freedom of rank-regularized estimators and cousins ⋮ Statistical properties of convex clustering ⋮ \( \chi^2\) test for total variation regularization parameter selection ⋮ Divided Differences, Falling Factorials, and Discrete Splines: Another Look at Trend Filtering and Related Problems ⋮ On the selection of predictors by using greedy algorithms and information theoretic criteria ⋮ A variable projection method for large-scale inverse problems with \(\ell^1\) regularization ⋮ Estimation of the Spatial Weighting Matrix for Spatiotemporal Data under the Presence of Structural Breaks ⋮ Regularized boxplot via convex clustering ⋮ Solution uniqueness of convex piecewise affine functions based optimization with applications to constrained ℓ₁ minimization ⋮ Likelihood-free inference by ratio estimation ⋮ Unnamed Item ⋮ Prediction error after model search ⋮ Statistical Learning for Individualized Asset Allocation ⋮ A cross-validation framework for signal denoising with applications to trend filtering, dyadic CART and beyond ⋮ SURE-tuned bridge regression ⋮ Quantile regression by dyadic CART ⋮ The Lasso problem and uniqueness ⋮ Estimation of nonbinary random response ⋮ Adaptive piecewise polynomial estimation via trend filtering ⋮ Best subset, forward stepwise or Lasso? Analysis and recommendations based on extensive comparisons ⋮ A new perspective on least squares under convex constraint ⋮ On Degrees of Freedom of Projection Estimators With Applications to Multivariate Nonparametric Regression ⋮ Sparsity-promoting elastic net method with rotations for high-dimensional nonlinear inverse problem ⋮ On the degrees of freedom of mixed matrix regression ⋮ A significance test for the lasso ⋮ Discussion: ``A significance test for the lasso ⋮ Rejoinder: ``A significance test for the lasso ⋮ Local behavior of sparse analysis regularization: applications to risk estimation ⋮ The generalized Lasso problem and uniqueness ⋮ MDR method for nonbinary response variable ⋮ Prediction risk for the horseshoe regression ⋮ Additive models with trend filtering ⋮ Low Complexity Regularization of Linear Inverse Problems ⋮ Leave-one-out cross-validation is risk consistent for Lasso ⋮ On the exponentially weighted aggregate with the Laplace prior ⋮ A study on tuning parameter selection for the high-dimensional lasso ⋮ Degrees of freedom in submodular regularization: a computational perspective of Stein's unbiased risk estimate ⋮ Estimator of prediction error based on approximate message passing for penalized linear regression ⋮ Automated data-driven selection of the hyperparameters for total-variation-based texture segmentation ⋮ Simulation and Analytical Approach to the Identification of Significant Factors ⋮ Second-order Stein: SURE for SURE and other applications in high-dimensional inference ⋮ The distribution of the Lasso: uniform control over sparse balls and adaptive parameter tuning ⋮ Algorithms for Fitting the Constrained Lasso ⋮ Excess Optimism: How Biased is the Apparent Error of an Estimator Tuned by SURE? ⋮ Spatially clustered varying coefficient model ⋮ Information criteria bias correction for group selection ⋮ Generalized cross validation in variable selection with and without shrinkage ⋮ Discussion: ``A significance test for the lasso ⋮ Discussion: ``A significance test for the lasso ⋮ Discussion: ``A significance test for the lasso ⋮ Discussion: ``A significance test for the lasso ⋮ Discussion: ``A significance test for the lasso

Uses Software

PDCO

Cites Work

This page was built for publication: Degrees of freedom in lasso problems