Abstract: Although the Lasso has been extensively studied, the relationship between its prediction performance and the correlations of the covariates is not fully understood. In this paper, we give new insights into this relationship in the context of multiple linear regression. We show, in particular, that the incorporation of a simple correlation measure into the tuning parameter can lead to a nearly optimal prediction performance of the Lasso even for highly correlated covariates. However, we also reveal that for moderately correlated covariates, the prediction performance of the Lasso can be mediocre irrespective of the choice of the tuning parameter. We finally show that our results also lead to near-optimal rates for the least-squares estimator with total variation penalty.
Recommendations
Cited in
(68)- Strong Rules for Discarding Predictors in Lasso-Type Problems
- Approximate \(\ell_0\)-penalized estimation of piecewise-constant signals on graphs
- Logistic regression with total variation regularization
- Frame-constrained total variation regularization for white noise regression
- Orthogonal one step greedy procedure for heteroscedastic linear models
- Reconstruction of jointly sparse vectors via manifold optimization
- The DFS fused Lasso: linear-time denoising over general graphs
- Solution of linear ill-posed problems using overcomplete dictionaries
- Group sparse recovery via group square-root elastic net and the iterative multivariate thresholding-based algorithm
- Localized Gaussian width of \(M\)-convex hulls with applications to Lasso and convex aggregation
- Improving the prediction performance of the Lasso by subtracting the additive structural noises
- Corrected proof of the result of 'A prediction error property of the Lasso estimator and its generalization' by Huang (2003)
- Tensor denoising with trend filtering
- Estimation of Linear Functionals in High-Dimensional Linear Models: From Sparsity to Nonsparsity
- Adapting to unknown noise level in sparse deconvolution
- Adaptive estimation of multivariate piecewise polynomials and bounded variation functions by optimal decision trees
- scientific article; zbMATH DE number 7306926 (Why is no real title available?)
- Adaptive risk bounds in univariate total variation denoising and trend filtering
- On the prediction loss of the Lasso in the partially labeled setting
- Stabilizing the Lasso against cross-validation variability
- Canonical thresholding for nonsparse high-dimensional linear regression
- Inference for high-dimensional instrumental variables regression
- Multivariate extensions of isotonic regression and total variation denoising via entire monotonicity and Hardy-Krause variation
- Oracle inequalities for high-dimensional prediction
- Slope meets Lasso: improved oracle bounds and optimality
- Statistical guarantees for sparse deep learning
- Solution of linear ill-posed problems using random dictionaries
- ERM and RERM are optimal estimators for regression problems when malicious outliers corrupt the labels
- Sharp oracle inequalities for low-complexity priors
- Prediction and estimation consistency of sparse multi-class penalized optimal scoring
- Cross-validation with confidence
- High-dimensional latent panel quantile regression with an application to asset pricing
- Estimating piecewise monotone signals
- Lasso–type and Heuristic Strategies in Model Selection and Forecasting
- Prediction error bounds for linear regression with the TREX
- A Critical Review of LASSO and Its Derivatives for Variable Selection Under Dependence Among Covariates
- Tuning parameter calibration for _1-regularized logistic regression
- Ridge regression revisited: debiasing, thresholding and bootstrap
- On Lasso refitting strategies
- On the robustness of the generalized fused Lasso to prior specifications
- Finite impulse response models: a non-asymptotic analysis of the least squares estimator
- Statistical guarantees for regularized neural networks
- On the sensitivity of the Lasso to the number of predictor variables
- Exact spike train inference via \(\ell_{0}\) optimization
- Sample-Specific Learning of Lymphovascular Invasion with Heterogeneous Spatial Patterns
- A non-asymptotic analysis of the single component PLS regression
- Denoising over networks with applications to partially observed epidemics
- Element-wise estimation error of generalized Fused Lasso
- Ensemble Subset Regression (ENSURE): Efficient High-dimensional Prediction
- Binarsity: a penalization for one-hot encoded features in linear supervised learning
- Prediction bounds for higher order total variation regularized least squares
- Integrating additional knowledge into the estimation of graphical models
- On the exponentially weighted aggregate with the Laplace prior
- Removing the singularity of a penalty via thresholding function matching
- Sampling rates for ^1-synthesis
- On tight bounds for the Lasso
- Sharp optimality of sparse group LASSO and SLOPE under weaker assumptions
- scientific article; zbMATH DE number 7626791 (Why is no real title available?)
- Augmented direct learning for conditional average treatment effect estimation with double robustness
- Multivariate trend filtering for lattice data
- Variable selection under multicollinearity using modified log penalty
- Tuning parameter calibration for personalized prediction in medicine
- Sample-specific cooperative learning integrating heterogeneous radiomics and pathomics data
- Empirical priors and posterior concentration in a piecewise polynomial sequence model
- Penalized B-spline estimator for regression functions using total variation penalty
- Optimal two-step prediction in regression
- On the total variation regularized estimator over a class of tree graphs
- The Lasso with structured design and entropy of (absolute) convex hulls
This page was built for publication: On the prediction performance of the Lasso
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q502891)
