Lasso-type recovery of sparse representations for high-dimensional data

From MaRDI portal
Publication:1002157

DOI10.1214/07-AOS582zbMATH Open1155.62050arXiv0806.0145OpenAlexW3106266785WikidataQ105584243 ScholiaQ105584243MaRDI QIDQ1002157FDOQ1002157


Authors: Nicolai Meinshausen, Bin Yu Edit this on Wikidata


Publication date: 25 February 2009

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: The Lasso is an attractive technique for regularization and variable selection for high-dimensional data, where the number of predictor variables pn is potentially much larger than the number of samples n. However, it was recently discovered that the sparsity pattern of the Lasso estimator can only be asymptotically identical to the true sparsity pattern if the design matrix satisfies the so-called irrepresentable condition. The latter condition can easily be violated in the presence of highly correlated variables. Here we examine the behavior of the Lasso estimators if the irrepresentable condition is relaxed. Even though the Lasso cannot recover the correct sparsity pattern, we show that the estimator is still consistent in the ell2-norm sense for fixed designs under conditions on (a) the number sn of nonzero components of the vector and (b) the minimal singular values of design matrices that are induced by selecting small subsets of variables. Furthermore, a rate of convergence result is obtained on the ell2 error with an appropriate choice of the smoothing parameter. The rate is shown to be optimal under the condition of bounded maximal and minimal sparse eigenvalues. Our results imply that, with high probability, all important variables are selected. The set of selected variables is a meaningful reduction on the original set of variables. Finally, our results are illustrated with the detection of closely adjacent frequencies, a problem encountered in astrophysics.


Full work available at URL: https://arxiv.org/abs/0806.0145




Recommendations




Cites Work


Cited In (only showing first 100 items - show all)





This page was built for publication: Lasso-type recovery of sparse representations for high-dimensional data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1002157)