Theoretical properties of the overlapping groups Lasso
From MaRDI portal
Abstract: We present two sets of theoretical results on the grouped lasso with overlap of Jacob, Obozinski and Vert (2009) in the linear regression setting. This method allows for joint selection of predictors in sparse regression, allowing for complex structured sparsity over the predictors encoded as a set of groups. This flexible framework suggests that arbitrarily complex structures can be encoded with an intricate set of groups. Our results show that this strategy results in unexpected theoretical consequences for the procedure. In particular, we give two sets of results: (1) finite sample bounds on prediction and estimation, and (2) asymptotic distribution and selection. Both sets of results give insight into the consequences of choosing an increasingly complex set of groups for the procedure, as well as what happens when the set of groups cannot recover the true sparsity pattern. Additionally, these results demonstrate the differences and similarities between the the grouped lasso procedure with and without overlapping groups. Our analysis shows the set of groups must be chosen with caution - an overly complex set of groups will damage the analysis.
Recommendations
Cites work
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Asymptotics for Lasso-type estimators.
- Consistency of the group Lasso and multiple kernel learning
- Learning with Structured Sparsity
- Model Selection and Estimation in Regression with Grouped Variables
- On the asymptotic properties of the group lasso estimator for linear models
- Regularized multivariate regression for identifying master predictors with application to integrative genomics study of breast cancer
- Simultaneous analysis of Lasso and Dantzig selector
- Some theoretical results on the grouped variables Lasso
- Structured variable selection with sparsity-inducing norms
- Structured, sparse regression with application to HIV drug resistance
- The Adaptive Lasso and Its Oracle Properties
- The benefit of group sparsity
- The composite absolute penalties family for grouped and hierarchical variable selection
- Weak convergence and empirical processes. With applications to statistics
Cited in
(13)- Variable selection based on squared derivative averages
- Some theoretical results on the grouped variables Lasso
- High-dimensional generalized linear models incorporating graphical structure among predictors
- Overlapping group lasso for high-dimensional generalized linear models
- Incorporating Graphical Structure of Predictors in Sparse Quantile Regression
- scientific article; zbMATH DE number 7306867 (Why is no real title available?)
- A penalized two-pass regression to predict stock returns with time-varying risk premia
- High-dimensional expectile regression incorporating graphical structure among predictors
- An Efficient Algorithm for Minimizing Multi Non-Smooth Component Functions
- Support union recovery in high-dimensional multivariate regression
- Structured sparsity through convex optimization
- A selective review of group selection in high-dimensional models
- Overlapped groupwise dimension reduction
This page was built for publication: Theoretical properties of the overlapping groups Lasso
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1950815)
