Sparsity with sign-coherent groups of variables via the cooperative-Lasso
From MaRDI portal
(Redirected from Publication:439175)
Abstract: We consider the problems of estimation and selection of parameters endowed with a known group structure, when the groups are assumed to be sign-coherent, that is, gathering either nonnegative, nonpositive or null parameters. To tackle this problem, we propose the cooperative-Lasso penalty. We derive the optimality conditions defining the cooperative-Lasso estimate for generalized linear models, and propose an efficient active set algorithm suited to high-dimensional problems. We study the asymptotic consistency of the estimator in the linear regression setup and derive its irrepresentable conditions, which are milder than the ones of the group-Lasso regarding the matching of groups with the sparsity pattern of the true parameters. We also address the problem of model selection in linear regression by deriving an approximation of the degrees of freedom of the cooperative-Lasso estimator. Simulations comparing the proposed estimator to the group and sparse group-Lasso comply with our theoretical results, showing consistent improvements in support recovery for sign-coherent groups. We finally propose two examples illustrating the wide applicability of the cooperative-Lasso: first to the processing of ordinal variables, where the penalty acts as a monotonicity prior; second to the processing of genomic data, where the set of differentially expressed probes is enriched by incorporating all the probes of the microarray that are related to the corresponding genes.
Recommendations
- The Group Lasso for Logistic Regression
- Consistent group selection in high-dimensional linear regression
- Adaptive group Lasso for high-dimensional generalized linear models
- Coordinate descent algorithms for lasso penalized regression
- On the asymptotic properties of the group lasso estimator for linear models
Cites work
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
- An active set algorithm to estimate parameters in generalized linear models with ordered predictors
- Asymptotic Statistics
- Asymptotics for Lasso-type estimators.
- Averaged gene expressions for regression
- Better Subset Regression Using the Nonnegative Garrote
- Consistency of the group Lasso and multiple kernel learning
- Defining a robust biological prior from pathway analysis to drive network inference
- Estimation of the mean of a multivariate normal distribution
- Heuristics of instability and stabilization in model selection
- Inferring multiple graphical structures
- Least angle and \(\ell _{1}\) penalized regression: a review
- Model Selection and Estimation in Regression with Grouped Variables
- On the Non-Negative Garrotte Estimator
- On the ``degrees of freedom of the lasso
- On the asymptotic properties of the group lasso estimator for linear models
- Regularization and Variable Selection Via the Elastic Net
- Sparse modeling of categorial explanatory variables
- The Estimation of Prediction Error
- The Group Lasso for Logistic Regression
- The benefit of group sparsity
- The composite absolute penalties family for grouped and hierarchical variable selection
- Using cluster computers in bioinformatics research
Cited in
(7)- Additive monotone regression in high and lower dimensions
- ``Grouping strategies and thresholding for high dimensional linear models: rejoinder
- Monotone splines Lasso
- Regularization and model selection for quantile varying coefficient model with categorical effect modifiers
- Grouping strategies and thresholding for high dimensional linear models
- Partially linear monotone methods with automatic variable selection and monotonicity direction discovery
- A Two-Part Framework for Estimating Individualized Treatment Rules From Semicontinuous Outcomes
This page was built for publication: Sparsity with sign-coherent groups of variables via the cooperative-Lasso
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q439175)
