Consistent group selection in high-dimensional linear regression
From MaRDI portal
Abstract: In regression problems where covariates can be naturally grouped, the group Lasso is an attractive method for variable selection since it respects the grouping structure in the data. We study the selection and estimation properties of the group Lasso in high-dimensional settings when the number of groups exceeds the sample size. We provide sufficient conditions under which the group Lasso selects a model whose dimension is comparable with the underlying model with high probability and is estimation consistent. However, the group Lasso is, in general, not selection consistent and also tends to select groups that are not important in the model. To improve the selection results, we propose an adaptive group Lasso method which is a generalization of the adaptive Lasso and requires an initial estimator. We show that the adaptive group Lasso is consistent in group selection under certain conditions if the group Lasso is used as the initial estimator.
Recommendations
- Group selection in high-dimensional partially linear additive models
- Consistent tuning parameter selection in high-dimensional group-penalized regression
- Consistent group selection with Bayesian high dimensional modeling
- A selective review of group selection in high-dimensional models
- Group subset selection for linear regression
- Grouping strategies and thresholding for high dimensional linear models
- Consistent variable selection in high dimensional regression via multiple testing
- Model selection and estimation in high dimensional regression models with group SCAD
- Grouped variable screening for ultra-high dimensional data for linear model
- Concave group methods for variable selection and estimation in high-dimensional varying coefficient models
Cites work
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Adaptive Lasso for sparse high-dimensional regression models
- Asymptotic properties of bridge estimators in sparse high-dimensional regression models
- Asymptotics for Lasso-type estimators.
- Blockwise sparse regression
- Discussion: One-step sparse estimates in nonconcave penalized likelihood models
- Estimating the dimension of a model
- High-dimensional generalized linear models and the lasso
- High-dimensional graphs and variable selection with the Lasso
- Model Selection and Estimation in Regression with Grouped Variables
- Nonconcave penalized likelihood with a diverging number of parameters.
- Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
- Regularization and Variable Selection Via the Elastic Net
- Regularization of Wavelet Approximations
- The Adaptive Lasso and Its Oracle Properties
- The Group Lasso for Logistic Regression
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(81)- Grouping pursuit through a regularization solution surface
- Model selection and estimation in high dimensional regression models with group SCAD
- A note on adaptive group Lasso
- The Group Lasso for Logistic Regression
- Adaptive fused LASSO in grouped quantile regression
- Robust inference on average treatment effects with possibly more covariates than observations
- High-dimensional sign-constrained feature selection and grouping
- Group selection in high-dimensional partially linear additive models
- Robust group identification and variable selection in regression
- Trace regression model with simultaneously low rank and row(column) sparse parameter
- Optimal EMG placement for a robotic prosthesis controller with sequential, adaptive functional estimation (SAFE)
- Model determination and estimation for the growth curve model via group SCAD penalty
- Group variable selection via \(\ell_{p,0}\) regularization and application to optimal scoring
- Comments on ``Grouping strategies and thresholding for high dimension linear models
- Group Bound: Confidence Intervals for Groups of Variables in Sparse High Dimensional Regression Without Assumptions on the Design
- Identification of breast cancer prognosis markers via integrative analysis
- Consistent group selection with Bayesian high dimensional modeling
- Discussion of: ``Grouping strategies and thresholding for high dimension linear models
- Group coordinate descent algorithms for nonconvex penalized regression
- Log-Contrast Regression with Functional Compositional Predictors: Linking Preterm Infant's Gut Microbiome Trajectories to Neurobehavioral Outcome
- Sparse minimum discrepancy approach to sufficient dimension reduction with simultaneous variable selection in ultrahigh dimension
- Quantile regression with group Lasso for classification
- Sampling from non-smooth distributions through Langevin diffusion
- High-dimensional grouped folded concave penalized estimation via the LLA algorithm
- Shrinkage estimation of dynamic panel data models with interactive fixed effects
- Variable selection in partially linear additive hazards model with grouped covariates and a diverging number of parameters
- Determination of vector error correction models in high dimensions
- A group VISA algorithm for variable selection
- Group regularized estimation under structural hierarchy
- Some properties of generalized fused Lasso and its applications to high dimensional data
- Group subset selection for linear regression
- A high-dimensional M-estimator framework for bi-level variable selection
- Bi-level variable selection via adaptive sparse group Lasso
- Sharp oracle inequalities for low-complexity priors
- Sparsity identification for high-dimensional partially linear model with measurement error
- The degrees of freedom of partly smooth regularizers
- Sparsity with sign-coherent groups of variables via the cooperative-Lasso
- A selective review of group selection in high-dimensional models
- Sparse additive ordinary differential equations for dynamic gene regulatory network modeling
- Model Selection and Estimation in Regression with Grouped Variables
- A doubly sparse approach for group variable selection
- Model selection with low complexity priors
- Sparse optimization for nonconvex group penalized estimation
- Group screening for ultra-high-dimensional feature under linear model
- Grouping strategies and thresholding for high dimensional linear models
- A group bridge approach for variable selection
- Bridge regression: adaptivity and group selection
- Consistency of the group Lasso and multiple kernel learning
- Grouped variable screening for ultra-high dimensional data for linear model
- Optimal linear discriminators for the discrete choice model in growing dimensions
- On the oracle property of adaptive group Lasso in high-dimensional linear models
- A convex-Nonconvex strategy for grouped variable selection
- Within group variable selection through the exclusive Lasso
- Adaptive group Lasso for high-dimensional generalized linear models
- Consistent tuning parameter selection in high-dimensional group-penalized regression
- Robust group non-convex estimations for high-dimensional partially linear models
- A group adaptive elastic-net approach for variable selection in high-dimensional linear regression
- Concave group methods for variable selection and estimation in high-dimensional varying coefficient models
- Joint variable and rank selection for parsimonious estimation of high-dimensional matrices
- Adaptive group Lasso selection in quantile models
- Structural identification and variable selection in high-dimensional varying-coefficient models
- \(\ell_{2,0}\)-norm based selection and estimation for multivariate generalized linear models
- Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models
- Estimating high-dimensional regression models with bootstrap group penalties
- The log-linear group-lasso estimator and its asymptotic properties
- Penalized estimation of a class of single‐index varying‐coefficient models for integrative genomic analysis
- AIC for the group Lasso in generalized linear models
- An Interactive Greedy Approach to Group Sparsity in High Dimensions
- Group SLOPE – Adaptive Selection of Groups of Predictors
- Oracle efficient estimation of structural breaks in cointegrating regressions
- Automatic selection by penalized asymmetric L q -norm in a high-dimensional model with grouped variables
- Improved Estimation of High-dimensional Additive Models Using Subspace Learning
- Asymptotic properties of adaptive group Lasso for sparse reduced rank regression
- A structured brain‐wide and genome‐wide association study using ADNI PET images
- Detection of similar successive groups in a model with diverging number of variable groups
- Scalable efficient reproducible multi-task learning via data splitting
- Modeling association between multivariate correlated outcomes and high-dimensional sparse covariates: the adaptive SVS method
- Asymptotically faster estimation of high-dimensional additive models using subspace learning
- Adaptive elastic-net selection in a quantile model with diverging number of variable groups
- Tree-Guided Rare Feature Selection and Logic Aggregation with Electronic Health Records Data
- Grouped variable selection with discrete optimization: computational and statistical perspectives
This page was built for publication: Consistent group selection in high-dimensional linear regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q627307)
