Consistent group selection in high-dimensional linear regression
From MaRDI portal
(Redirected from Publication:627307)
Abstract: In regression problems where covariates can be naturally grouped, the group Lasso is an attractive method for variable selection since it respects the grouping structure in the data. We study the selection and estimation properties of the group Lasso in high-dimensional settings when the number of groups exceeds the sample size. We provide sufficient conditions under which the group Lasso selects a model whose dimension is comparable with the underlying model with high probability and is estimation consistent. However, the group Lasso is, in general, not selection consistent and also tends to select groups that are not important in the model. To improve the selection results, we propose an adaptive group Lasso method which is a generalization of the adaptive Lasso and requires an initial estimator. We show that the adaptive group Lasso is consistent in group selection under certain conditions if the group Lasso is used as the initial estimator.
Recommendations
- Group selection in high-dimensional partially linear additive models
- Consistent tuning parameter selection in high-dimensional group-penalized regression
- Consistent group selection with Bayesian high dimensional modeling
- A selective review of group selection in high-dimensional models
- Group subset selection for linear regression
- Grouping strategies and thresholding for high dimensional linear models
- Consistent variable selection in high dimensional regression via multiple testing
- Model selection and estimation in high dimensional regression models with group SCAD
- Grouped variable screening for ultra-high dimensional data for linear model
- Concave group methods for variable selection and estimation in high-dimensional varying coefficient models
Cites work
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Adaptive Lasso for sparse high-dimensional regression models
- Asymptotic properties of bridge estimators in sparse high-dimensional regression models
- Asymptotics for Lasso-type estimators.
- Blockwise sparse regression
- Discussion: One-step sparse estimates in nonconcave penalized likelihood models
- Estimating the dimension of a model
- High-dimensional generalized linear models and the lasso
- High-dimensional graphs and variable selection with the Lasso
- Model Selection and Estimation in Regression with Grouped Variables
- Nonconcave penalized likelihood with a diverging number of parameters.
- Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
- Regularization and Variable Selection Via the Elastic Net
- Regularization of Wavelet Approximations
- The Adaptive Lasso and Its Oracle Properties
- The Group Lasso for Logistic Regression
- The sparsity and bias of the LASSO selection in high-dimensional linear regression
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(81)- Model determination and estimation for the growth curve model via group SCAD penalty
- Comments on ``Grouping strategies and thresholding for high dimension linear models
- Grouped variable screening for ultra-high dimensional data for linear model
- Shrinkage estimation of dynamic panel data models with interactive fixed effects
- Sparsity with sign-coherent groups of variables via the cooperative-Lasso
- Oracle efficient estimation of structural breaks in cointegrating regressions
- Discussion of: ``Grouping strategies and thresholding for high dimension linear models
- Consistent tuning parameter selection in high-dimensional group-penalized regression
- Grouping strategies and thresholding for high dimensional linear models
- High-dimensional grouped folded concave penalized estimation via the LLA algorithm
- On the oracle property of adaptive group Lasso in high-dimensional linear models
- Group selection in high-dimensional partially linear additive models
- Sparse additive ordinary differential equations for dynamic gene regulatory network modeling
- An Interactive Greedy Approach to Group Sparsity in High Dimensions
- Within group variable selection through the exclusive Lasso
- Determination of vector error correction models in high dimensions
- Optimal linear discriminators for the discrete choice model in growing dimensions
- Penalized estimation of a class of single‐index varying‐coefficient models for integrative genomic analysis
- Consistency of the group Lasso and multiple kernel learning
- A note on adaptive group Lasso
- Adaptive group Lasso for high-dimensional generalized linear models
- Group coordinate descent algorithms for nonconvex penalized regression
- The degrees of freedom of partly smooth regularizers
- Robust group non-convex estimations for high-dimensional partially linear models
- Grouping pursuit through a regularization solution surface
- Sharp oracle inequalities for low-complexity priors
- Sparse minimum discrepancy approach to sufficient dimension reduction with simultaneous variable selection in ultrahigh dimension
- A high-dimensional M-estimator framework for bi-level variable selection
- Grouped variable selection with discrete optimization: computational and statistical perspectives
- Adaptive elastic-net selection in a quantile model with diverging number of variable groups
- Detection of similar successive groups in a model with diverging number of variable groups
- Variable selection in partially linear additive hazards model with grouped covariates and a diverging number of parameters
- Adaptive fused LASSO in grouped quantile regression
- A structured brain‐wide and genome‐wide association study using ADNI PET images
- Structural identification and variable selection in high-dimensional varying-coefficient models
- Model selection with low complexity priors
- The Group Lasso for Logistic Regression
- Some properties of generalized fused Lasso and its applications to high dimensional data
- Adaptive group Lasso selection in quantile models
- A convex-Nonconvex strategy for grouped variable selection
- Robust group identification and variable selection in regression
- Trace regression model with simultaneously low rank and row(column) sparse parameter
- High-dimensional sign-constrained feature selection and grouping
- Optimal EMG placement for a robotic prosthesis controller with sequential, adaptive functional estimation (SAFE)
- Group screening for ultra-high-dimensional feature under linear model
- A group bridge approach for variable selection
- \(\ell_{2,0}\)-norm based selection and estimation for multivariate generalized linear models
- Bi-level variable selection via adaptive sparse group Lasso
- Convergence and sparsity of Lasso and group Lasso in high-dimensional generalized linear models
- Sparse optimization for nonconvex group penalized estimation
- Concave group methods for variable selection and estimation in high-dimensional varying coefficient models
- Tree-Guided Rare Feature Selection and Logic Aggregation with Electronic Health Records Data
- Modeling association between multivariate correlated outcomes and high-dimensional sparse covariates: the adaptive SVS method
- Identification of breast cancer prognosis markers via integrative analysis
- Automatic selection by penalized asymmetric L q -norm in a high-dimensional model with grouped variables
- Asymptotically faster estimation of high-dimensional additive models using subspace learning
- Model selection and estimation in high dimensional regression models with group SCAD
- A doubly sparse approach for group variable selection
- Group variable selection via \(\ell_{p,0}\) regularization and application to optimal scoring
- Group Bound: Confidence Intervals for Groups of Variables in Sparse High Dimensional Regression Without Assumptions on the Design
- Model Selection and Estimation in Regression with Grouped Variables
- A group VISA algorithm for variable selection
- The log-linear group-lasso estimator and its asymptotic properties
- Estimating high-dimensional regression models with bootstrap group penalties
- Sampling from non-smooth distributions through Langevin diffusion
- Improved Estimation of High-dimensional Additive Models Using Subspace Learning
- Group subset selection for linear regression
- Robust inference on average treatment effects with possibly more covariates than observations
- Log-Contrast Regression with Functional Compositional Predictors: Linking Preterm Infant's Gut Microbiome Trajectories to Neurobehavioral Outcome
- AIC for the group Lasso in generalized linear models
- A group adaptive elastic-net approach for variable selection in high-dimensional linear regression
- Sparsity identification for high-dimensional partially linear model with measurement error
- Joint variable and rank selection for parsimonious estimation of high-dimensional matrices
- Group SLOPE – Adaptive Selection of Groups of Predictors
- Asymptotic properties of adaptive group Lasso for sparse reduced rank regression
- Scalable efficient reproducible multi-task learning via data splitting
- Group regularized estimation under structural hierarchy
- A selective review of group selection in high-dimensional models
- Quantile regression with group Lasso for classification
- Bridge regression: adaptivity and group selection
- Consistent group selection with Bayesian high dimensional modeling
This page was built for publication: Consistent group selection in high-dimensional linear regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q627307)
