Correlated variables in regression: clustering and sparse estimation

DOI10.1016/j.jspi.2013.05.019zbMath1278.62103arXiv1209.5908OpenAlexW2040912306MaRDI QIDQ394080

Philipp Rütimann, Sara van de Geer, Cun-Hui Zhang, Peter Bühlmann

Publication date: 24 January 2014

Published in: Journal of Statistical Planning and Inference (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1209.5908

zbMATH Keywords

hierarchical clusteringvariable selectiongroup Lassohigh-dimensional inferenceoracle inequalityLassovariable screeningcanonical correlations

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Ridge regression; shrinkage estimators (Lasso) (62J07) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Linear regression; mixed models (62J05) Measures of association (correlation, canonical correlation, etc.) (62H20)

Related Items

Modeling association between multivariate correlated outcomes and high-dimensional sparse covariates: the adaptive SVS method, Semi-Standard Partial Covariance Variable Selection When Irrepresentable Conditions Fail, The cluster graphical Lasso for improved estimation of Gaussian graphical models, A component lasso, Extensions of stability selection using subsamples of observations and covariates, Robust grouped variable selection using distributionally robust optimization, Hierarchical inference for genome-wide association studies: a view on methodology with software, Bayesian linear regression with sparse priors, Group linear algorithm with sparse principal decomposition: a variable selection and clustering method for generalized linear models, Evolution of high-frequency systematic trading: a performance-driven gradient boosting model, A clustering-based feature selection method for automatically generated relational attributes, The Trimmed Lasso: Sparse Recovery Guarantees and Practical Optimization by the Generalized Soft-Min Penalty, Correlation and variable importance in random forests, A Cluster Elastic Net for Multivariate Regression, A General Framework for Estimation and Inference From Clusters of Features, Weak signals in high‐dimensional regression: Detection, estimation and prediction, MCEN: a method of simultaneous variable selection and clustering for high-dimensional multinomial regression, Spatially relaxed inference on high-dimensional linear models, Graph-Based Regularization for Regression Problems with Alignment and Highly Correlated Designs

Uses Software

• glasso
• glmnet
• hgam

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• The Adaptive Lasso and Its Oracle Properties
• Statistics for high-dimensional data. Methods, theory and applications.
• The sparse Laplacian shrinkage estimator for high-dimensional regression
• Rejoinder: One-step sparse estimates in nonconcave penalized likelihood models
• The sparsity and bias of the LASSO selection in high-dimensional linear regression
• Lasso-type recovery of sparse representations for high-dimensional data
• Relaxed Lasso
• High-dimensional additive modeling
• Finding predictive gene groups from microarray data
• On the conditions used to prove oracle results for the Lasso
• Sparse regression with exact clustering
• Simultaneous analysis of Lasso and Dantzig selector
• High-dimensional graphs and variable selection with the Lasso
• Scaled sparse linear regression
• PARTIAL CORRELATION AND CONDITIONAL CORRELATION AS MEASURES OF CONDITIONAL INDEPENDENCE
• Regularization and Variable Selection Via the Elastic Net
• Model Selection and Estimation in Regression with Grouped Variables
• Simultaneous Regression Shrinkage, Variable Selection, and Supervised Clustering of Predictors with OSCAR
• The Lasso, correlated design, and improved oracle inequalities