A cluster elastic net for multivariate regression
From MaRDI portal
Abstract: We propose a method for estimating coefficients in multivariate regression when there is a clustering structure to the response variables. The proposed method includes a fusion penalty, to shrink the difference in fitted values from responses in the same cluster, and an L1 penalty for simultaneous variable selection and estimation. The method can be used when the grouping structure of the response variables is known or unknown. When the clustering structure is unknown the method will simultaneously estimate the clusters of the response and the regression coefficients. Theoretical results are presented for the penalized least squares case, including asymptotic results allowing for p >> n. We extend our method to the setting where the responses are binomial variables. We propose a coordinate descent algorithm for both the normal and binomial likelihood, which can easily be extended to other generalized linear model (GLM) settings. Simulations and data examples from business operations and genomics are presented to show the merits of both the least squares and binomial methods.
Recommendations
- MCEN: a method of simultaneous variable selection and clustering for high-dimensional multinomial regression
- scientific article; zbMATH DE number 6458363
- Clusterwise functional linear regression models
- Sparse regression with exact clustering
- Simultaneous multiple response regression and inverse covariance matrix estimation via penalized Gaussian maximum likelihood
Cites work
- A new approach to Cholesky-based covariance regularization in high dimensions
- A significance test for graph-constrained estimation
- A unified framework for high-dimensional analysis of M-estimators with decomposable regularizers
- Adaptive piecewise polynomial estimation via trend filtering
- Correlated variables in regression: clustering and sparse estimation
- Envelope models for parsimonious and efficient multivariate linear regression
- Extending the linear model with R. Generalized linear, mixed effects and nonparametric regression models.
- Foundations for envelope models and methods
- scientific article; zbMATH DE number 1086070 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- Indirect multivariate response linear regression
- Lasso-type recovery of sparse representations for high-dimensional data
- Model Selection and Estimation in Regression with Grouped Variables
- On the conditions used to prove oracle results for the Lasso
- Properties and refinements of the fused Lasso
- Regularization and Variable Selection Via the Elastic Net
- Regularized multivariate regression for identifying master predictors with application to integrative genomics study of breast cancer
- Ridge Regression: Biased Estimation for Nonorthogonal Problems
- Simultaneous analysis of Lasso and Dantzig selector
- Simultaneous multiple response regression and inverse covariance matrix estimation via penalized Gaussian maximum likelihood
- Sparsity and Smoothness Via the Fused Lasso
- SPReM: sparse projection regression model for high-dimensional linear regression
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- The sparse Laplacian shrinkage estimator for high-dimensional regression
- Tree-guided group lasso for multi-response regression with structured sparsity, with an application to eQTL mapping
- Variable selection and regression analysis for graph-structured covariates with an application to genomics
Cited in
(11)- Sparse regression with exact clustering
- A new globally convergent algorithm for non-Lipschitz \(\ell_{p}-\ell_q\) minimization
- Asymptotic properties of concave \(L_1\)-norm group penalties
- MCEN: a method of simultaneous variable selection and clustering for high-dimensional multinomial regression
- Grouping Variable Selection by Weight Fused Elastic Net for Multi-Collinear Data
- mcen
- Smooth and locally sparse estimation for multiple-output functional linear regression
- Group linear algorithm with sparse principal decomposition: a variable selection and clustering method for generalized linear models
- Clusterwise elastic-net regression based on a combined information criterion
- Sparse outlier-robust PCA for multi-source data
- Mixtures of probit regression models with overlapping clusters
This page was built for publication: A cluster elastic net for multivariate regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q63195)
