A cluster elastic net for multivariate regression
From MaRDI portal
(Redirected from Publication:63195)
Abstract: We propose a method for estimating coefficients in multivariate regression when there is a clustering structure to the response variables. The proposed method includes a fusion penalty, to shrink the difference in fitted values from responses in the same cluster, and an L1 penalty for simultaneous variable selection and estimation. The method can be used when the grouping structure of the response variables is known or unknown. When the clustering structure is unknown the method will simultaneously estimate the clusters of the response and the regression coefficients. Theoretical results are presented for the penalized least squares case, including asymptotic results allowing for p >> n. We extend our method to the setting where the responses are binomial variables. We propose a coordinate descent algorithm for both the normal and binomial likelihood, which can easily be extended to other generalized linear model (GLM) settings. Simulations and data examples from business operations and genomics are presented to show the merits of both the least squares and binomial methods.
Recommendations
- MCEN: a method of simultaneous variable selection and clustering for high-dimensional multinomial regression
- scientific article; zbMATH DE number 6458363
- Clusterwise functional linear regression models
- Sparse regression with exact clustering
- Simultaneous multiple response regression and inverse covariance matrix estimation via penalized Gaussian maximum likelihood
Cites work
- scientific article; zbMATH DE number 1086070 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A new approach to Cholesky-based covariance regularization in high dimensions
- A significance test for graph-constrained estimation
- A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers
- Adaptive piecewise polynomial estimation via trend filtering
- Correlated variables in regression: clustering and sparse estimation
- Envelope models for parsimonious and efficient multivariate linear regression
- Extending the linear model with R. Generalized linear, mixed effects and nonparametric regression models.
- Foundations for envelope models and methods
- Indirect multivariate response linear regression
- Lasso-type recovery of sparse representations for high-dimensional data
- Model Selection and Estimation in Regression with Grouped Variables
- On the conditions used to prove oracle results for the Lasso
- Properties and refinements of the fused Lasso
- Regularization and Variable Selection Via the Elastic Net
- Regularized multivariate regression for identifying master predictors with application to integrative genomics study of breast cancer
- Ridge Regression: Biased Estimation for Nonorthogonal Problems
- SPReM: sparse projection regression model for high-dimensional linear regression
- Simultaneous analysis of Lasso and Dantzig selector
- Simultaneous multiple response regression and inverse covariance matrix estimation via penalized Gaussian maximum likelihood
- Sparsity and Smoothness Via the Fused Lasso
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- The sparse Laplacian shrinkage estimator for high-dimensional regression
- Tree-guided group lasso for multi-response regression with structured sparsity, with an application to eQTL mapping
- Variable selection and regression analysis for graph-structured covariates with an application to genomics
Cited in
(9)- A new globally convergent algorithm for non-Lipschitz \(\ell_{p}-\ell_q\) minimization
- Sparse regression with exact clustering
- Clusterwise elastic-net regression based on a combined information criterion
- Grouping Variable Selection by Weight Fused Elastic Net for Multi-Collinear Data
- mcen
- Smooth and locally sparse estimation for multiple-output functional linear regression
- Group linear algorithm with sparse principal decomposition: a variable selection and clustering method for generalized linear models
- Asymptotic properties of concave \(L_1\)-norm group penalties
- MCEN: a method of simultaneous variable selection and clustering for high-dimensional multinomial regression
This page was built for publication: A cluster elastic net for multivariate regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q63195)
