Sparse principal component regression for generalized linear models
From MaRDI portal
Abstract: Principal component regression (PCR) is a widely used two-stage procedure: principal component analysis (PCA), followed by regression in which the selected principal components are regarded as new explanatory variables in the model. Note that PCA is based only on the explanatory variables, so the principal components are not selected using the information on the response variable. In this paper, we propose a one-stage procedure for PCR in the framework of generalized linear models. The basic loss function is based on a combination of the regression loss and PCA loss. An estimate of the regression parameter is obtained as the minimizer of the basic loss function with a sparse penalty. We call the proposed method sparse principal component regression for generalized linear models (SPCR-glm). Taking the two loss function into consideration simultaneously, SPCR-glm enables us to obtain sparse principal component loadings that are related to a response variable. However, a combination of loss functions may cause a parameter identification problem, but this potential problem is avoided by virtue of the sparse penalty. Thus, the sparse penalty plays two roles in this method. The parameter estimation procedure is proposed using various update algorithms with the coordinate descent algorithm. We apply SPCR-glm to two real datasets, doctor visits data and mouse consomic strain data. SPCR-glm provides more easily interpretable principal component (PC) scores and clearer classification on PC plots than the usual PCA.
Recommendations
- Sparse principal component regression with adaptive loading
- Performances of some high dimensional regression methods: sparse principal component regression
- Bayesian principal component regression with data-driven component selection
- Principal component estimation for generalized linear regression
- Principal component-guided sparse regression
Cites work
- scientific article; zbMATH DE number 47310 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- A Direct Formulation for Sparse PCA Using Semidefinite Programming
- A Statistical View of Some Chemometrics Regression Tools
- A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis
- A penalized maximum likelihood approach to sparse factor analysis
- Classification of gene microarrays by penalized logistic regression
- Coordinate descent algorithms for lasso penalized regression
- Functional Principal Component Regression and Functional Partial Least Squares
- Kernel PCA for feature extraction and de-noising in nonlinear regression
- Least angle regression. (With discussion)
- PLS generalised linear regression
- Pathwise coordinate optimization
- Principal component analysis.
- Regularization and Variable Selection Via the Elastic Net
- Rotation to simple loadings using component loss functions: the oblique case
- Sparse estimation via nonconcave penalized likelihood in factor analysis model
- Sparse principal component regression with adaptive loading
- The Adaptive Lasso and Its Oracle Properties
Cited in
(13)- Fast deflation sparse principal component analysis via subspace projections
- Principal component-guided sparse regression
- Penalized principal logistic regression for sparse sufficient dimension reduction
- Supervised component generalized linear regression with multiple explanatory blocks: THEME-SCGLR
- Performances of some high dimensional regression methods: sparse principal component regression
- Principal component estimation for generalized linear regression
- Sparse principal component regression with adaptive loading
- Bayesian principal component regression with data-driven component selection
- Sparse Estimation of Generalized Linear Models (GLM) via Approximated Information Criteria
- Sparse principal component regression via singular value decomposition approach
- Hierarchical clustered multiclass discriminant analysis via cross-validation
- Estimation and visualization of heterogeneous treatment effects for multiple outcomes
- scientific article; zbMATH DE number 6866335 (Why is no real title available?)
This page was built for publication: Sparse principal component regression for generalized linear models
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1662867)
