Generalized orthogonal components regression for high dimensional generalized linear models

DOI10.1016/J.CSDA.2015.02.006MaRDI QIDQ1663286zbMATH OpenOpenAlexWikidataFDO

Authors Yanzhu Lin, Min Zhang, Dabao Zhang

Publication date 21 August 2018

Published in Computational Statistics and Data Analysis (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1304.4890

zbMATH Keywords

classificationcategorical datacollineardimension reduction multicollinear

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Generalized linear models (logistic models) (62J12)

Abstract: Here we propose an algorithm, named generalized orthogonal components regression (GOCRE), to explore the relationship between a categorical outcome and a set of massive variables. A set of orthogonal components are sequentially constructed to account for the variation of the categorical outcome, and together build up a generalized linear model (GLM). This algorithm can be considered as an extension of the partial least squares (PLS) for GLMs, but overcomes several issues of existing extensions based on iteratively reweighted least squares (IRLS). First, existing extensions construct a different set of components at each iteration and thus cannot provide a convergent set of components. Second, existing extensions are computationally intensive because of repetitively constructing a full set of components. Third, although they pursue the convergence of regression coefficients, the resultant regression coefficients may still diverge especially when building logistic regression models. GOCRE instead sequentially builds up each orthogonal component upon convergent construction, and simultaneously regresses against these orthogonal components to fit the GLM. The performance of the new method is demonstrated by both simulation studies and a real data example.

Recommendations

• Supervised component generalized linear regression using a PLS-extension of the Fisher scoring algorithm
• Penalized orthogonal-components regression for large \(p\) small \(n\) data
• PLS generalised linear regression
• Regularization and variable selection in categorical regression analyses.
• OLS with multiple high dimensional category variables

Cites work

• scientific article; zbMATH DE number 3885116 (Why is no real title available?)
• scientific article; zbMATH DE number 3518130 (Why is no real title available?)
• An invariant form for the prior probability in estimation problems
• Bias reduction of maximum likelihood estimates
• Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
• Handbook of partial least squares. Concepts, methods and applications.
• Iteratively Reweighted Partial Least Squares Estimation for Generalized Linear Regression
• On the existence of maximum likelihood estimates in logistic regression models
• Penalized orthogonal-components regression for large \(p\) small \(n\) data
• Sparse partial least squares classification for high dimensional data

Cited in

(3)

• Penalized orthogonal-components regression for large \(p\) small \(n\) data
• Supervised component generalized linear regression with multiple explanatory blocks: THEME-SCGLR
• OLS with multiple high dimensional category variables

This page was built for publication: Generalized orthogonal components regression for high dimensional generalized linear models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1663286)