Generalized orthogonal components regression for high dimensional generalized linear models

DOI10.1016/J.CSDA.2015.02.006zbMATH Open1468.62123arXiv1304.4890OpenAlexW2075043630WikidataQ58170695 ScholiaQ58170695MaRDI QIDQ1663286FDOQ1663286

Dabao Zhang, Min Zhang, Yanzhu Lin

Publication date: 21 August 2018

Published in: Computational Statistics and Data Analysis (Search for Journal in Brave)

Abstract: Here we propose an algorithm, named generalized orthogonal components regression (GOCRE), to explore the relationship between a categorical outcome and a set of massive variables. A set of orthogonal components are sequentially constructed to account for the variation of the categorical outcome, and together build up a generalized linear model (GLM). This algorithm can be considered as an extension of the partial least squares (PLS) for GLMs, but overcomes several issues of existing extensions based on iteratively reweighted least squares (IRLS). First, existing extensions construct a different set of components at each iteration and thus cannot provide a convergent set of components. Second, existing extensions are computationally intensive because of repetitively constructing a full set of components. Third, although they pursue the convergence of regression coefficients, the resultant regression coefficients may still diverge especially when building logistic regression models. GOCRE instead sequentially builds up each orthogonal component upon convergent construction, and simultaneously regresses against these orthogonal components to fit the GLM. The performance of the new method is demonstrated by both simulation studies and a real data example.

Full work available at URL: https://arxiv.org/abs/1304.4890

Recommendations

• Supervised component generalized linear regression using a PLS-extension of the Fisher scoring algorithm
• Penalized orthogonal-components regression for large \(p\) small \(n\) data
• PLS generalised linear regression
• Regularization and variable selection in categorical regression analyses.
• OLS with multiple high dimensional category variables

zbMATH Keywords

classificationcategorical datacollineardimension reduction multicollinear

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Generalized linear models (logistic models) (62J12)

Cites Work

• Title not available (Why is that?)
• On the existence of maximum likelihood estimates in logistic regression models
• Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
• Title not available (Why is that?)
• Bias reduction of maximum likelihood estimates
• Penalized orthogonal-components regression for large \(p\) small \(n\) data
• Handbook of partial least squares. Concepts, methods and applications.
• Iteratively Reweighted Partial Least Squares Estimation for Generalized Linear Regression
• An invariant form for the prior probability in estimation problems
• Sparse partial least squares classification for high dimensional data

This page was built for publication: Generalized orthogonal components regression for high dimensional generalized linear models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1663286)