Reduced rank vector generalized linear models for feature extraction

DOI10.4310/SII.2013.V6.N2.A4zbMATH Open1327.62431arXiv1007.3098MaRDI QIDQ897171FDOQ897171

Authors: Yiyuan She 

Publication date: 17 December 2015

Published in: Statistics and Its Interface (Search for Journal in Brave)

Abstract: Supervised linear feature extraction can be achieved by fitting a reduced rank multivariate model. This paper studies rank penalized and rank constrained vector generalized linear models. From the perspective of thresholding rules, we build a framework for fitting singular value penalized models and use it for feature extraction. Through solving the rank constraint form of the problem, we propose progressive feature space reduction for fast computation in high dimensions with little performance loss. A novel projective cross-validation is proposed for parameter tuning in such nonconvex setups. Real data applications are given to show the power of the methodology in supervised dimension reduction and feature extraction.

Full work available at URL: https://arxiv.org/abs/1007.3098

Recommendations

• Reduced-rank vector generalized linear models
• Reduced rank regression based on hard-thresholding singular value penalization
• Reduced-rank vector generalized linear models with two linear predictors
• Supervised singular value decomposition and its asymptotic properties
• Asymptotic theory for maximum likelihood estimates in reduced-rank multivariate generalized linear models

zbMATH Keywords

generalized linear modelsreduced rank regressionfeature extractionprogressive dimension reductionprojective crossvalidation

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Estimation in multivariate analysis (62H12) Ridge regression; shrinkage estimators (Lasso) (62J07) Generalized linear models (logistic models) (62J12)

Cited In (10)

• Generalized co-sparse factor regression
• A general framework for association analysis of heterogeneous data
• Reduced-rank vector generalized linear models with two linear predictors
• Rank reduction for high-dimensional generalized additive models
• Provable accelerated gradient method for nonconvex low rank optimization
• Reduced-rank vector generalized linear models
• Leveraging mixed and incomplete outcomes via reduced-rank modeling
• Ranked modelling on feature vectors with missing values
• Robust subtractive stability measures for fast and exhaustive feature importance ranking and selection in generalised linear models
• A note on rank reduction in sparse multivariate regression

This page was built for publication: Reduced rank vector generalized linear models for feature extraction

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q897171)