Integrative multi-view regression: bridging group-sparse and low-rank models

DOI10.1111/BIOM.13006zbMATH Open1436.62588arXiv1807.10375OpenAlexW2901357766WikidataQ93232582 ScholiaQ93232582MaRDI QIDQ5214519FDOQ5214519

Kun Chen, Xiao-Kang Liu, Gen Li

Publication date: 7 February 2020

Published in: Biometrics (Search for Journal in Brave)

Abstract: Multi-view data have been routinely collected in various fields of science and engineering. A general problem is to study the predictive association between multivariate responses and multi-view predictor sets, all of which can be of high dimensionality. It is likely that only a few views are relevant to prediction, and the predictors within each relevant view contribute to the prediction collectively rather than sparsely. We cast this new problem under the familiar multivariate regression framework and propose an integrative reduced-rank regression (iRRR), where each view has its own low-rank coefficient matrix. As such, latent features are extracted from each view in a supervised fashion. For model estimation, we develop a convex composite nuclear norm penalization approach, which admits an efficient algorithm via alternating direction method of multipliers. Extensions to non-Gaussian and incomplete data are discussed. Theoretically, we derive non-asymptotic oracle bounds of iRRR under a restricted eigenvalue condition. Our results recover oracle bounds of several special cases of iRRR including Lasso, group Lasso and nuclear norm penalized regression. Therefore, iRRR seamlessly bridges group-sparse and low-rank methods and can achieve substantially faster convergence rate under realistic settings of multi-view learning. Simulation studies and an application in the Longitudinal Studies of Aging further showcase the efficacy of the proposed methods.

Full work available at URL: https://arxiv.org/abs/1807.10375

Recommendations

• scientific article; zbMATH DE number 7506682
• Structural learning and integrative decomposition of multi-view data
• Sparse reduced-rank regression with covariance estimation
• Reduced rank regression via adaptive nuclear norm penalization
• Bayesian sparse reduced rank multivariate regression

zbMATH Keywords

nuclear normgroup selectionmulti-view learningcomposite penalizationintegrative multivariate analysis

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10) Estimation in multivariate analysis (62H12)

Cited In (7)

• Integrated subgroup identification from multi-source data
• Integrative Factor Regression and Its Inference for Multimodal Data Analysis
• Orthogonalized Kernel Debiased Machine Learning for Multimodal Data Analysis
• Multivariate log-contrast regression with sub-compositional predictors: testing the association between preterm infants' gut microbiome and neurobehavioral outcomes
• Sparse and integrative principal component analysis for multiview data
• Integrative sparse reduced-rank regression via orthogonal rotation for analysis of high-dimensional multi-source data
• Large-scale multivariate sparse regression with applications to UK Biobank

This page was built for publication: Integrative multi-view regression: bridging group-sparse and low-rank models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5214519)