Low rank multivariate regression
From MaRDI portal
Abstract: We consider in this paper the multivariate regression problem, when the target regression matrix is close to a low rank matrix. Our primary interest in on the practical case where the variance of the noise is unknown. Our main contribution is to propose in this setting a criterion to select among a family of low rank estimators and prove a non-asymptotic oracle inequality for the resulting estimator. We also investigate the easier case where the variance of the noise is known and outline that the penalties appearing in our criterions are minimal (in some sense). These penalties involve the expected value of the Ky-Fan quasi-norm of some random matrices. These quantities can be evaluated easily in practice and upper-bounds can be derived from recent results in random matrix theory.
Recommendations
- Adaptive estimation of the rank of the coefficient matrix in high-dimensional multivariate response regression models
- Exponential weights in multivariate regression and a low-rankness favoring prior
- Optimal selection of reduced rank estimators of high-dimensional matrices
- scientific article; zbMATH DE number 7506682
- Rank penalized estimators for high-dimensional matrices
Cites work
- scientific article; zbMATH DE number 635657 (Why is no real title available?)
- Consistency of trace norm minimization
- Convex optimization methods for dimension reduction and coefficient estimation in multivariate linear regression
- Estimating Linear Restrictions on Regression Coefficients for Multivariate Normal Distributions
- Estimation of (near) low-rank matrices with noise and high-dimensional scaling
- Estimation of high-dimensional low-rank matrices
- Estimator selection in the Gaussian setting
- Local operator theory, random matrices and Banach spaces.
- Low rank multivariate regression
- Minimal penalties for Gaussian model selection
- Modern Multivariate Statistical Techniques
- Non-asymptotic theory of random matrices: extreme singular values
- Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion
- Optimal selection of reduced rank estimators of high-dimensional matrices
- Reduced-rank regression for the multivariate linear model
- The concentration of measure phenomenon
Cited in
(24)- High-dimensional regression with unknown variance
- Low rank multivariate regression
- Low-rank regularization in two-sided matrix regression
- Finding the largest low-rank clusters with Ky Fan 2-k-norm and _1-norm
- Low-rank matrix recovery with Ky Fan 2-\(k\)-norm
- On the convergence of rank-one multi-target linear regression
- Exponential weights in multivariate regression and a low-rankness favoring prior
- Adaptive estimation in multivariate response regression with hidden variables
- Variable selection in multivariate linear regression with random predictors
- Multivariate response regression with low-rank and generalized sparsity
- Adaptive estimation of the rank of the coefficient matrix in high-dimensional multivariate response regression models
- Minimax estimation in multi-task regression under low-rank structures
- scientific article; zbMATH DE number 7506682 (Why is no real title available?)
- Variational Gram functions: convex analysis and optimization
- Model-based regression clustering for high-dimensional data: application to functional data
- Sequential Scaled Sparse Factor Regression
- Rank penalized estimators for high-dimensional matrices
- Low-Rank Regression Models for Multiple Binary Responses and their Applications to Cancer Cell-Line Encyclopedia Data
- On estimation in the reduced-rank regression with a large number of responses and predictors
- Multi-task regression using minimal penalties
- Nuclear-norm penalization and optimal rates for noisy low-rank matrix completion
- scientific article; zbMATH DE number 7506686 (Why is no real title available?)
- Joint variable and rank selection for parsimonious estimation of high-dimensional matrices
- Estimators for multivariate allometric regression model
This page was built for publication: Low rank multivariate regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1952208)