A generalized least-square matrix decomposition
From MaRDI portal
Abstract: Variables in many massive high-dimensional data sets are structured, arising for example from measurements on a regular grid as in imaging and time series or from spatial-temporal measurements as in climate studies. Classical multivariate techniques ignore these structural relationships often resulting in poor performance. We propose a generalization of the singular value decomposition (SVD) and principal components analysis (PCA) that is appropriate for massive data sets with structured variables or known two-way dependencies. By finding the best low rank approximation of the data with respect to a transposable quadratic norm, our decomposition, entitled the Generalized least squares Matrix Decomposition (GMD), directly accounts for structural relationships. As many variables in high-dimensional settings are often irrelevant or noisy, we also regularize our matrix decomposition by adding two-way penalties to encourage sparsity or smoothness. We develop fast computational algorithms using our methods to perform generalized PCA (GPCA), sparse GPCA, and functional GPCA on massive data sets. Through simulations and a whole brain functional MRI example we demonstrate the utility of our methodology for dimension reduction, signal recovery, and feature selection with high-dimensional structured data.
Recommendations
- A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis
- A generalization of principal component analysis to K sets of variables.
- On consistency and sparsity for principal components analysis in high dimensions
- Sparse-smooth regularized singular value decomposition
- Sparse principal component analysis in Hilbert space
Cites work
- A likelihood ratio test for separability of covariances
- Bi-cross-validation of the SVD and the nonnegative matrix factorization
- Biclustering via sparse singular value decomposition
- scientific article; zbMATH DE number 1964693 (Why is no real title available?)
- Inference on low-rank data matrices with applications to microarray data
- Laplacian matrices of graphs: A survey
- Learning to decode cognitive states from brain images
- Local multidimensional scaling for nonlinear dimension reduction, graph drawing, and proximity analysis
- Matrix Analysis
- Model Selection and Estimation in Regression with Grouped Variables
- Multivariate data analysis: The French way
- On consistency and sparsity for principal components analysis in high dimensions
- On the ``degrees of freedom of the lasso
- On the degrees of freedom in shrinkage estimation
- On the inverses of some patterned matrices arising in the theory of stationary time series
- Smoothed functional principal components analysis by choice of norm
- Sparse principal component analysis via regularized low rank matrix approximation
- SparseNet: coordinate descent with nonconvex penalties
- Sparsity and Smoothness Via the Fused Lasso
- The analysis of two-way functional data using two-way regularized singular value decompositions
- The solution path of the generalized lasso
- The statistical analysis of fMRI data
- The statistical analysis of functional MRI data
- Transposable regularized covariance models with an application to missing data imputation
- Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Cited in
(32)- Accounting for time dependence in large-scale multiple testing of event-related potential data
- An oracle inequality for quasi-Bayesian nonnegative matrix factorization
- Matrix factorization for multivariate time series analysis
- Interpretability of composite indicators based on principal components
- Search for weights in the problem of finite-rank signal estimation in the presence of random noise
- SVD-based incremental approaches for recommender systems
- Blind deconvolution of covariance matrix inverses for autoregressive processes
- Adaptive gPCA: a method for structured dimensionality reduction with applications to microbiome data
- PLS for Big Data: a unified parallel algorithm for regularised group PLS
- Multiple correspondence analysis and the multilogit bilinear model
- Local-aggregate modeling for big data via distributed optimization: applications to neuroimaging
- Mathematical characterization of sophisticated variants for relevance learning in learning matrix quantization based on Schatten-p-norms
- Estimating a common period for a set of irregularly sampled functions with applications to periodic variable star data
- Weighted norms in subspace-based methods for time series analysis.
- Population value decomposition, a framework for the analysis of image populations
- Deconvolution of a discrete uniform distribution
- Heteroscedastic BART via Multiplicative Regression Trees
- Functional factor analysis for periodic remote sensing data
- Local biplots for multidimensional scaling, with application to the microbiome
- Discussion of the paper ‘A general framework for functional regression modelling’
- Multilevel Matrix-Variate Analysis and its Application to Accelerometry-Measured Physical Activity in Clinical Populations
- Generalized matrix decomposition regression: estimation and inference for two-way structured data
- Deviance matrix factorization
- Flow-directed PCA for monitoring networks
- Principal component analysis for river network data: use of spatiotemporal correlation and heterogeneous covariance structure
- A Bayesian Partially Observable Online Change Detection Approach with Thompson Sampling
- Statistical Foundations Driving 21st Century Innovation
- High-Dimensional Block Diagonal Covariance Structure Detection Using Singular Vectors
- Linear dimensionality reduction methods for analyzing structured biomedical data: existing research and future opportunities
- Feasible model-based principal component analysis: joint estimation of rank and error covariance matrix
- A sparse optimization approach for simultaneous orthogonal tensor diagonalization
- Application of the sequential matrix diagonalization algorithm to high-dimensional functional MRI data
This page was built for publication: A generalized least-square matrix decomposition
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4975339)
