Sparse matrix linear models for structured high-throughput data

DOI10.1214/21-AOAS1444zbMATH Open1498.62232arXiv1712.05767WikidataQ114599236 ScholiaQ114599236MaRDI QIDQ2135347FDOQ2135347

Authors: Jane W. Liang, Śaunak Sen 

Publication date: 6 May 2022

Published in: The Annals of Applied Statistics (Search for Journal in Brave)

Abstract: Recent technological advancements have led to the rapid generation of high-throughput biological data, which can be used to address novel scientific questions in broad areas of research. These data can be thought of as a large matrix with covariates annotating both rows and columns of this matrix. Matrix linear models provide a convenient way for modeling such data. In many situations, sparse estimation of these models is desired. We present fast, general methods for fitting sparse matrix linear models to structured high-throughput data. We induce model sparsity using an L${}_1$ penalty and consider the case when the response matrix and the covariate matrices are large. Due to data size, standard methods for estimation of these penalized regression models fail if the problem is converted to the corresponding univariate regression scenario. By leveraging matrix properties in the structure of our model, we develop several fast estimation algorithms (coordinate descent, FISTA, and ADMM) and discuss their trade-offs. We evaluate our method's performance on simulated data, E. coli chemical genetic screening data, and two Arabidopsis genetic datasets with multivariate responses. Our algorithms have been implemented in the Julia programming language and are available at https://github.com/senresearch/MatrixLMnet.jl.

Full work available at URL: https://arxiv.org/abs/1712.05767

Recommendations

• L2RM: Low-Rank Linear Regression Models for High-Dimensional Matrix Responses
• Sparse Matrix Graphical Models
• scientific article; zbMATH DE number 7506682
• A sparse matrix approach to Bayesian computation in large linear models
• Structured Lasso for regression with matrix covariates

zbMATH Keywords

LassoADMMJuliagradient descentFISTAproximal gradient algorithms

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Linear regression; mixed models (62J05) Applications of statistics to biology and medical sciences; meta analysis (62P10) Convex programming (90C25) Ridge regression; shrinkage estimators (Lasso) (62J07)

Cites Work

• A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems
• Julia: a fresh approach to numerical computing
• Title not available (Why is that?)
• Least angle regression. (With discussion)
• Coordinate descent algorithms for lasso penalized regression
• Functional data analysis.
• Title not available (Why is that?)
• Distributed optimization and statistical learning via the alternating direction method of multipliers
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• A study of error variance estimation in Lasso regression
• Regularization and Variable Selection Via the Elastic Net
• Title not available (Why is that?)
• A differential equation for modeling Nesterov's accelerated gradient method: theory and insights
• Another look at the fast iterative shrinkage/thresholding algorithm (FISTA)
• Learning graphical models with hubs
• Adaptive FISTA for Nonconvex Optimization

Cited In (4)

• ANOVA Model Fitting via Sparse Matrix Computations: A Fast Direct Method
• MatrixLMnet
• Independent Component Analysis and Blind Signal Separation
• Streamlined solutions to multilevel sparse matrix problems

Uses Software

• R
• fda (R)
• glmnet
• data.table
• MESS
• limma
• hglasso
• Mutoss
• Julia
• selectiveInference
• R/qtl
• GitHub
• sma

This page was built for publication: Sparse matrix linear models for structured high-throughput data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2135347)