Joint estimation of precision matrices in heterogeneous populations

DOI10.1214/16-EJS1137zbMATH Open1341.62130arXiv1601.00142WikidataQ38803110 ScholiaQ38803110MaRDI QIDQ302425FDOQ302425

Authors: Takumi Saegusa, Ali Shojaie 

Publication date: 5 July 2016

Published in: Electronic Journal of Statistics (Search for Journal in Brave)

Abstract: We introduce a general framework for estimation of inverse covariance, or precision, matrices from heterogeneous populations. The proposed framework uses a Laplacian shrinkage penalty to encourage similarity among estimates from disparate, but related, subpopulations, while allowing for differences among matrices. We propose an efficient alternating direction method of multipliers (ADMM) algorithm for parameter estimation, as well as its extension for faster computation in high dimensions by thresholding the empirical covariance matrix to identify the joint block diagonal structure in the estimated precision matrices. We establish both variable selection and norm consistency of the proposed estimator for distributions with exponential or polynomial tails. Further, to extend the applicability of the method to the settings with unknown populations structure, we propose a Laplacian penalty based on hierarchical clustering, and discuss conditions under which this data-driven choice results in consistent estimation of precision matrices in heterogenous populations. Extensive numerical studies and applications to gene expression data from subtypes of cancer with distinct clinical outcomes indicate the potential advantages of the proposed method over existing approaches.

Full work available at URL: https://arxiv.org/abs/1601.00142

Recommendations

• Joint estimation of multiple high-dimensional precision matrices
• Joint estimation of multiple precision matrices with common structures
• Estimation of multiple networks in Gaussian mixture models
• On regularized estimation methods for precision and covariance matrix and statistical network inference
• Promote sign consistency in the joint estimation of precision matrices

zbMATH Keywords

sparsityprecision matrixhierarchical clusteringhigh-dimensional estimationgraph Laplaciangraphical modelingheterogeneous populations

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Applications of statistics to biology and medical sciences; meta analysis (62P10) Estimation in multivariate analysis (62H12) Ridge regression; shrinkage estimators (Lasso) (62J07)

Cites Work

• Title not available (Why is that?)
• Distributed optimization and statistical learning via the alternating direction method of multipliers
• High-dimensional graphs and variable selection with the Lasso
• Title not available (Why is that?)
• Trend filtering on graphs
• A significance test for graph-constrained estimation
• A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers
• Variable selection and regression analysis for graph-structured covariates with an application to genomics
• The sparse Laplacian shrinkage estimator for high-dimensional regression
• Sparse inverse covariance estimation with the graphical lasso
• Sparse permutation invariant covariance estimation
• Model selection and estimation in the Gaussian graphical model
• Title not available (Why is that?)
• Concentration inequalities. A nonasymptotic theory of independence
• \(\ell_{1}\)-penalization for mixture regression models
• Penalized likelihood methods for estimation of sparse high-dimensional directed acyclic graphs
• The composite absolute penalties family for grouped and hierarchical variable selection
• Joint estimation of multiple graphical models
• Bayesian inference of multiple Gaussian graphical models
• High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence
• High dimensional inverse covariance matrix estimation via linear programming
• A constrained \(\ell _{1}\) minimization approach to sparse precision matrix estimation
• First-Order Methods for Sparse Covariance Selection
• Asymptotics of hierarchical clustering for growing dimension
• Bayesian variable selection in structured high-dimensional covariate spaces with applications in genomics
• Bayesian regularization via graph Laplacian

Cited In (29)

• Testing the differential network between two gaussian graphical models with false discovery rate control
• Joint Gaussian graphical model estimation: a survey
• Compressed spectral screening for large-scale differential correlation analysis with application in selecting glioblastoma gene modules
• Promote sign consistency in the joint estimation of precision matrices
• Title not available (Why is that?)
• Targeted fused ridge estimation of inverse covariance matrices from multiple high-dimensional data classes
• Covariate-adjusted inference for differential analysis of high-dimensional networks
• Common reducing subspace model and network alternation analysis
• Joint estimation of multiple precision matrices with common structures
• Bayesian graphical models for modern biological applications
• Penalized estimation of threshold auto-regressive models with many components and thresholds
• Fitting Laplacian regularized stratified Gaussian models
• Structured learning of time-varying networks with application to \(\mathrm{PM}_{2.5}\) data
• Bayesian Edge Regression in Undirected Graphical Models to Characterize Interpatient Heterogeneity in Cancer
• Detecting clusters in multivariate response regression
• The cluster D-trace loss for differential network analysis
• Joint estimation of multiple high-dimensional precision matrices
• A Bayesian Subset Specific Approach to Joint Selection of Multiple Graphical Models
• Joint learning of multiple Granger causal networks via non-convex regularizations: inference of group-level brain connectivity
• Simultaneous Clustering and Estimation of Heterogeneous Graphical Models
• On regularized estimation methods for precision and covariance matrix and statistical network inference
• Bayesian modeling of multiple structural connectivity networks during the progression of Alzheimer's disease
• Shared subspace models for multi-group covariance estimation
• Estimating Multiple Precision Matrices With Cluster Fusion Regularization
• Network differential connectivity analysis
• Estimation of multiple networks in Gaussian mixture models
• Estimating heterogeneous gene regulatory networks from zero-inflated single-cell expression data
• Heterogeneity adjustment with applications to graphical model inference
• Direct covariance matrix estimation with compositional data

Uses Software

• glasso

This page was built for publication: Joint estimation of precision matrices in heterogeneous populations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q302425)