A Compound Decision Approach to Covariance Matrix Estimation
From MaRDI portal
Abstract: Covariance matrix estimation is a fundamental statistical task in many applications, but the sample covariance matrix is sub-optimal when the sample size is comparable to or less than the number of features. Such high-dimensional settings are common in modern genomics, where covariance matrix estimation is frequently employed as a method for inferring gene networks. To achieve estimation accuracy in these settings, existing methods typically either assume that the population covariance matrix has some particular structure, for example sparsity, or apply shrinkage to better estimate the population eigenvalues. In this paper, we study a new approach to estimating high-dimensional covariance matrices. We first frame covariance matrix estimation as a compound decision problem. This motivates defining a class of decision rules and using a nonparametric empirical Bayes g-modeling approach to estimate the optimal rule in the class. Simulation results and gene network inference in an RNA-seq experiment in mouse show that our approach is comparable to or can outperform a number of state-of-the-art proposals.
Recommendations
- High-dimensional covariance estimation
- Nonparametric Stein-type shrinkage covariance matrix estimators in high-dimensional settings
- On regularized estimation methods for precision and covariance matrix and statistical network inference
- Weighted covariance matrix estimation
- Condition-number-regularized covariance estimation
Cites work
- A calibration method for non-positive definite covariance matrix in multivariate data analysis
- A General Framework for Weighted Gene Co-Expression Network Analysis
- A well-conditioned estimator for large-dimensional covariance matrices
- Adapting to Unknown Smoothness via Wavelet Shrinkage
- Adaptive thresholding for sparse covariance matrix estimation
- An overview of composite likelihood methods
- Approximate nonparametric maximum likelihood for mixture models: a convex optimization approach to fitting arbitrary multivariate mixing distributions
- Bayes, oracle Bayes and empirical Bayes
- Compound decision theory and empirical Bayes methods
- Computing a nearest symmetric positive semidefinite matrix
- Consistency of the Maximum Likelihood Estimator in the Presence of Infinitely Many Incidental Parameters
- Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules
- Estimation with quadratic loss.
- General maximum likelihood empirical Bayes estimation of normal means
- Generalized thresholding of large covariance matrices
- High dimensional covariance matrix estimation using a factor model
- Lectures on the theory of estimation of many parameters
- Nonlinear shrinkage estimation of large-dimensional covariance matrices
- Nonparametric eigenvalue-regularized precision or covariance matrix estimator
- Nonparametric empirical Bayes and compound decision approaches to estimation of a high-dimensional vector of normal means
- Nonparametric Maximum Likelihood Estimation of a Mixing Distribution
- On the Asymptotic Behavior of the Sample Estimates of Eigenvalues and Eigenvectors of Covariance Matrices
- On the nonparametric maximum likelihood estimator for Gaussian location mixture densities with application to Gaussian denoising
- Positive-definite _1-penalized estimation of large covariance matrices
- Rotational Invariant Estimator for General Noisy Matrices
- Shrinkage estimation
- The 1988 Neyman Memorial Lecture: A Galtonian perspective on shrinkage estimators
- The geometry of mixture likelihoods: A general theory
- Two modeling strategies for empirical Bayes estimation
Cited in
(6)- Estimating large covariance matrix with network topology for high-dimensional biomedical data
- Compressed covariance estimation with automated dimension learning
- scientific article; zbMATH DE number 7007504 (Why is no real title available?)
- Convex optimization techniques due to Nestrov and computational complexity
- Optimal Multiple Decision Statistical Procedure for Inverse Covariance Matrix
- Weighted average ensemble for Cholesky-based covariance matrix estimation
This page was built for publication: A Compound Decision Approach to Covariance Matrix Estimation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6055869)
