Covariance structure estimation with Laplace approximation
From MaRDI portal
Publication:6074739
Abstract: Gaussian covariance graph model is a popular model in revealing underlying dependency structures among random variables. A Bayesian approach to the estimation of covariance structures uses priors that force zeros on some off-diagonal entries of covariance matrices and put a positive definite constraint on matrices. In this paper, we consider a spike and slab prior on off-diagonal entries, which uses a mixture of point-mass and normal distribution. The point-mass naturally introduces sparsity to covariance structures so that the resulting posterior from this prior renders covariance structure learning. Under this prior, we calculate posterior model probabilities of covariance structures using Laplace approximation. We show that the error due to Laplace approximation becomes asymptotically marginal at some rate depending on the posterior convergence rate of covariance matrix under the Frobenius norm. With the approximated posterior model probabilities, we propose a new framework for estimating a covariance structure. Since the Laplace approximation is done around the mode of conditional posterior of covariance matrix, which cannot be obtained in the closed form, we propose a block coordinate descent algorithm to find the mode and show that the covariance matrix can be estimated using this algorithm once the structure is chosen. Through a simulation study based on five numerical models, we show that the proposed method outperforms graphical lasso and sample covariance matrix in terms of root mean squared error, max norm, spectral norm, specificity, and sensitivity. Also, the advantage of the proposed method is demonstrated in terms of accuracy compared to our competitors when it is applied to linear discriminant analysis (LDA) classification to breast cancer diagnostic dataset.
Cites work
- A convex pseudolikelihood framework for high dimensional partial correlation estimation with convergence guarantees
- A direct estimation approach to sparse linear discriminant analysis
- A penalized maximum likelihood approach to sparse factor analysis
- Adaptive thresholding for sparse covariance matrix estimation
- Bayesian exploratory factor analysis
- Bayesian graphical Lasso models and efficient posterior computation
- Bayesian regularization for graphical models with unequal shrinkage
- Bayesian structure learning in graphical models
- Breast Cancer Diagnosis and Prognosis Via Linear Programming
- Convergence of a block coordinate descent method for nondifferentiable minimization
- Convergence rates of posterior distributions.
- Coordinate descent algorithm for covariance graphical Lasso
- Coordinate descent algorithms for nonconvex penalized regression, with applications to biological feature selection
- Covariance and precision matrix estimation for high-dimensional time series
- Covariance matrix estimation for stationary time series
- Covariance matrix selection and estimation via penalised normal likelihood
- Covariance regularization by thresholding
- Covariance tapering for likelihood-based estimation in large spatial data sets
- De-Biased Sparse PCA: Inference for Eigenstructure of Large Covariance Matrices
- Efficient Empirical Bayes Variable Selection and Estimation in Linear Models
- Efficient estimation of covariance selection models
- Efficient Gaussian graphical model determination under G-Wishart prior distributions
- Generalized alternating direction method of multipliers: new theoretical insights and applications
- Generalized thresholding of large covariance matrices
- High-dimensional sparse factor modeling: applications in gene expression genomics
- scientific article; zbMATH DE number 5281111 (Why is no real title available?)
- Model selection and estimation in the Gaussian graphical model
- Modified linear discriminant analysis approaches for classification of high-dimensional microarray data
- Network exploration via the adaptive LASSO and SCAD penalties
- Nonparametric estimation of large covariance matrices of longitudinal data
- Objective Bayesian model selection in Gaussian graphical models
- Penalized discriminant analysis
- Regularized estimation of large covariance matrices
- Scaling it up: stochastic search structure learning in graphical models
- Sparse Bayesian infinite factor models
- Sparse Bayesian time-varying covariance estimation in many dimensions
- Sparse estimation of a covariance matrix
- Sparse factor analysis for learning and content analytics
- Sparse inverse covariance estimation with the graphical lasso
- Sparse PCA via covariance thresholding
- Sparse permutation invariant covariance estimation
- The beta-mixture shrinkage prior for sparse covariances with near-minimax posterior convergence rate
- The hidden life of latent variables: Bayesian learning with mixed graph models
- Wishart distributions for decomposable covariance graph models
This page was built for publication: Covariance structure estimation with Laplace approximation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6074739)
