Structure estimation for discrete graphical models: generalized covariance matrices and their inverses
From MaRDI portal
Publication:2443211
Abstract: We investigate the relationship between the structure of a discrete graphical model and the support of the inverse of a generalized covariance matrix. We show that for certain graph structures, the support of the inverse covariance matrix of indicator variables on the vertices of a graph reflects the conditional independence structure of the graph. Our work extends results that have previously been established only in the context of multivariate Gaussian graphical models, thereby addressing an open question about the significance of the inverse covariance matrix of a non-Gaussian distribution. The proof exploits a combination of ideas from the geometry of exponential families, junction tree theory and convex analysis. These population-level results have various consequences for graph selection methods, both known and novel, including a novel method for structure estimation for missing or corrupted observations. We provide nonasymptotic guarantees for such methods and illustrate the sharpness of these predictions via simulations.
Recommendations
- High-dimensional covariance estimation based on Gaussian graphical models
- High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence
- Efficient estimation of covariance selection models
- Gemini: graph estimation with matrix variate normal instances
- Gaussian Markov distributions over finite graphs
Cites work
- scientific article; zbMATH DE number 5957408 (Why is no real title available?)
- scientific article; zbMATH DE number 44577 (Why is no real title available?)
- scientific article; zbMATH DE number 47926 (Why is no real title available?)
- scientific article; zbMATH DE number 3513115 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 3602484 (Why is no real title available?)
- scientific article; zbMATH DE number 1134987 (Why is no real title available?)
- scientific article; zbMATH DE number 2140075 (Why is no real title available?)
- scientific article; zbMATH DE number 4121482 (Why is no real title available?)
- scientific article; zbMATH DE number 918103 (Why is no real title available?)
- A Theorem about Random Fields
- A constrained \(\ell _{1}\) minimization approach to sparse precision matrix estimation
- Additive and multiplicative models and interactions
- Approximating discrete probability distributions with dependence trees
- Convex Analysis
- Fast global convergence of gradient methods for high-dimensional statistical recovery
- First-Order Methods for Sparse Covariance Selection
- Graphical models, exponential families, and variational inference
- High dimensional inverse covariance matrix estimation via linear programming
- High-dimensional Ising model selection using \(\ell _{1}\)-regularized logistic regression
- High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence
- High-dimensional graphs and variable selection with the Lasso
- High-dimensional regression with noisy and missing data: provable guarantees with nonconvexity
- High-dimensional semiparametric Gaussian copula graphical models
- High-dimensional structure estimation in Ising models: local separation criterion
- Information-Theoretic Limits of Selecting Binary Graphical Models in High Dimensions
- Missing-Data Methods for Generalized Linear Models
- Model selection and estimation in the Gaussian graphical model
- Model selection through sparse maximum likelihood estimation for multivariate Gaussian or binary data
- Probabilistic graphical models.
- Reconstruction of Markov Random Fields from Samples: Some Observations and Algorithms
- Regularized rank-based estimation of high-dimensional nonparanormal graphical models
- Sparse inverse covariance estimation with the graphical lasso
- Sparse permutation invariant covariance estimation
- Structure estimation for discrete graphical models: generalized covariance matrices and their inverses
- Support union recovery in high-dimensional multivariate regression
- The nonparanormal: semiparametric estimation of high dimensional undirected graphs
Cited in
(24)- Graphical-model based high dimensional generalized linear models
- Structure estimation for discrete graphical models: generalized covariance matrices and their inverses
- High-dimensional Ising model selection with Bayesian information criteria
- The curved exponential family of a staged tree
- Gaussian tree constraints applied to acoustic linguistic functional data
- On model selection consistency of regularized M-estimators
- Palindromic Bernoulli distributions
- Toward a multisubject analysis of neural connectivity
- Structured sparsity: discrete and convex approaches
- Exact estimation of multiple directed acyclic graphs
- Estimation of high-dimensional seemingly unrelated regression models
- Regularized estimation in sparse high-dimensional time series models
- Structure recovery for partially observed discrete Markov random fields on graphs under not necessarily positive distributions
- Learning binary undirected graph in low dimensional regime
- A general algorithm for covariance modeling of discrete data
- Model selection for Markov random fields on graphs under a mixing condition
- scientific article; zbMATH DE number 7626718 (Why is no real title available?)
- On graphical models and convex geometry
- Discriminant analysis for discrete variables derived from a tree-structured graphical model
- Joint estimation of heterogeneous exponential Markov random fields through an approximate likelihood inference
- Learning a tree-structured Ising model in order to make predictions
- Optimal computational and statistical rates of convergence for sparse nonconvex learning problems
- Copula directed acyclic graphs
- Heterogeneity adjustment with applications to graphical model inference
This page was built for publication: Structure estimation for discrete graphical models: generalized covariance matrices and their inverses
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2443211)
