A review of Gaussian Markov models for conditional independence

DOI10.1016/J.JSPI.2019.09.008zbMATH Open1437.62195arXiv1606.07282OpenAlexW2975015986WikidataQ127181386 ScholiaQ127181386MaRDI QIDQ2301082FDOQ2301082

Pedro Larrañaga, Irene Córdoba, Concha Bielza

Publication date: 28 February 2020

Published in: Journal of Statistical Planning and Inference (Search for Journal in Brave)

Abstract: Markov models lie at the interface between statistical independence in a probability distribution and graph separation properties. We review model selection and estimation in directed and undirected Markov models with Gaussian parametrization, emphasizing the main similarities and differences. These two model classes are similar but not equivalent, although they share a common intersection. We present the existing results from a historical perspective, taking into account the amount of literature existing from both the artificial intelligence and statistics research communities, where these models were originated. We cover classical topics such as maximum likelihood estimation and model selection via hypothesis testing, but also more modern approaches like regularization and Bayesian methods. We also discuss how the Markov models reviewed fit in the rich hierarchy of other, higher level Markov model classes. Finally, we close the paper overviewing relaxations of the Gaussian assumption and pointing out the main areas of application where these Markov models are nowadays used.

Full work available at URL: https://arxiv.org/abs/1606.07282

Recommendations

• scientific article
• Gaussian Markov distributions over finite graphs
• Ancestral graph Markov models.
• Model selection for Gaussian concentration graphs
• Conditional independence and basic Markov properties

zbMATH Keywords

model selectionparameter estimationconditional independenceGaussian Markov model

Mathematics Subject Classification ID

Bayesian inference (62F15) Gaussian processes (60G15) Estimation in multivariate analysis (62H12) Measures of association (correlation, canonical correlation, etc.) (62H20) Ridge regression; shrinkage estimators (Lasso) (62J07) Research exposition (monographs, survey articles) pertaining to statistics (62-02)

Cites Work

• Title not available (Why is that?)
• Causation, prediction, and search
• Experiments in stochastic computation for high-dimensional graphical models
• Parameter priors for directed acyclic graphical models and the characterization of several probability distributions
• The Adaptive Lasso and Its Oracle Properties
• Gaussian graphical model estimation with false discovery rate control
• Title not available (Why is that?)
• Statistics for high-dimensional data. Methods, theory and applications.
• Lasso-type recovery of sparse representations for high-dimensional data
• High-dimensional semiparametric Gaussian copula graphical models
• On the conditions used to prove oracle results for the Lasso
• High-dimensional graphs and variable selection with the Lasso
• The nonparanormal: semiparametric estimation of high dimensional undirected graphs
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Multiple testing and error control in Gaussian graphical model selection
• Regularized rank-based estimation of high-dimensional nonparanormal graphical models
• Sparsistency and rates of convergence in large covariance matrix estimation
• Graphical models for associations between variables, some of which are qualitative and some quantitative
• Hyper Markov laws in the statistical analysis of decomposable graphical models
• Sparse inverse covariance estimation with the graphical lasso
• Graphical models for genetic analyses
• Sparse permutation invariant covariance estimation
• Uniform consistency in causal inference
• Title not available (Why is that?)
• Title not available (Why is that?)
• Model selection and estimation in the Gaussian graphical model
• \(\ell_{0}\)-penalized maximum likelihood for sparse directed acyclic graphs
• Decomposition of maximum likelihood in mixed graphical interaction models
• Title not available (Why is that?)
• Title not available (Why is that?)
• Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
• Graphical models
• Penalized likelihood methods for estimation of sparse high-dimensional directed acyclic graphs
• A note on the Lasso for Gaussian graphical model selection
• Learning Local Dependence In Ordered Data
• Learning mixtures of truncated basis functions from data
• Ancestral graph Markov models.
• High-dimensional covariance estimation by minimizing \(\ell _{1}\)-penalized log-determinant divergence
• Dependence and independence
• Propagation of Probabilities, Means, and Variances in Mixed Graphical Association Models
• Title not available (Why is that?)
• Title not available (Why is that?)
• Mixtures of truncated basis functions
• Title not available (Why is that?)
• Title not available (Why is that?)
• Inference in hybrid Bayesian networks using mixtures of polynomials
• On the Non-Negative Garrotte Estimator
• Probability distributions with summary graph structure
• Conditional independence for statistical operations
• Linear dependencies represented by chain graphs. With comments and a rejoinder by the authors
• Wishart distributions for decomposable graphs
• Elliptical graphical modelling
• Model selection for Gaussian concentration graphs
• Linear Recursive Equations, Covariance Selection, and Path Analysis
• Cholesky decomposition of a hyper inverse Wishart matrix
• Simulation of hyper-inverse Wishart distributions in graphical models
• Multivariate Correlation Models with Mixed Discrete and Continuous Variables
• Title not available (Why is that?)
• Flexible covariance estimation in graphical Gaussian models
• Title not available (Why is that?)
• Geometry of the faithfulness assumption in causal inference
• Markov Properties for Acyclic Directed Mixed Graphs
• Hypersurfaces and their singularities in partial correlation testing
• Logical and algorithmic properties of conditional independence and graphical models
• Marginalizing and conditioning in graphical models
• A SINful approach to Gaussian graphical model selection
• Robust estimators for nondecomposable elliptical graphical models
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Objective Bayesian model selection in Gaussian graphical models
• Hyper Inverse Wishart Distribution for Non-decomposable Graphs and its Application to Bayesian Inference for Gaussian Graphical Models
• Decomposable graphical Gaussian model determination
• On the Validity of the Markov Interpretation of Path Diagrams of Gaussian Structural Equations Systems with Correlated Errors
• A Monte Carlo method for computing the marginal likelihood in nondecomposable Gaussian graphical models
• Positive definite completions of partial Hermitian matrices
• On the prior and posterior distributions used in graphical modelling
• Markov Random Fields and Their Applications
• A Theorem about Random Fields
• Multivariate Gaussians, semidefinite matrix completion, and convex algebraic geometry
• Markov fields and log-linear interaction models for contingency tables
• Sequences of regressions and their independences
• Stable mixed graphs
• Alternative Markov properties for chain graphs
• Marginalization and conditioning for LWF chain graphs
• Title not available (Why is that?)
• Discrete chain graph models
• Markov properties for mixed graphs
• Objective Bayes Factors for Gaussian Directed Acyclic Graphical Models
• Asymptotically efficient estimation of covariance matrices with linear structure
• Fusion, propagation, and structuring in belief networks
• Separoids: a mathematical framework for conditional independence and irrelevance
• Asymptotic behaviour of the number of labelled essential acyclic digraphs and labelled chain graphs
• The size distribution for Markov equivalence classes of acyclic digraph models.
• Geometry of maximum likelihood estimation in Gaussian graphical models
• Model Search among Multiplicative Models
• Analogies between Multiplicative Models in Contingency Tables and Covariance Selection
• PC algorithm for Gaussian copula graphical models
• Normal linear regression models with recursive graphical Markov structure
• The Isserlis matrix and its application to non-decomposable graphical Gaussian models
• Low-Order Conditional Independence Graphs for Inferring Genetic Networks
• High-dimensional learning of linear causal networks via inverse covariance estimation
• Independence properties of directed markov fields
• CAM: causal additive models, high-dimensional order search and penalized regression
• Title not available (Why is that?)
• Simulation of hyper-inverse Wishart distributions for non-decomposable graphs
• Graphical and Recursive Models for Contingency Tables
• An Introduction to Spatial Point Processes and Markov Random Fields
• Posterior graph selection and estimation consistency for high-dimensional Bayesian DAG models
• Objective Bayesian search of Gaussian directed acyclic graphical models for ordered variables with non-local priors
• Positive definite completion problems for Bayesian networks
• Exact formulas for the normalizing constants of Wishart distributions for graphical models
• Stochastic inequalities relating a class of log-likelihood ratio statistics to their asymptotic \(\chi ^ 2\) distribution
• Title not available (Why is that?)
• Unifying Markov properties for graphical models
• Counting Markov equivalence classes for DAG models on trees
• Counting and exploring sizes of Markov equivalence classes of directed acyclic graphs
• Comments on: Sequences of regressions and their independencies
• Comment on: Sequences of regressions and their independences
• On the causal interpretation of acyclic mixed graphs under multivariate normality

Cited In (3)

• A mathematical view of weights-of-evidence, conditional independence, and logistic regression in terms of Markov random fields
• Gaussian-related undirected graphical models for circular variables
• Directional tests in Gaussian graphical models

Uses Software

• glasso
• Separoids
• TETRAD
• HdBCS

This page was built for publication: A review of Gaussian Markov models for conditional independence

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2301082)