Graphical posterior predictive classification: Bayesian model averaging with particle Gibbs
From MaRDI portal
Abstract: In this study, we present a multi-class graphical Bayesian predictive classifier that incorporates the uncertainty in the model selection into the standard Bayesian formalism. For each class, the dependence structure underlying the observed features is represented by a set of decomposable Gaussian graphical models. Emphasis is then placed on the Bayesian model averaging which takes full account of the class-specific model uncertainty by averaging over the posterior graph model probabilities. An explicit evaluation of the model probabilities is well known to be infeasible. To address this issue, we consider the particle Gibbs strategy of Olsson et al. (2018b) for posterior sampling from decomposable graphical models which utilizes the Christmas tree algorithm of Olsson et al. (2018a) as proposal kernel. We also derive a strong hyper Markov law which we call the hyper normal Wishart law that allow to perform the resultant Bayesian calculations locally. The proposed predictive graphical classifier reveals superior performance compared to the ordinary Bayesian predictive rule that does not account for the model uncertainty, as well as to a number of out-of-the-box classifiers.
Recommendations
- Bayesian model-averaged regularization for Gaussian graphical models
- scientific article; zbMATH DE number 7626712
- Bayesian inference of multiple Gaussian graphical models
- Bayesian graphical Lasso models and efficient posterior computation
- Bayesian graphical regression
- A class of models for Bayesian predictive inference
- Approximating predictive probabilities of Gibbs-type priors
- Partial Gaussian Graphical Model Estimation
- Bayesian Inference for Gaussian Graphical Models Beyond Decomposable Graphs
- On the prior and posterior distributions used in graphical modelling
Cites work
- A structural Markov property for decomposable graph laws that allows control of clique intersections
- Bayes Factors
- Bayesian block-diagonal predictive classifier for Gaussian data
- Bayesian Graphical Models for Discrete Data
- Bayesian learning of weakly structural Markov graph laws using sequential Monte Carlo methods
- Conjugate Bayes discrimination with infinitely many variables
- Counting labelled chordal graphs
- Have I seen you before? Principles of Bayesian predictive classification revisited
- scientific article; zbMATH DE number 735230 (Why is no real title available?)
- scientific article; zbMATH DE number 1134987 (Why is no real title available?)
- scientific article; zbMATH DE number 835699 (Why is no real title available?)
- scientific article; zbMATH DE number 1432028 (Why is no real title available?)
- scientific article; zbMATH DE number 3205746 (Why is no real title available?)
- scientific article; zbMATH DE number 3344239 (Why is no real title available?)
- Hyper Markov laws in the statistical analysis of decomposable graphical models
- Inductive Inference and Partition Exchangeability in Classification
- Marginal and simultaneous predictive classification using stratified graphical models
- Model Selection and Accounting for Model Uncertainty in Graphical Models Using Occam's Window
- Model uncertainty
- On particle Gibbs sampling
- Particle Markov Chain Monte Carlo Methods
- Sampling decomposable graphs using a Markov chain on junction trees
- Scikit-learn: machine learning in Python
- Sequential sampling of junction trees for decomposable graphs
- Simultaneous predictive Gaussian classifiers
- Structural Markov graph laws for Bayesian model uncertainty
This page was built for publication: Graphical posterior predictive classification: Bayesian model averaging with particle Gibbs
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6050282)
