The posterior predictive null
From MaRDI portal
Abstract: Bayesian model criticism is an important part of the practice of Bayesian statistics. Traditionally, model criticism methods have been based on the predictive check, an adaptation of goodness-of-fit testing to Bayesian modeling and an effective method to understand how well a model captures the distribution of the data. In modern practice, however, researchers iteratively build and develop many models, exploring a space of models to help solve the problem at hand. While classical predictive checks can help assess each one, they cannot help the researcher understand how the models relate to each other. This paper introduces the posterior predictive null check (PPN), a method for Bayesian model criticism that helps characterize the relationships between models. The idea behind the PPN is to check whether data from one model's predictive distribution can pass a predictive check designed for another model. This form of criticism complements the classical predictive check by providing a comparative tool. A collection of PPNs, which we call a PPN study, can help us understand which models are equivalent and which models provide different perspectives on the data. With mixture models, we demonstrate how a PPN study, along with traditional predictive checks, can help select the number of components by the principle of parsimony. With probabilistic factor models, we demonstrate how a PPN study can help understand relationships between different classes of models, such as linear models and models based on neural networks. Finally, we analyze data from the literature on predictive checks to show how a PPN study can improve the practice of Bayesian model criticism. Code to replicate the results in this paper is available at url{https://github.com/gemoran/ppn-code}.
Cites work
- scientific article; zbMATH DE number 1522696 (Why is no real title available?)
- scientific article; zbMATH DE number 3255310 (Why is no real title available?)
- scientific article; zbMATH DE number 3189754 (Why is no real title available?)
- A survey of Bayesian predictive methods for model assessment, selection and comparison
- An introduction to variational methods for graphical models
- Asymptotic Distribution of P Values in Composite Null Models
- Bayes Factors
- Bayesian checking of the second levels of hierarchical models
- Bayesianly justifiable and relevant frequency calculations for the applied statistician
- Checking for prior-data conflict
- Identifying outliers in Bayesian hierarchical models: a simulation-based approach
- Model choice: a minimum posterior predictive loss approach
- P Values for Composite Null Models
- Philosophy and the practice of Bayesian statistics
- Posterior predictive \(p\)-values
- Probabilistic Principal Component Analysis
- Sampling and Bayes' Inference in Scientific Modelling and Robustness
- Statistical modeling: The two cultures. (With comments and a rejoinder).
This page was built for publication: The posterior predictive null
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6122056)
