Hidden Markov Pólya Trees for High-Dimensional Distributions
From MaRDI portal
Publication:6153984
Abstract: The P'olya tree (PT) process is a general-purpose Bayesian nonparametric model that has found wide application in a range of inference problems. It has a simple analytic form and the posterior computation boils down to beta-binomial conjugate updates along a partition tree over the sample space. Recent development in PT models shows that performance of these models can be substantially improved by (i) allowing the partition tree to adapt to the structure of the underlying distributions and (ii) incorporating latent state variables that characterize local features of the underlying distributions. However, important limitations of the PT remain, including (i) the sensitivity in the posterior inference with respect to the choice of the partition tree, and (ii) the lack of scalability with respect to dimensionality of the sample space. We consider a modeling strategy for PT models that incorporates a flexible prior on the partition tree along with latent states with Markov dependency. We introduce a hybrid algorithm combining sequential Monte Carlo (SMC) and recursive message passing for posterior sampling that can scale up to 100 dimensions. While our description of the algorithm assumes a single computer environment, it has the potential to be implemented on distributed systems to further enhance the scalability. Moreover, we investigate the large sample properties of the tree structures and latent states under the posterior model. We carry out extensive numerical experiments in density estimation and two-group comparison, which show that flexible partitioning can substantially improve the performance of PT models in both inference tasks. We demonstrate an application to a mass cytometry data set with 19 dimensions and over 200,000 observations.
Cites work
- scientific article; zbMATH DE number 1085986 (Why is no real title available?)
- scientific article; zbMATH DE number 1932866 (Why is no real title available?)
- A Bayesian Hierarchical Model for Related Densities by using Pólya Trees
- A Bayesian Non‐parametric Approach to Survival Analysis Using Polya Trees
- A Bayesian analysis of some nonparametric problems
- A Bayesian nonparametric approach to testing for dependence between random variables
- A class of mixtures of dependent tail-free processes
- Adaptive shrinkage in Pólya tree type models
- Analysis of Distributional Variation Through Graphical Multi-Scale Beta-Binomial Models
- Bayesian Density Estimation and Inference Using Mixtures
- Bayesian Nonparametric Inference for Random Distributions and Related Functions
- Bayesian Smoothing of Photon-Limited Images with Applications in Astronomy
- Bayesian and Conditional Frequentist Testing of a Parametric Model Versus Nonparametric Alternatives
- Bayesian curve fitting using multivariate normal mixtures
- Bayesian multiscale smoothing of Gaussian noised images
- Bayesian nonparametric \(k\)-sample tests for censored and uncensored data
- Bayesian nonparametric multiple imputation of partially observed data with ignorable nonresponse
- Coupling optional Pólya trees and the two sample problem
- Inference for Mixtures of Finite Polya Tree Models
- Modeling Regression Error With a Mixture of Polya Trees
- Multivariate density estimation by Bayesian sequential partitioning
- On Bayesian consistency
- On the Asymptotic Behavior of Bayes' Estimates in the Discrete Case
- Optional Pólya tree and Bayesian inference
- Prior distributions on spaces of probability measures
- Probabilistic multi-resolution scanning for two-sample differences
- Pólya tree distributions for statistical modeling of censored data
- Pólya tree posterior distributions on densities
- Rubbery Pólya tree
- Some aspects of Pólya tree distributions for statistical modelling
- Two-sample Bayesian nonparametric hypothesis testing
This page was built for publication: Hidden Markov Pólya Trees for High-Dimensional Distributions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6153984)
