Hidden Markov Pólya Trees for High-Dimensional Distributions

DOI10.1080/01621459.2022.2105223arXiv2011.03121OpenAlexW3098726686MaRDI QIDQ6153984FDOQ6153984

Authors:

Publication date: 19 March 2024

Published in: Journal of the American Statistical Association (Search for Journal in Brave)

Abstract: The P'olya tree (PT) process is a general-purpose Bayesian nonparametric model that has found wide application in a range of inference problems. It has a simple analytic form and the posterior computation boils down to beta-binomial conjugate updates along a partition tree over the sample space. Recent development in PT models shows that performance of these models can be substantially improved by (i) allowing the partition tree to adapt to the structure of the underlying distributions and (ii) incorporating latent state variables that characterize local features of the underlying distributions. However, important limitations of the PT remain, including (i) the sensitivity in the posterior inference with respect to the choice of the partition tree, and (ii) the lack of scalability with respect to dimensionality of the sample space. We consider a modeling strategy for PT models that incorporates a flexible prior on the partition tree along with latent states with Markov dependency. We introduce a hybrid algorithm combining sequential Monte Carlo (SMC) and recursive message passing for posterior sampling that can scale up to 100 dimensions. While our description of the algorithm assumes a single computer environment, it has the potential to be implemented on distributed systems to further enhance the scalability. Moreover, we investigate the large sample properties of the tree structures and latent states under the posterior model. We carry out extensive numerical experiments in density estimation and two-group comparison, which show that flexible partitioning can substantially improve the performance of PT models in both inference tasks. We demonstrate an application to a mass cytometry data set with 19 dimensions and over 200,000 observations.

Full work available at URL: https://arxiv.org/abs/2011.03121

zbMATH Keywords

Bayesian nonparametricslatent variable modelsmultivariate analysisrecursive partitioningmulti-scale inference

Mathematics Subject Classification ID

Statistics (62-XX)

Cites Work

• Bayesian Density Estimation and Inference Using Mixtures
• Bayesian curve fitting using multivariate normal mixtures
• Modeling Regression Error With a Mixture of Polya Trees
• Prior distributions on spaces of probability measures
• A Bayesian analysis of some nonparametric problems
• Pólya tree posterior distributions on densities
• Coupling optional Pólya trees and the two sample problem
• Optional Pólya tree and Bayesian inference
• Bayesian Nonparametric Inference for Random Distributions and Related Functions
• On the Asymptotic Behavior of Bayes' Estimates in the Discrete Case
• Some aspects of Pólya tree distributions for statistical modelling
• Two-sample Bayesian nonparametric hypothesis testing
• On Bayesian consistency
• Inference for Mixtures of Finite Polya Tree Models
• Title not available (Why is that?)
• Title not available (Why is that?)
• Bayesian and Conditional Frequentist Testing of a Parametric Model Versus Nonparametric Alternatives
• A Bayesian nonparametric approach to testing for dependence between random variables
• Pólya tree distributions for statistical modeling of censored data
• Rubbery Pólya tree
• A Bayesian Non‐parametric Approach to Survival Analysis Using Polya Trees
• A class of mixtures of dependent tail-free processes
• Multivariate density estimation by Bayesian sequential partitioning
• Bayesian Smoothing of Photon-Limited Images with Applications in Astronomy
• Bayesian multiscale smoothing of Gaussian noised images
• Bayesian nonparametric \(k\)-sample tests for censored and uncensored data
• Probabilistic multi-resolution scanning for two-sample differences
• Adaptive shrinkage in Pólya tree type models
• Bayesian nonparametric multiple imputation of partially observed data with ignorable nonresponse
• A Bayesian Hierarchical Model for Related Densities by using Pólya Trees
• Analysis of Distributional Variation Through Graphical Multi-Scale Beta-Binomial Models

This page was built for publication: Hidden Markov Pólya Trees for High-Dimensional Distributions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6153984)