Sampling from Dirichlet process mixture models with unknown concentration parameter: mixing issues in large data implementations

DOI10.1007/S11222-014-9471-3zbMATH Open1332.62093DBLPjournals/sac/HastieLR15OpenAlexW1966851795WikidataQ30990753 ScholiaQ30990753MaRDI QIDQ261044FDOQ261044

Authors David I. Hastie, Silvia Liverani, Sylvia Richardson

Publication date 22 March 2016

Published in Statistics and Computing (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1304.1778

zbMATH Keywords

mixture modelBayesian clusteringDirichlet processprofile regression

Mathematics Subject Classification ID

Computational methods in Markov chains (60J22) Bayesian inference (62F15) Sampling theory, sample surveys (62D05) Random measures (60G57)

Abstract: We consider the question of Markov chain Monte Carlo sampling from a general stick-breaking Dirichlet process mixture model, with concentration parameter alpha. This paper introduces a Gibbs sampling algorithm that combines the slice sampling approach of Walker (2007) and the retrospective sampling approach of Papaspiliopoulos and Roberts (2008). Our general algorithm is implemented as efficient open source C++ software, available as an R package, and is based on a blocking strategy similar to that suggested by Papaspiliopoulos (2008) and implemented by Yau et al (2011). We discuss the difficulties of achieving good mixing in MCMC samplers of this nature and investigate sensitivity to initialisation. We additionally consider the challenges when an additional layer of hierarchy is added such that joint inference is to be made on alpha. We introduce a new label switching move and compute the marginal model posterior to help to surmount these difficulties. Our work is illustrated using a profile regression (Molitor et al, 2010) application, where we demonstrate good mixing behaviour for both synthetic and real examples.

Recommendations

• Sampling the Dirichlet Mixture Model with Slices
• Slice sampling mixture models
• Sampling schemes for generalized linear Dirichlet process random effects models
• Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models
• MCMC for normalized random measure mixture models

Cites work

• scientific article; zbMATH DE number 1085980 (Why is no real title available?)
• scientific article; zbMATH DE number 774881 (Why is no real title available?)
• A Bayesian analysis of some nonparametric problems
• Bayesian Density Estimation and Inference Using Mixtures
• Bayesian Non-Parametric Hidden Markov Models with Applications in Genomics
• Bayesian inference on changes in response densities over predictor clusters
• Bayesian profile regression with an application to the National Survey of Children's Health
• Bayesian semiparametric joint models for functional predictors
• Ferguson distributions via Polya urn schemes
• Gibbs Sampling Methods for Stick-Breaking Priors
• Improved criteria for clustering based on the posterior similarity matrix
• Markov chain Monte Carlo methods and the label switching problem in Bayesian mixture modeling
• Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems
• Nonparametric Bayes local partition models for random effects
• Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models
• Sampling the Dirichlet Mixture Model with Slices
• Slice sampling mixture models
• Splitting and merging components of a nonconjugate Dirichlet process mixture model
• The two-parameter Poisson-Dirichlet distribution derived from a stable subordinator

Cited in

(18)

• Optimal Bayesian estimators for latent variable cluster models
• Bayesian Spline-Based Hidden Markov Models with Applications to Actimetry Data and Sleep Analysis
• Quantifying the uncertainty of partitions for infinite mixture models
• Sampling schemes for generalized linear Dirichlet process random effects models
• AdaptSPEC-X: Covariate-Dependent Spectral Modeling of Multiple Nonstationary Time Series
• Clustering method for censored and collinear survival data
• An optimal data ordering scheme for Dirichlet process mixture models
• Splitting and merging components of a nonconjugate Dirichlet process mixture model
• On the use of Markov chain Monte Carlo methods for the sampling of mixture models: a statistical perspective
• Study of hybrid sampling inference for Dirichlet process mixtures of Gaussian processes models
• PReMiuM
• Sampling the Dirichlet Mixture Model with Slices
• Slice sampling mixture models
• Mixture modeling on related samples by \(\psi\)-stick breaking and kernel perturbation
• Retrospective Markov chain Monte Carlo methods for Dirichlet process hierarchical models
• Functional non-parametric latent block model: a multivariate time series clustering approach for autonomous driving validation
• Revealing subgroup structure in ranked data using a Bayesian WAND
• Infinite mixtures of infinite factor analysers

Describes a project that uses

Uses Software

• R

This page was built for publication: Sampling from Dirichlet process mixture models with unknown concentration parameter: mixing issues in large data implementations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q261044)