On the use of Markov chain Monte Carlo methods for the sampling of mixture models: a statistical perspective

DOI10.1007/S11222-014-9526-5MaRDI QIDQ5963549zbMATH OpenOpenAlexFDO

Authors Randal Douc, Florian Maire, Jimmy Olsson

Publication date 22 February 2016

Published in Statistics and Computing (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1404.0880

zbMATH Keywords

mixture modelsasymptotic varianceinhomogeneous Markov chainsPeskun orderingCarlin \& Chib's pseudo-prior methodmetropolisation

Mathematics Subject Classification ID

Multivariate distribution of statistics (62H10) Markov processes: estimation; hidden Markov models (62M05) Time series, auto-correlation, regression, etc. in statistics (GARCH) (62M10) Numerical analysis or methods applied to Markov chains (65C40) Sampling theory, sample surveys (62D05) Estimation in multivariate analysis (62H12)

Abstract: In this paper we study asymptotic properties of different data-augmentation-type Markov chain Monte Carlo algorithms sampling from mixture models comprising discrete as well as continuous random variables. Of particular interest to us is the situation where sampling from the conditional distribution of the continuous component given the discrete component is infeasible. In this context, we cast Carlin & Chib's pseudo-prior method into the framework of mixture models and discuss and compare different variants of this scheme. We propose a novel algorithm, the FCC sampler, which is less computationally demanding than any Metropolised Carlin & Chib-type algorithm. The significant gain of computational efficiency is however obtained at the cost of some asymptotic variance. The performance of the algorithm vis-`a-vis alternative schemes is investigated theoretically, using some recent results obtained in [3] for inhomogeneous Markov chains evolving alternatingly according to two different reversible Markov transition kernels, as well as numerically.

Recommendations

• Efficient MCMC sampling in dynamic mixture models
• MCMC for normalized random measure mixture models
• Markov chain Monte Carlo methods and the label switching problem in Bayesian mixture modeling
• Sampling from Dirichlet process mixture models with unknown concentration parameter: mixing issues in large data implementations
• Using a Markov Chain to Construct a Tractable Approximation of an Intractable Probability Distribution

Cites work

• scientific article; zbMATH DE number 2117879 (Why is no real title available?)
• scientific article; zbMATH DE number 795289 (Why is no real title available?)
• A note on Metropolis-Hastings kernels for general state spaces
• An MCMC model search algorithm for regression problems
• Batch means and spectral variance estimators in Markov chain Monte Carlo
• Comparison of asymptotic variances of inhomogeneous Markov chains with application to Markov chain Monte Carlo methods
• Ordering and improving the performance of Monte Carlo Markov chains.
• Particle Markov Chain Monte Carlo Methods
• Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
• Towards a Coherent Statistical Framework for Dense Deformable Template Estimation

Cited in

(5)

• A comparative study of nonlinear Markov chain models for conditional simulation of multinomial classes from regular samples
• Markov chain Monte Carlo Estimation of Classical and Dynamic Switching and Mixture Models
• The method of solving structural reliability with multiparameter correlation problem
• Multicanonical MCMC for sampling rare events: an illustrative review
• Efficient MCMC sampling in dynamic mixture models

Describes a project that uses

Uses Software

• MNIST

This page was built for publication: On the use of Markov chain Monte Carlo methods for the sampling of mixture models: a statistical perspective

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5963549)