Consistency of mixture models with a prior on the number of components
From MaRDI portal
(Redirected from Publication:6160720)
Abstract: This article establishes general conditions for posterior consistency of Bayesian finite mixture models with a prior on the number of components. That is, we provide sufficient conditions under which the posterior concentrates on neighborhoods of the true parameter values when the data are generated from a finite mixture over the assumed family of component distributions. Specifically, we establish almost sure consistency for the number of components, the mixture weights, and the component parameters, up to a permutation of the component labels. The approach taken here is based on Doob's theorem, which has the advantage of holding under extraordinarily general conditions, and the disadvantage of only guaranteeing consistency at a set of parameter values that has probability one under the prior. However, we show that in fact, for commonly used choices of prior, this yields consistency at Lebesgue-almost all parameter values -- which is satisfactory for most practical purposes. We aim to formulate the results in a way that maximizes clarity, generality, and ease of use.
Recommendations
- Convergence of posterior distribution in the mixture of regressions
- On Consistency of Nonparametric Normal Mixtures for Bayesian Density Estimation
- Consistency of the MLE under mixture models
- On Consistency of Bayesian Inference with Mixtures of Logistic Regression
- On the posterior distribution of the number of components in a finite mixture
Cites work
- Adaptive Bayesian density estimation with location-scale mixtures
- Adaptive Bayesian multivariate density estimation with Dirichlet mixtures
- Concepts of Independence for Proportions with a Generalization of the Dirichlet Distribution
- Convergence of latent mixing measures in finite and infinite mixture models
- Fundamentals of nonparametric Bayesian inference
- Gibbs Sampling Methods for Stick-Breaking Priors
- scientific article; zbMATH DE number 1461253 (Why is no real title available?)
- scientific article; zbMATH DE number 3063387 (Why is no real title available?)
- Identifiability of Finite Mixtures
- Identifiability of Finite Mixtures of Elliptical Distributions
- Identifiability of mixtures of power-series distributions and related characterizations
- Inconsistency of Pitman-Yor process mixtures for the number of components
- Mixture models with a prior on the number of components
- On posterior contraction of parameters and interpretability in Bayesian mixture modeling
- On the Identifiability of Finite Mixtures
- Practical Bayesian Density Estimation Using Mixtures of Normals
- Real Analysis and Probability
- Robust Bayesian inference via coarsening
Cited in
(7)- On the posterior distribution of the number of components in a finite mixture
- On posterior contraction of parameters and interpretability in Bayesian mixture modeling
- Inconsistency of Pitman-Yor process mixtures for the number of components
- On Consistency of Bayesian Inference with Mixtures of Logistic Regression
- Convergence of posterior distribution in the mixture of regressions
- Bayesian mixture models (in)consistency for the number of clusters
- Model-Based Clustering of Categorical Data Based on the Hamming Distance
This page was built for publication: Consistency of mixture models with a prior on the number of components
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6160720)
