On posterior contraction of parameters and interpretability in Bayesian mixture modeling
From MaRDI portal
Abstract: We study posterior contraction behaviors for parameters of interest in the context of Bayesian mixture modeling, where the number of mixing components is unknown while the model itself may or may not be correctly specified. Two representative types of prior specification will be considered: one requires explicitly a prior distribution on the number of mixture components, while the other places a nonparametric prior on the space of mixing distributions. The former is shown to yield an optimal rate of posterior contraction on the model parameters under minimal conditions, while the latter can be utilized to consistently recover the unknown number of mixture components, with the help of a fast probabilistic post-processing procedure. We then turn the study of these Bayesian procedures to the realistic settings of model misspecification. It will be shown that the modeling choice of kernel density functions plays perhaps the most impactful roles in determining the posterior contraction rates in the misspecified situations. Drawing on concrete posterior contraction rates established in this paper we wish to highlight some aspects about the interesting tradeoffs between model expressiveness and interpretability that a statistical modeler must negotiate in the rich world of mixture modeling.
Recommendations
- Convergence of posterior distribution in the mixture of regressions
- Consistency of mixture models with a prior on the number of components
- Anchored Bayesian Gaussian mixture models
- On the posterior distribution of the number of components in a finite mixture
- Bayesian mixture models: theory and methods
Cites work
- scientific article; zbMATH DE number 1085980 (Why is no real title available?)
- scientific article; zbMATH DE number 194758 (Why is no real title available?)
- scientific article; zbMATH DE number 774881 (Why is no real title available?)
- 10.1162/jmlr.2003.3.4-5.993
- A Bayesian analysis of some nonparametric problems
- Adaptive Bayesian density estimation in \(L^p\)-metrics with Pitman-Yor or normalized inverse-Gaussian process kernel mixtures
- Adaptive Bayesian multivariate density estimation with Dirichlet mixtures
- Asymptotic behaviour of the posterior distribution in overfitted mixture models
- Bayes Factors
- Bayesian Density Estimation and Inference Using Mixtures
- Bayesian Model Selection in Finite Mixtures by Marginal Density Decompositions
- Bayesian Repulsive Gaussian Mixture Model
- Bayesian analysis of mixture models with an unknown number of components\,--\,an alternative to reversible jump methods.
- Bayesian decision analysis. Principles and practice.
- Bounds for Bayesian order identification with application to mixtures
- Consistent estimation of a mixing distribution
- Convergence of latent mixing measures in finite and infinite mixture models
- Convergence rates for density estimation with Bernstein polynomials.
- Convergence rates of posterior distributions.
- Ferguson distributions via Polya urn schemes
- Fourier methods for estimating mixing densities and distributions
- Hierarchical Dirichlet Processes
- Inconsistency of Pitman-Yor process mixtures for the number of components
- Misspecification in infinite-dimensional Bayesian statistics
- Mixture models with a prior on the number of components
- Mixture models: theory, geometry and applications
- Mixtures
- Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems
- Modelling heterogeneity with and without the Dirichlet process
- On a class of Bayesian nonparametric estimates: I. Density estimates
- On choosing mixture components via non-local priors
- On posterior contraction of parameters and interpretability in Bayesian mixture modeling
- On rates of convergence for posterior distributions in infinite-dimensional models
- On strong identifiability and convergence rates of parameter estimation in finite mixtures
- On the optimal rates of convergence for nonparametric deconvolution problems
- Optimal Transport
- Optimal rate of convergence for finite mixture models
- Posterior consistency of Dirichlet mixtures in density estimation
- Posterior contraction of the population polytope in finite admixture models
- Posterior contraction rates for deconvolution of Dirichlet-Laplace mixtures
- Posterior convergence rates of Dirichlet mixtures at smooth densities
- Rates of convergence of posterior distributions.
- Robust estimation of mixing measures in finite mixture models
- Splitting and merging components of a nonconjugate Dirichlet process mixture model
- Strong identifiability and optimal minimax rates for finite mixture estimation
- The Bernstein-von Mises theorem under misspecification
- The Nested Dirichlet Process
- The estimation of the order of a mixture model
Cited in
(12)- On posterior contraction of parameters and interpretability in Bayesian mixture modeling
- Is infinity that far? A Bayesian nonparametric perspective of finite mixture models
- Consistency of mixture models with a prior on the number of components
- Zero‐inflated Poisson model with clustered regression coefficients: Application to heterogeneity learning of field goal attempts of professional basketball players
- Empirical optimal transport under estimated costs: distributional limits and statistical applications
- Bayesian mixture models (in)consistency for the number of clusters
- Bayesian non‐parametric spatial prior for traffic crash risk mapping: A case study of Victoria, Australia
- Optimal Bayesian estimation of Gaussian mixtures with growing number of components
- Optimal estimation of high-dimensional Gaussian location mixtures
- Estimating the number of components in finite mixture models via the group-sort-fuse procedure
- Convergence of de Finetti's mixing measure in latent structure models for observed exchangeable sequences
- Community detection for weighted networks with unknown number of communities
This page was built for publication: On posterior contraction of parameters and interpretability in Bayesian mixture modeling
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1983595)
