Overfitting Bayesian mixtures of factor analyzers with an unknown number of components
From MaRDI portal
Abstract: Recent advances on overfitting Bayesian mixture models provide a solid and straightforward approach for inferring the underlying number of clusters and model parameters in heterogeneous datasets. The applicability of such a framework in clustering correlated high dimensional data is demonstrated. For this purpose an overfitting mixture of factor analyzers is introduced, assuming that the number of factors is fixed. A Markov chain Monte Carlo (MCMC) sampler combined with a prior parallel tempering scheme is used to estimate the posterior distribution of model parameters. The optimal number of factors is estimated using information criteria. Identifiability issues related to the label switching problem are dealt by post-processing the simulated MCMC sample by relabelling algorithms. The method is benchmarked against state-of-the-art software for maximum likelihood estimation of mixtures of factor analyzers using an extensive simulation study. Finally, the applicability of the method is illustrated in publicly available data.
Recommendations
- Clustering multivariate data using factor analytic Bayesian mixtures with an unknown number of components
- Mixtures of factor analysers. Bayesian estimation and inference by stochastic simulation
- Modelling high-dimensional data by mixtures of factor analyzers
- Infinite mixtures of infinite factor analysers
- A mixture of generalized hyperbolic factor analyzers
Cites work
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 1085980 (Why is no real title available?)
- scientific article; zbMATH DE number 1086057 (Why is no real title available?)
- A Bayesian analysis of some nonparametric problems
- A Reference Bayesian Test for Nested Hypotheses and its Relationship to the Schwarz Criterion
- A new look at the statistical model identification
- An online Bayesian mixture labelling method by minimizing deviance of classification probabilities to reference labels
- Annealing Markov Chain Monte Carlo with Applications to Ancestral Inference
- Asymptotic behaviour of the posterior distribution in overfitted mixture models
- Bayes Factors
- Bayesian Measures of Model Complexity and Fit
- Bayesian analysis of mixture models with an unknown number of components\,--\,an alternative to reversible jump methods.
- Bayesian exploratory factor analysis
- Computational and Inferential Difficulties with Mixture Posterior Distributions
- DIC in variable selection
- Dealing With Label Switching in Mixture Models
- Deviance information criteria for missing data models
- Estimating the dimension of a model
- Exact and approximate sum representations for the Dirichlet process
- Finite mixture and Markov switching models.
- Finite mixture models
- Generic global identification in factor analysis
- Latent variable models and factor analysis. A unified approach
- Markov chain Monte Carlo methods and the label switching problem in Bayesian mixture modeling
- Mixture Densities, Maximum Likelihood and the EM Algorithm
- Mixtures of distributions: A topological approach
- Mixtures of factor analysers. Bayesian estimation and inference by stochastic simulation
- Modelling high-dimensional data by mixtures of factor analyzers
- On the convergence rate of random permutation sampler and ECR algorithm in missing data models
- On the estimation of mixtures of Poisson regression models with large number of components
- Reversible jump MCMC in mixtures of normal distributions with the same component means
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
- Sampling-Based Approaches to Calculating Marginal Densities
- Serial and parallel implementations of model-based clustering via parsimonious Gaussian mixture models
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
- The Deviance Information Criterion: 12 Years on
Cited in
(6)- Infinite mixtures of infinite factor analysers
- Model-based clustering of censored data via mixtures of factor analyzers
- fabMix
- On the identifiability of Bayesian factor analytic models
- Clustering multivariate data using factor analytic Bayesian mixtures with an unknown number of components
- On Bayesian analysis of parsimonious Gaussian mixture models
Describes a project that uses
Uses Software
This page was built for publication: Overfitting Bayesian mixtures of factor analyzers with an unknown number of components
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q140406)
