Bayesian variable selection for latent class analysis using a collapsed Gibbs sampler
From MaRDI portal
Publication:2631382
Abstract: Latent class analysis is used to perform model based clustering for multivariate categorical responses. Selection of the variables most relevant for clustering is an important task which can affect the quality of clustering considerably. This work considers a Bayesian approach for selecting the number of clusters and the best clustering variables. The main idea is to reformulate the problem of group and variable selection as a probabilistically driven search over a large discrete space using Markov chain Monte Carlo (MCMC) methods. This approach results in estimates of degree of relevance of each variable for clustering along with posterior probability for the number of clusters. Bayes factors can then be easily calculated, and a suitable model chosen in a principled manner. Both selection tasks are carried out simultaneously using an MCMC approach based on a collapsed Gibbs sampling method, whereby several model parameters are integrated from the model, substantially improving computational performance. Approaches for estimating posterior marginal probabilities of class membership, variable inclusion and number of groups are proposed, and post-hoc procedures for parameter and uncertainty estimation are outlined. The approach is tested on simulated and real data.
Recommendations
Cites work
- A generalized multiple-try version of the reversible jump algorithm
- Asymptotic behaviour of the posterior distribution in overfitted mixture models
- Bayes Factors
- Bayesian analysis of mixture models with an unknown number of components\,--\,an alternative to reversible jump methods.
- Bayesian Inference in Econometric Models Using Monte Carlo Integration
- Bayesian Measures of Model Complexity and Fit
- Bayesian Variable Selection in Clustering High-Dimensional Data
- Block clustering with collapsed latent block models
- Computational and Inferential Difficulties with Mixture Posterior Distributions
- Dealing With Label Switching in Mixture Models
- Deviance information criteria for missing data models
- Estimating marginal likelihoods for mixture and Markov switching models using bridge sampling techniques*
- Estimating the dimension of a model
- Exploratory latent structure analysis using both identifiable and unidentifiable models
- Finite mixture and Markov switching models.
- Finite mixture models
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 509150 (Why is no real title available?)
- scientific article; zbMATH DE number 1085980 (Why is no real title available?)
- scientific article; zbMATH DE number 947416 (Why is no real title available?)
- scientific article; zbMATH DE number 3444596 (Why is no real title available?)
- scientific article; zbMATH DE number 2188755 (Why is no real title available?)
- Improved Bayesian inference for the stochastic block model with application to large networks
- Latent class analysis variable selection
- Latent Class Model Diagnosis
- Mixture of latent trait analyzers for model-based clustering of categorical data
- Properties of nested sampling
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
- Reversible Jump, Birth-and-Death and More General Continuous Time Markov Chain Monte Carlo Samplers
- Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images
- Variable Selection for Model-Based Clustering
Cited in
(15)- Optimal Bayesian estimators for latent variable cluster models
- Variable selection for model-based clustering using the integrated complete-data likelihood
- Variable selection for latent class analysis with application to low back pain diagnosis
- Simultaneous variable weighting and determining the number of clusters -- a weighted Gaussian means algorithm
- A hierarchical Bayesian approach for examining heterogeneity in choice decisions
- A model-based approach to simultaneous clustering and dimensional reduction of ordinal data
- Variable selection methods for model-based clustering
- Bayesian Variable Selections for Probit Models with Componentwise Gibbs Samplers
- Bayesian variable selection for latent class models
- An overview on the URV model-based approach to cluster mixed-type data
- Bayesian inference for an unknown number of attributes in restricted latent class models
- On the strong consistency of feature-weighted \(k\)-means clustering in a nearmetric space
- Fast sampling and model selection for Bayesian mixture models
- Variable selection for mixed data clustering: application in human population genomics
- Exact and Monte Carlo calculations of integrated likelihoods for the latent class model
This page was built for publication: Bayesian variable selection for latent class analysis using a collapsed Gibbs sampler
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2631382)
