A tensor-EM method for large-scale latent class analysis with binary responses
From MaRDI portal
Abstract: Latent class models are powerful statistical modeling tools widely used in psychological, behavioral, and social sciences. In the modern era of data science, researchers often have access to response data collected from large-scale surveys or assessments, featuring many items (large J) and many subjects (large N). This is in contrary to the traditional regime with fixed J and large N. To analyze such large-scale data, it is important to develop methods that are both computationally efficient and theoretically valid. In terms of computation, the conventional EM algorithm for latent class models tends to have a slow algorithmic convergence rate for large-scale data and may converge to some local optima instead of the maximum likelihood estimator(MLE). Motivated by this, we introduce the tensor decomposition perspective into latent class analysis with binary responses. Methodologically, we propose to use a moment-based tensor power method in the first step, and then use the obtained estimates as initialization for the EM algorithm in the second step. Theoretically, we establish the clustering consistency of the MLE in assigning subjects into latent classes when N and J both go to infinity. Simulation studies suggest that the proposed tensor-EM pipeline enjoys both good accuracy and computational efficiency for large-scale data with binary responses. We also apply the proposed method to an educational assessment dataset as an illustration.
Recommendations
- Efficient direct sampling MCEM algorithm for latent variable models with binary responses
- A Joint MLE Approach to Large-Scale Structured Latent Attribute Analysis
- Optimization-based model fitting for latent class and latent profile analyses
- A Doubly Enhanced EM Algorithm for Model-Based Tensor Clustering
- Linear latent structure analysis: mixture distribution models with linear constraints
Cites work
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 1832191 (Why is no real title available?)
- scientific article; zbMATH DE number 3290846 (Why is no real title available?)
- A Joint MLE Approach to Large-Scale Structured Latent Attribute Analysis
- A classification EM algorithm for clustering and two stochastic versions
- A spectral algorithm for latent Dirichlet allocation
- Asymptotic properties of criteria for selection of variables in multiple regression
- Consistent Estimates Based on Partially Consistent Observations
- Estimating the dimension of a model
- Exploratory latent structure analysis using both identifiable and unidentifiable models
- Finite Mixture Modeling with Mixture Outcomes Using the EM Algorithm
- Identifiability of latent class models with covariates
- Identifiability of parameters in latent structure models with many observed variables
- Identifiability of restricted latent class models with binary responses
- Identifying Latent Structures in Restricted Latent Class Models
- Joint maximum likelihood estimation for high-dimensional exploratory item factor analysis
- Latent Variable Regression for Multiple Discrete Outcomes
- Latent class analysis variable selection
- Learning latent and hierarchical structures in cognitive diagnosis models
- Learning mixtures of spherical Gaussians: moment methods and spectral decompositions (extended abstract)
- More factors than subjects, tests and treatments: An indeterminacy theorem for canonical decomposition and individual differences scaling
- On the Best Rank-1 and Rank-(R1 ,R2 ,. . .,RN) Approximation of Higher-Order Tensors
- Regularized latent class analysis with application in cognitive diagnosis
- Spectral methods meet EM: a provably optimal algorithm for crowdsourcing
- Statistical guarantees for the EM algorithm: from population to sample-based analysis
- Structured latent factor analysis for large-scale data: identifiability, estimability, and their implications
- Tensor Decompositions and Applications
- Tensor decompositions for learning latent variable models
- Tuning parameter selection in high dimensional penalized likelihood
Cited in
(10)- Finding mixed memberships in categorical data
- Latent theme dictionary model for finding co-occurrent patterns in process data
- A Doubly Enhanced EM Algorithm for Model-Based Tensor Clustering
- Leveraging independence in high-dimensional mixed linear regression
- Degree-Heterogeneous Latent Class Analysis for High-Dimensional Discrete Data
- Efficient direct sampling MCEM algorithm for latent variable models with binary responses
- Spectral clustering with likelihood refinement for high-dimensional latent class recovery
- Optimization-based model fitting for latent class and latent profile analyses
- Exact sampling of spanning trees via fast-forwarded random walks
- Mixed membership estimation for categorical data with weighted responses
This page was built for publication: A tensor-EM method for large-scale latent class analysis with binary responses
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6175692)
