Choosing initial values for the EM algorithm for finite mixtures

DOI10.1016/S0167-9473(02)00177-9zbMath1429.62082MaRDI QIDQ951825

Dimitris Karlis, Evdokia Xekalaki

Publication date: 4 November 2008

Published in: Computational Statistics and Data Analysis (Search for Journal in Brave)

zbMATH Keywords

moment estimatesfinite mixturesAitken accelerationbootstrap root search

Mathematics Subject Classification ID

Point estimation (62F10)

Related Items (80)

Variable selection in finite mixture of median regression models using skew-normal distribution ⋮ Multilevel cluster-weighted models for the evaluation of hospitals ⋮ Fitting insurance and economic data with outliers: a flexible approach based on finite mixtures of contaminated gamma distributions ⋮ Robust clustering of multiply censored data via mixtures of \(t\) factor analyzers ⋮ An artificial bee colony algorithm for mixture model-based clustering ⋮ On the mixtures of length-biased Weibull distributions for loss severity modeling ⋮ Clustering bivariate mixed-type data via the cluster-weighted model ⋮ Initializing the EM Algorithm for Univariate Gaussian, Multi-Component, Heteroscedastic Mixture Models by Dynamic Programming Partitions ⋮ Erratum to: The Generalized Linear Mixed Cluster-Weighted Model ⋮ Addressing overfitting and underfitting in Gaussian model-based clustering ⋮ Location and scale mixtures of Gaussians with flexible tail behaviour: properties, inference and application to multivariate clustering ⋮ Hierarchical mixture-of-experts models for count variables with excessive zeros ⋮ Robust clustering in regression analysis via the contaminated Gaussian cluster-weighted model ⋮ Mixture model-based association analysis with case-control data in genome wide association studies ⋮ Computational aspects of fitting mixture models via the expectation-maximization algorithm ⋮ Penalized estimation in finite mixture of ultra-high dimensional regression models ⋮ Finite mixtures, projection pursuit and tensor rank: a triangulation ⋮ Item selection by latent class-based methods: an application to nursing home evaluation ⋮ Robust algorithm for attack detection based on time‐varying hidden Markov model subject to outliers ⋮ EMBRACE: An EM‐based bias reduction approach through Copas‐model estimation for quantifying the evidence of selective publishing in network meta‐analysis ⋮ Finite mixtures of multivariate skew \(t\)-distributions: some recent and new results ⋮ A Selective Overview and Comparison of Robust Mixture Regression Estimators ⋮ Flexible mixture modelling using the multivariate skew-\(t\)-normal distribution ⋮ Discussion on “Distributional independent component analysis for diverse neuroimaging modalities” by Ben Wu, Subhadip Pal, Jian Kang, and Ying Guo ⋮ Initialization of Hidden Markov and Semi‐Markov Models: A Critical Evaluation of Several Strategies ⋮ Estimation for finite mixture of mode regression models using skew-normal distribution ⋮ Variable selection in finite mixture of location and mean regression models using skew-normal distribution ⋮ Extending mixtures of factor models using the restricted multivariate skew-normal distribution ⋮ Seemingly unrelated clusterwise linear regression for contaminated data ⋮ Improving the vector \(\varepsilon\) acceleration for the EM algorithm using a re-starting procedure ⋮ Multiple scaled contaminated normal distribution and its application in clustering ⋮ Estimation of finite mixture models of skew-symmetric circular distributions ⋮ Initializing the EM algorithm in Gaussian mixture models with an unknown number of components ⋮ A simulation study to compare robust clustering methods based on mixtures ⋮ Spatial risk mapping for rare disease with hidden Markov fields and variational EM ⋮ Optimal estimation of Gaussian mixtures via denoised method of moments ⋮ Unnamed Item ⋮ Asymmetric clusters and outliers: mixtures of multivariate contaminated shifted asymmetric Laplace distributions ⋮ Improved model-based clustering performance using Bayesian initialization averaging ⋮ Comparative study for inference of hidden classes in stochastic block models ⋮ Robust algorithms for multiphase regression models ⋮ The REBMIX Algorithm for the Multivariate Finite Mixture Estimation ⋮ Drug risk assessment with determining the number of sub-populations under finite mixture normal models ⋮ An application of principal stratification to control for institutionalization at follow-up in studies of substance abuse treatment programs ⋮ A mixture integer-valued ARCH model ⋮ Preliminary estimators for a mixture model of ordinal data ⋮ Model-based clustering and outlier detection with missing data ⋮ A generalized framework for modelling ordinal data ⋮ Maximum likelihood estimation of heterogeneous mixtures of Gaussian and uniform distributions ⋮ On the estimation of mixtures of Poisson regression models with large number of components ⋮ Parameter identification for Wiener-finite impulse response system with output data of missing completely at random mechanism and time delay ⋮ Model-based capacitated clustering with posterior regularization ⋮ Latent ignorability and item selection for nursing home case-mix evaluation ⋮ Model-based clustering with envelopes ⋮ On modeling left-truncated loss data using mixtures of distributions ⋮ Adaptive fault detection and diagnosis using parsimonious Gaussian mixture models trained with distributed computing techniques ⋮ A profile likelihood method for normal mixture with unequal variance ⋮ Order selection in finite mixtures of linear regressions ⋮ Classical and Bayesian inference of a mixture of bivariate exponentiated exponential model ⋮ Modelling Poisson marked point processes using bivariate mixture transition distributions ⋮ Estimation using hybrid censored data from a generalized inverted exponential distribution ⋮ Flexible mixture modelling with the polynomial Gaussian cluster-weighted model ⋮ Finite mixture-of-gamma distributions: estimation, inference, and model-based clustering ⋮ An automatic clustering algorithm for probability density functions ⋮ Hypothesis Testing for Mixture Model Selection ⋮ Recent asymptotic results in testing for mixtures ⋮ Mixtures of multivariate contaminated normal regression models ⋮ On maximum likelihood estimation of the general projected normal distribution ⋮ Mixtures of factor analyzers with covariates for modeling multiply censored dependent variables ⋮ JOINT MODELING OF CORRELATED TIME DURATIONS AND THEIR MARKS USING A WEIBULL POISSON MARKED POINT PROCESS MIXTURE MODELS ⋮ Validation of the alternating conditional estimation algorithm for estimation of flexible extensions of Cox's proportional hazards model with nonlinear constraints on the parameters ⋮ Parsimonious mixtures of multivariate contaminated normal distributions ⋮ MMK for heterogeneous data: identifiability, estimation and application ⋮ Cluster validation for mixtures of regressions via the total sum of squares decomposition ⋮ On comparative study of clustering using finite mixture of non-Gaussian distributions ⋮ Improvements in estimating the probability of informed trading models ⋮ Types of likelihood maxima in mixture models and their implication on the performance of tests ⋮ Randomly initialized EM algorithm for two-component Gaussian mixture achieves near optimality in \(O(\sqrt{n})\) iterations ⋮ The generalized linear mixed cluster-weighted model ⋮ Model-based clustering and classification with non-normal mixture distributions

Cites Work

• Unnamed Item
• Unnamed Item
• The geometry of mixture likelihoods: A general theory
• Consistent estimation of a mixing distribution
• On testing for the number of components in a mixed Poisson model
• The distribution of the likelihood ratio for mixtures of densities from the one-parameter exponential family
• Testing for the number of components in a mixture of normal distributions using moment estimators
• Measuring the relative effectiveness of moment estimators as starting values in maximizing likelihoods
• Likelihood ratio tests based on subglobal optimization: A power comparison in exponential mixture models
• Alternative EM methods for nonparametric finite mixture models
• A Comparison of Minimum Distance and Maximum Likelihood Estimation of a Mixture Proportion
• Newton-Raphson and EM Algorithms for Linear Mixed-Effects Models for Repeated-Measures Data
• Some Methods for Studying the Mixture of Two Normal (Lognormal) Distributions
• Nonparametric Maximum Likelihood Estimation of a Mixing Distribution
• Weighted Likelihood Equations with Bootstrap Root Search
• Finite mixture models
• Mixture Models, Robustness, and the Weighted Likelihood Methodology
• Multivariate Normal Mixtures: A Fast Consistent Method of Moments
• A cautionary note on likelihood ratio tests in mixture models
• Robust inference for finite Poisson mixtures

This page was built for publication: Choosing initial values for the EM algorithm for finite mixtures