Inference for multivariate normal mixtures
From MaRDI portal
Abstract: Multivariate normal mixtures provide a flexible model for high-dimensional data. They are widely used in statistical genetics, statistical finance, and other disciplines. Due to the unboundedness of the likelihood function, classical likelihood-based methods, which may have nice practical properties, are inconsistent. In this paper, we recommend a penalized likelihood method for estimating the mixing distribution. We show that the maximum penalized likelihood estimator is strongly consistent when the number of components has a known upper bound. We also explore a convenient EM-algorithm for computing the maximum penalized likelihood estimator. Extensive simulations are conducted to explore the effectiveness and the practical limitations of both the new method and the ratified maximum likelihood estimators. Guidelines are provided based on the simulation results.
Recommendations
- Inference for normal mixtures in mean and variance
- A CLASSICAL INVARIANCE APPROACH TO THE NORMAL MIXTURE PROBLEM
- Penalized Maximum Likelihood Estimator for Normal Mixtures
- Maximum likelihood estimation for multivariate skew normal mixture models
- Maximum likelihood estimation of the multivariate normal mixture model
Cites work
- A constrained formulation of maximum-likelihood estimation for normal mixture distributions
- A likelihood-based constrained algorithm for multivariate normal mixture models
- Bayesian Variable Selection in Clustering High-Dimensional Data
- Consistency of the Maximum Likelihood Estimator in the Presence of Infinitely Many Incidental Parameters
- Estimating the components of a mixture of normal distributions
- Estimation with quadratic loss.
- Finite mixture and Markov switching models.
- Finite mixture models
- How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis
- scientific article; zbMATH DE number 4159863 (Why is no real title available?)
- scientific article; zbMATH DE number 3826980 (Why is no real title available?)
- Inference for normal mixtures in mean and variance
- Maximum penalized likelihood estimation. Vol. 1: Density estimation
- Mixture Densities, Maximum Likelihood and the EM Algorithm
- Mixture models: theory, geometry and applications
- Multivariate Normal Mixtures: A Fast Consistent Method of Moments
- Note on the Consistency of the Maximum Likelihood Estimate
- On the convergence properties of the EM algorithm
- Slowly varying nonlinear waves in a warm plasma stream
- Statistical analysis of finite mixture distributions
- The topography of multivariate normal mixtures
- Variable Selection for Model-Based Clustering
Cited in
(46)- A profile likelihood method for normal mixture with unequal variance
- Testing for the number of states in hidden Markov models
- Inference for multivariate mixtures of two unknown symmetric components
- Consistency of the MLE under mixture models
- Statistical inference based on bridge divergences
- A note on the article ``Inference for multivariate normal mixtures by J. Chen and X. Tan
- Classical and Bayesian inference of a mixture of bivariate exponentiated exponential model
- Consistency of the MLE under a two-parameter gamma mixture model with a structural shape parameter
- A note on maximum likelihood estimation for mixture models
- Estimating parameters of mixtures of multivariate \(t\)-populations and application to classification of observations
- A mixture factor model with applications to microarray data
- On consistency of the MLE under finite mixtures of location-scale distributions with a structural parameter
- A data driven equivariant approach to constrained Gaussian mixture modeling
- Estimating the mean and variance of a high-dimensional normal distribution using a mixture prior
- A computational strategy for doubly smoothed MLE exemplified in the normal mixture model
- A likelihood-based constrained algorithm for multivariate normal mixture models
- Assessment of the number of components in Gaussian mixture models in the presence of multiple local maximizers
- Strong consistency of the MLE under two-parameter Gamma mixture models with a structural scale parameter
- Penalized maximum likelihood estimation for Gaussian hidden Markov models
- Simultaneous credible bands for latent Gaussian models
- Bayesian estimation of multivariate normal mixtures with covariate-dependent mixing weights, with an application in antimicrobial resistance monitoring
- Inference for normal mixtures in mean and variance
- On the upper bound of the number of modes of a multivariate normal mixture
- Penalized likelihood-ratio test for finite mixture models with multinomial observations
- Minimax estimation for mixtures of Wishart distributions
- Consistency, breakdown robustness, and algorithms for robust improper maximum likelihood clustering
- Bootstrap estimation and model selection for multivariate normal mixtures using parallel computing with graphics processing units
- A CLASSICAL INVARIANCE APPROACH TO THE NORMAL MIXTURE PROBLEM
- Label switching and its solutions for frequentist mixture models
- A mixture of generalized hyperbolic distributions
- Consistency of the penalized MLE for two-parameter gamma mixture models
- Multivariate Normal Mixtures: A Fast Consistent Method of Moments
- scientific article; zbMATH DE number 5218712 (Why is no real title available?)
- A simple root selection method for univariate finite normal mixture models
- Variable selection in finite mixture of median regression models using skew-normal distribution
- Warp Bridge Sampling: The Next Generation
- Understanding and Addressing the Unbounded “Likelihood” Problem
- Avoiding spurious local maximizers in mixture modeling
- Penalized maximum likelihood estimator for finite multivariate skew normal mixtures
- Discussion on “Distributional independent component analysis for diverse neuroimaging modalities” by Ben Wu, Subhadip Pal, Jian Kang, and Ying Guo
- Challenges in model-based clustering
- Root selection in normal mixture models
- Discovering Active Subspaces for High-Dimensional Computer Models
- Determine the number of states in hidden Markov models via marginal likelihood
- Order selection in finite mixtures of linear regressions
- Degeneracy of the EM algorithm for the MLE of multivariate Gaussian mixtures and dynamic constraints
This page was built for publication: Inference for multivariate normal mixtures
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1021835)
