A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering
From MaRDI portal
Publication:2058771
Abstract: High-dimensional data clustering has become and remains a challenging task for modern statistics and machine learning, with a wide range of applications. We consider in this work the powerful discriminative latent mixture model, and we extend it to the Bayesian framework. Modeling data as a mixture of Gaussians in a low-dimensional discriminative subspace, a Gaussian prior distribution is introduced over the latent group means and a family of twelve submodels are derived considering different covariance structures. Model inference is done with a variational EM algorithm, while the discriminative subspace is estimated via a Fisher-step maximizing an unsupervised Fisher criterion. An empirical Bayes procedure is proposed for the estimation of the prior hyper-parameters, and an integrated classification likelihood criterion is derived for selecting both the number of clusters and the submodel. The performances of the resulting Bayesian Fisher-EM algorithm are investigated in two thorough simulated scenarios, regarding both dimensionality as well as noise and assessing its superiority with respect to state-of-the-art Gaussian subspace clustering models. In addition to standard real data benchmarks, an application to single image denoising is proposed, displaying relevant results. This work comes with a reference implementation for the R software in the FisherEM package accompanying the paper.
Recommendations
- Simultaneous model-based clustering and visualization in the Fisher discriminative subspace
- High-dimensional data clustering
- On the estimation of the latent discriminative subspace in the Fisher-EM algorithm
- Discriminative variable selection for clustering with the sparse Fisher-EM algorithm
- Bayesian Variable Selection in Clustering High-Dimensional Data
Cites work
- 10.1162/jmlr.2003.3.4-5.993
- A classification EM algorithm for clustering and two stochastic versions
- A generalized Foley–Sammon transform based on generalized fisher discriminant criterion and its application to face recognition
- A nonlocal Bayesian image denoising algorithm
- A Review of Image Denoising Algorithms, with a New One
- An Optimal Set of Discriminant Vectors
- Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems
- Discriminative variable selection for clustering with the sparse Fisher-EM algorithm
- Feature selection for unsupervised learning
- Finite mixture models
- Handbook of mixture analysis
- Heteroscedastic factor mixture analysis
- High-dimensional data clustering
- High-dimensional mixture models for unsupervised image denoising (HDMI)
- scientific article; zbMATH DE number 6388313 (Why is no real title available?)
- scientific article; zbMATH DE number 3126094 (Why is no real title available?)
- scientific article; zbMATH DE number 3942813 (Why is no real title available?)
- scientific article; zbMATH DE number 47593 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 1059776 (Why is no real title available?)
- Local Smoothing Neighborhood Filters
- Mixed membership stochastic blockmodels
- Model-based clustering and classification for data science. With applications in R
- Model-based clustering of high-dimensional data: a review
- Model-Based Gaussian and Non-Gaussian Clustering
- On the estimation of the latent discriminative subspace in the Fisher-EM algorithm
- On Using Principal Components Before Separating a Mixture of Two Multivariate Normal Distributions
- Parametric Empirical Bayes Inference: Theory and Applications
- Pattern classification.
- Pattern recognition and machine learning.
- Simultaneous model-based clustering and visualization in the Fisher discriminative subspace
- Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity
- Sparse linear discriminant analysis with applications to high dimensional low sample size data
- SURE guided Gaussian mixture image denoising
- Theoretical and practical considerations on the convergence properties of the Fisher-EM algorithm
- Trace optimization and eigenproblems in dimension reduction methods.
Cited in
(5)- Simultaneous model-based clustering and visualization in the Fisher discriminative subspace
- Subclass graph embedding and a marginal Fisher analysis paradigm
- Infinite max-margin factor analysis via data augmentation
- On the estimation of the latent discriminative subspace in the Fisher-EM algorithm
- FisherEM
This page was built for publication: A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2058771)
