Simultaneous model-based clustering and visualization in the Fisher discriminative subspace

DOI10.1007/S11222-011-9249-9zbMATH Open1322.62162arXiv1101.2374OpenAlexW3125929818MaRDI QIDQ134334FDOQ134334

Authors: Charles Bouveyron, Camille Brunet, Charles Bouveyron, Camille Brunet 

Publication date: 13 April 2011

Published in: Statistics and Computing (Search for Journal in Brave)

Abstract: Clustering in high-dimensional spaces is nowadays a recurrent problem in many scientific domains but remains a difficult task from both the clustering accuracy and the result understanding points of view. This paper presents a discriminative latent mixture (DLM) model which fits the data in a latent orthonormal discriminative subspace with an intrinsic dimension lower than the dimension of the original space. By constraining model parameters within and between groups, a family of 12 parsimonious DLM models is exhibited which allows to fit onto various situations. An estimation algorithm, called the Fisher-EM algorithm, is also proposed for estimating both the mixture parameters and the discriminative subspace. Experiments on simulated and real datasets show that the proposed approach performs better than existing clustering methods while providing a useful representation of the clustered data. The method is as well applied to the clustering of mass spectrometry data.

Full work available at URL: https://arxiv.org/abs/1101.2374

Recommendations

• A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering
• On the estimation of the latent discriminative subspace in the Fisher-EM algorithm
• High-dimensional data clustering
• Discriminative variable selection for clustering with the sparse Fisher-EM algorithm
• The generic subspace clustering model

zbMATH Keywords

model-based clusteringvisualizationparsimonious modelsdiscriminative subspaceFisher criterionhigh-dimensional clustering

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Applications of statistics to biology and medical sciences; meta analysis (62P10) Graphical methods in statistics (62A09)

Cites Work

• MCLUST: Software for model-based cluster analysis
• Estimating the dimension of a model
• Variable Selection for Clustering with Gaussian Mixture Models
• Model-Based Clustering, Discriminant Analysis, and Density Estimation
• Finite mixture models
• Variable Selection for Model-Based Clustering
• A new look at the statistical model identification
• A classification EM algorithm for clustering and two stochastic versions
• Choosing starting values for the EM algorithm for getting the highest likelihood in multivariate Gaussian mixture models
• High-dimensional data clustering
• Modelling high-dimensional data by mixtures of factor analyzers
• Penalized discriminant analysis
• Some results on Tchebycheffian spline functions and stochastic processes
• Title not available (Why is that?)
• Title not available (Why is that?)
• DALASS: variable selection in discriminant analysis via the LASSO
• EM algorithms for ML factor analysis
• K-means iterative Fisher (KIF) unsupervised clustering algorithm applied to image texture segmentation
• Characterization of a family of algorithms for generalized discriminant analysis on undersampled problems
• CANONICAL VARIATE ANALYSIS-A GENERAL MODEL FORMULATION
• Title not available (Why is that?)
• Title not available (Why is that?)
• An Optimal Set of Discriminant Vectors
• A generalized Foley–Sammon transform based on generalized fisher discriminant criterion and its application to face recognition
• The independent factor analysis approach to latent variable modelling
• Title not available (Why is that?)
• A theorem on the uncorrelated optimal discriminant vectors
• Matrix computations.

Cited In (31)

• Model-based clustering of high-dimensional data: a review
• A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering
• Subclass graph embedding and a marginal Fisher analysis paradigm
• Model-based clustering of high-dimensional data streams with online mixture of probabilistic PCA
• Noise-insensitive discriminative subspace fuzzy clustering
• Variable selection methods for model-based clustering
• Distance Metrics and Clustering Methods for Mixed‐type Data
• Robust discriminative clustering with sparse regularizers
• Discriminative variable selection for clustering with the sparse Fisher-EM algorithm
• On the estimation of the latent discriminative subspace in the Fisher-EM algorithm
• Variable selection for clustering and classification
• Theoretical and practical considerations on the convergence properties of the Fisher-EM algorithm
• Variable selection for skewed model-based clustering: application to the identification of novel sleep phenotypes
• Sparse and geometry-aware generalisation of the mutual information for joint discriminative clustering and feature selection
• Recent developments in expectation-maximization methods for analyzing complex data
• Reducing data dimension for cluster detection
• Clustering, classification, discriminant analysis, and dimension reduction via generalized hyperbolic mixtures
• The discriminative functional mixture model for a comparative analysis of bike sharing systems
• Kernel discriminant analysis and clustering with parsimonious Gaussian process models
• A classification method for binary predictors combining similarity measures and mixture models
• FisherEM
• Group-wise shrinkage estimation in penalized model-based clustering
• A model-based approach to simultaneous clustering and dimensional reduction of ordinal data
• Sparse optimal discriminant clustering
• Model-based clustering with sparse covariance matrices
• Logistic Normal Multinomial Factor Analyzers for Clustering Microbiome Data
• Dimension reduction for model-based clustering via mixtures of multivariate \(t\)-distributions
• Factor probabilistic distance clustering (FPDC): a new clustering method
• A family of parsimonious mixtures of multivariate Poisson-lognormal distributions for clustering multivariate count data
• rCOSA: a software package for clustering objects on subsets of attributes
• Model-based clustering with nested Gaussian clusters

Uses Software

• mclust
• PGMM

This page was built for publication: Simultaneous model-based clustering and visualization in the Fisher discriminative subspace

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q134334)