A general trimming approach to robust cluster analysis

DOI10.1214/07-AOS515zbMATH Open1360.62328arXiv0806.2976MaRDI QIDQ930658FDOQ930658

Luis A. García-Escudero, Carlos Matrán, Alfonso Gordaliza, Agustín Mayo-Iscar

Publication date: 1 July 2008

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: We introduce a new method for performing clustering with the aim of fitting clusters with different scatters and weights. It is designed by allowing to handle a proportion $alpha$ of contaminating data to guarantee the robustness of the method. As a characteristic feature, restrictions on the ratio between the maximum and the minimum eigenvalues of the groups scatter matrices are introduced. This makes the problem to be well defined and guarantees the consistency of the sample solutions to the population ones. The method covers a wide range of clustering approaches depending on the strength of the chosen restrictions. Our proposal includes an algorithm for approximately solving the sample problem.

Full work available at URL: https://arxiv.org/abs/0806.2976

zbMATH Keywords

asymptoticscluster analysistrimmingrobustnessEM-algorithmtrimmed \(k\)-meansDykstra's algorithmfast-MCD algorithm

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Robustness and adaptive procedures (parametric inference) (62F35)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Weak convergence and empirical processes. With applications to statistics
• Finite mixture models
• A numerically stable dual method for solving strictly convex quadratic programs
• A constrained formulation of maximum-likelihood estimation for normal mixture distributions
• A robust method for cluster analysis
• Breakdown points for maximum likelihood estimators of location-scale mixtures
• A classification EM algorithm for clustering and two stochastic versions
• How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis
• Model-Based Gaussian and Non-Gaussian Clustering
• A general trimming approach to robust cluster analysis
• Linear grouping using orthogonal regression
• Trimmed \(k\)-means: An attempt to robustify quantizers
• Robustness Properties of k Means and Trimmed k Means
• An Algorithm for Restricted Least Squares Regression
• Multivariate Clustering Procedures with Variable Metrics
• A central limit theorem for multivariate generalized trimmed \(k\)-means
• The importance of the scales in heterogeneous robust clustering

Cited In (89)

• Co-clustering contaminated data: a robust model-based approach
• Comments on ``Data science, big data and statistics
• A data driven equivariant approach to constrained Gaussian mixture modeling
• Soft clustering
• Finding outliers in Gaussian model-based clustering
• Attraction-repulsion clustering: a way of promoting diversity linked to demographic parity in fair clustering
• Fuzzy and model based clustering methods: can we fruitfully compare them?
• Estimation and computations for Gaussian mixtures with uniform noise under separation constraints
• Robust fitting of mixture models using weighted complete estimating equations
• Improving the non‐compensatory trace‐clustering decision process
• Robust clustering based on trimming
• Robust clustering of functional directional data
• A robust EM clustering approach: ROBEM
• A Kemeny distance-based robust fuzzy clustering for preference data
• A General Hybrid Clustering Technique
• Finite Mixture of Linear Regression Models: An Adaptive Constrained Approach to Maximum Likelihood Estimation
• Clustering genomic words in human DNA using peaks and trends of distributions
• A simple root selection method for univariate finite normal mixture models
• Improving model choice in classification: an approach based on clustering of covariance matrices
• Fast and robust clustering of general-shaped structures with tk-merge
• Robust Clustering Method in the Presence of Scattered Observations
• Strong consistency of \(k\)-parameters clustering
• Robust Bregman clustering
• Maximum likelihood estimation of heterogeneous mixtures of Gaussian and uniform distributions
• Comments on: ``Model-based clustering and classification with non-normal mixture distributions
• Avoiding spurious local maximizers in mixture modeling
• Snipping for robust \(k\)-means clustering under component-wise contamination
• Robust variable selection for model-based learning in presence of adulteration
• Model-based clustering
• Estimating the number of neurons in multi-neuronal spike trains
• The influence function of the TCLUST robust clustering procedure
• Robust model-based clustering via mixtures of skew-\(t\) distributions with missing information
• Trimming algorithms for clustering contaminated grouped data and their robustness
• Robust distances for outlier-free goodness-of-fit testing
• Robust clustering tools based on optimal transportation
• Robust model-based clustering with mild and gross outliers
• Minimum profile Hellinger distance estimation for a semiparametric mixture model
• Eigenvalues and constraints in mixture modeling: geometric and computational issues
• Robust fitting of mixtures of GLMs by weighted likelihood
• Robust joint modeling of mean and dispersion through trimming
• A reweighting approach to robust clustering
• Title not available (Why is that?)
• Parsimonious mixtures of multivariate contaminated normal distributions
• Weighted likelihood latent class linear regression
• A fuzzy approach to robust regression clustering
• Weighted likelihood mixture modeling and model-based clustering
• Model-based clustering with determinant-and-shape constraint
• A simulation study to compare robust clustering methods based on mixtures
• Robust clusterwise linear regression through trimming
• A robust approach to model-based classification based on trimming and constraints. Semi-supervised learning in presence of outliers and label noise
• Anomaly and novelty detection for robust semi-supervised learning
• Cluster analysis with cellwise trimming and applications for the robust clustering of curves
• A constrained robust proposal for mixture modeling avoiding spurious solutions
• Simulating mixtures of multivariate data with fixed cluster overlap in FSDA library
• The trimmed mean in non-parametric regression function estimation
• Comments on ``The power of monitoring: how to make the most of a contaminated multivariate sample
• Solution path clustering with adaptive concave penalty
• Robust and sparse \(k\)-means clustering for high-dimensional data
• The joint role of trimming and constraints in robust estimation for mixtures of Gaussian factor analyzers
• Fast and robust estimation of the multivariate errors in variables model
• A review of robust clustering methods
• Robust Linear Clustering
• Robust clustering for functional data based on trimming and constraints
• Robust inference for parsimonious model-based clustering
• Finding the Number of Normal Groups in Model-Based Clustering via Constrained Likelihoods
• Robust constrained fuzzy clustering
• Robust estimation of mixtures of regressions with random covariates, via trimming and constraints
• Assessing when a sample is mostly normal
• Impact of Contamination on Training and Test Error Rates in Statistical Clustering
• Exploring the number of groups in robust model-based clustering
• Multiple scaled contaminated normal distribution and its application in clustering
• Model-based clustering and outlier detection with missing data
• Robust, fuzzy, and parsimonious clustering, based on mixtures of factor analyzers
• Finding Meaningful Cluster Structure Amidst Background Noise
• On the breakdown behavior of the TCLUST clustering procedure
• A fast and recursive algorithm for clustering large datasets with \(k\)-medians
• Noise-free latent block model for high dimensional data
• Assessing trimming methodologies for clustering linear regression data
• A Tailored Multivariate Mixture Model for Detecting Proteins of Concordant Change Among Virulent Strains of Clostridium Perfringens
• K-bMOM: A robust Lloyd-type clustering algorithm based on bootstrap median-of-means
• Wild adaptive trimming for robust estimation and cluster analysis
• A general trimming approach to robust cluster analysis
• A constrained maximum likelihood estimation for skew normal mixtures
• On consistency factors and efficiency of robust \(S\)-estimators
• Using combinatorial optimization in model-based trimmed clustering with cardinality constraints
• Similarity of samples and trimming
• Finite mixture-of-gamma distributions: estimation, inference, and model-based clustering
• A fast algorithm for robust constrained clustering
• Title not available (Why is that?)

Uses Software

• Flury

This page was built for publication: A general trimming approach to robust cluster analysis

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q930658)