Flexible parametric bootstrap for testing homogeneity against clustering and assessing the number of clusters
From MaRDI portal
(Redirected from Publication:5963783)
Abstract: There are two notoriously hard problems in cluster analysis, estimating the number of clusters, and checking whether the population to be clustered is not actually homogeneous. Given a dataset, a clustering method and a cluster validation index, this paper proposes to set up null models that capture structural features of the data that cannot be interpreted as indicating clustering. Artificial datasets are sampled from the null model with parameters estimated from the original dataset. This can be used for testing the null hypothesis of a homogeneous population against a clustering alternative. It can also be used to calibrate the validation index for estimating the number of clusters, by taking into account the expected distribution of the index under the null model for any given number of clusters. The approach is illustrated by three examples, involving various different clustering techniques (partitioning around medoids, hierarchical methods, a Gaussian mixture model), validation indexes (average silhouette width, prediction strength and BIC), and issues such as mixed type data, temporal and spatial autocorrelation.
Recommendations
- Significance testing in clustering
- Identifying genuine clusters in a classification
- Identifying genuine clusters in a classification
- How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis
- Comparing clusterings and numbers of clusters by aggregation of calibrated clustering validity indexes
Cites work
- Consistent estimation of the order of mixture models.
- Distance-based parametric bootstrap tests for clustering of species ranges
- Finding Groups in Data
- Finding the Number of Clusters in a Dataset
- How Many Clusters? Which Clustering Method? Answers Via Model-Based Cluster Analysis
- scientific article; zbMATH DE number 41467 (Why is no real title available?)
- scientific article; zbMATH DE number 708500 (Why is no real title available?)
- scientific article; zbMATH DE number 3429948 (Why is no real title available?)
- Model-Based Clustering, Classification, and Density Estimation Using mclust in R
- Model-Based Clustering, Discriminant Analysis, and Density Estimation
- Multidimensional scaling.
- Probabilistic models in cluster analysis
Cited in
(12)- Spatial variability clustering for spatially dependent functional data
- REMAXINT: a two-mode clustering-based method for statistical inference on two-way interaction
- Significance testing in clustering
- Bootstrapping for Significance of Compact Clusters in Multidimensional Datasets
- Testing independence between two nonhomogeneous point processes in time
- An adequacy approach for deciding the number of clusters for OTRIMLE robust Gaussian mixture‐based clustering
- Distance Metrics and Clustering Methods for Mixed‐type Data
- E-ReMI: extended maximal interaction two-mode clustering
- Tests for simultaneous ordered alternatives in a two-way ANOVA with interaction
- On using fuzzy clustering for detecting the number of states in Markov switching models
- Clustering with the average silhouette width
- Distance-based parametric bootstrap tests for clustering of species ranges
This page was built for publication: Flexible parametric bootstrap for testing homogeneity against clustering and assessing the number of clusters
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5963783)
