Stochastic cluster embedding

DOI10.1007/S11222-022-10186-ZMaRDI QIDQ2104017zbMATH OpenOpenAlexFDO

Authors Zhirong Yang, Denis Sedov, Samuel Kaski, Jukka Corander, Yu-Wei Chen

Publication date 9 December 2022

Published in Statistics and Computing (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/2108.08003

zbMATH Keywords

clusteringinformation divergenceneighbor embeddingnonlinear dimensionality reductionstochastic optimizationvisualization

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08)

Abstract: Neighbor Embedding (NE) aims to preserve pairwise similarities between data items and has been shown to yield an effective principle for data visualization. However, even the best existing NE methods such as Stochastic Neighbor Embedding (SNE) may leave large-scale patterns hidden, for example clusters, despite strong signals being present in the data. To address this, we propose a new cluster visualization method based on the Neighbor Embedding principle. We first present a family of Neighbor Embedding methods that generalizes SNE by using non-normalized Kullback-Leibler divergence with a scale parameter. In this family, much better cluster visualizations often appear with a parameter value different from the one corresponding to SNE. We also develop an efficient software that employs asynchronous stochastic block coordinate descent to optimize the new family of objective functions. Our experimental results demonstrate that the method consistently and substantially improves the visualization of data clusters compared with the state-of-the-art NE approaches.

Recommendations

• Visualizing data using t-SNE
• Clustering with t-SNE, provably
• Parametric Embedding for Class Visualization
• scientific article; zbMATH DE number 6378173
• Using global t-SNE to preserve intercluster data structure

Cites work

• Differential-geometrical methods in statistics
• scientific article; zbMATH DE number 6378173 (Why is no real title available?)
• Information retrieval perspective to nonlinear dimensionality reduction for data visualization
• Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function
• Visualizing data using t-SNE

Cited in

(8)

• sce
• Visualizing data using t-SNE
• On the role and impact of the metaparameters in t-distributed stochastic neighbor embedding
• Clustering with t-SNE, provably
• Using global t-SNE to preserve intercluster data structure
• Improving the effectiveness and efficiency of stochastic neighbour embedding with isolation kernel
• Minimum-Distortion Embedding
• Parametric Embedding for Class Visualization

Describes a project that uses

Uses Software

• DeepView
• largeVis
• t-SNE
• ELFI
• UMAP
• LargeVis

This page was built for publication: Stochastic cluster embedding

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2104017)