Query-Augmented Active Metric Learning

DOI10.1080/01621459.2021.2019045MaRDI QIDQ6077579zbMATH OpenOpenAlexFDO

Authors Yujia Deng, Yubai Yuan, Haoda Fu, Annie Qu

Publication date 18 October 2023

Published in Journal of the American Statistical Association (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2111.04871

zbMATH Keywords

active learningmetric learningselective penaltysemi-supervised clustering

Mathematics Subject Classification ID

Statistics (62-XX)

Abstract: In this paper we propose an active metric learning method for clustering with pairwise constraints. The proposed method actively queries the label of informative instance pairs, while estimating underlying metrics by incorporating unlabeled instance pairs, which leads to a more accurate and efficient clustering process. In particular, we augment the queried constraints by generating more pairwise labels to provide additional information in learning a metric to enhance clustering performance. Furthermore, we increase the robustness of metric learning by updating the learned metric sequentially and penalizing the irrelevant features adaptively. In addition, we propose a novel active query strategy that evaluates the information gain of instance pairs more accurately by incorporating the neighborhood structure, which improves clustering efficiency without extra labeling cost. In theory, we provide a tighter error bound of the proposed metric learning method utilizing augmented queries compared with methods using existing constraints only. Furthermore, we also investigate the improvement using the active query strategy instead of random selection. Numerical studies on simulation settings and real datasets indicate that the proposed method is especially advantageous when the signal-to-noise ratio between significant features and irrelevant features is low.

Cites work

• Active constrained fuzzy clustering: a multiple kernels learning approach
• Active image clustering with pairwise constraints from humans
• An automatic method for solving discrete programming problems
• Analytical properties of generalized Gaussian distributions
• scientific article; zbMATH DE number 1391397 (Why is no real title available?)
• scientific article; zbMATH DE number 3429948 (Why is no real title available?)
• Individualized Multidirectional Variable Selection
• Penalized Probabilistic Clustering

Cited in

(3)

• Self-supervised Metric Learning in Multi-View Data: A Downstream Task Perspective
• Local Clustering for Functional Data
• Efficient Human-in-the-Loop Active Learning: A Novel Framework for Data Labeling in AI Systems

This page was built for publication: Query-Augmented Active Metric Learning

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6077579)