A statistical testing procedure for validating class labels

DOI10.1080/02664763.2022.2038546arXiv2006.03025MaRDI QIDQ6134417FDOQ6134417

Author name not available (Why is that?), Author name not available (Why is that?), Benzion Boukai

Publication date: 25 July 2023

Published in: Journal of Applied Statistics (Search for Journal in Brave)

Abstract: Motivated by an open problem of validating protein identities in label-free shotgun proteomics work-flows, we present a testing procedure to validate class/protein labels using available measurements across instances/peptides. More generally, we present a solution to the problem of identifying instances that are deemed, based on some distance (or quasi-distance) measure, as outliers relative to the subset of instances assigned to the same class. The proposed procedure is non-parametric and requires no specific distributional assumption on the measured distances. The only assumption underlying the testing procedure is that measured distances between instances within the same class are stochastically smaller than measured distances between instances from different classes. The test is shown to simultaneously control the Type I and Type II error probabilities whilst also controlling the overall error probability of the repeated testing invoked in the validation procedure of initial class labeling. The theoretical results are supplemented with results from an extensive numerical study, simulating a typical setup for labeling validation in proteomics work-flow applications. These results illustrate the applicability and viability of our method. Even with up to 25% of instances mislabeled, our testing procedure maintains a high specificity and greatly reduces the proportion of mislabeled instances.

Full work available at URL: https://arxiv.org/abs/2006.03025

zbMATH Keywords

classificationhypothesis testingmachine learningproteomicsnon-parametric

Mathematics Subject Classification ID

Statistics (62-XX)

Cites Work

• Title not available (Why is that?)
• The control of the false discovery rate in multiple testing under dependency.
• Association of Random Variables, with Applications
• Class noise vs. attribute noise: A quantitative study of their impacts

Cited In (1)

• Classification accuracy as a proxy for two-sample testing

This page was built for publication: A statistical testing procedure for validating class labels

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6134417)