Dynamic principal projection for cost-sensitive online multi-label classification

DOI10.1007/S10994-018-5773-6MaRDI QIDQ2320550zbMATH OpenOpenAlexWikidataFDO

Authors Hong-Min Chu, Kuan-Hao Huang, Hsuan-Tien Lin

Publication date 23 August 2019

Published in Machine Learning (Search for Journal in Brave)

Copyright license Creative Commons Attribution 4.0 International

Full work available at URL https://arxiv.org/abs/1711.05060

zbMATH Keywords

cost-sensitivelabel space dimension reductionmulti-label classification

Mathematics Subject Classification ID

Factor analysis and principal components; correspondence analysis (62H25) Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05) Online algorithms; streaming algorithms (68W27)

Abstract: We study multi-label classification (MLC) with three important real-world issues: online updating, label space dimensional reduction (LSDR), and cost-sensitivity. Current MLC algorithms have not been designed to address these three issues simultaneously. In this paper, we propose a novel algorithm, cost-sensitive dynamic principal projection (CS-DPP) that resolves all three issues. The foundation of CS-DPP is an online LSDR framework derived from a leading LSDR algorithm. In particular, CS-DPP is equipped with an efficient online dimension reducer motivated by matrix stochastic gradient, and establishes its theoretical backbone when coupled with a carefully-designed online regression learner. In addition, CS-DPP embeds the cost information into label weights to achieve cost-sensitivity along with theoretical guarantees. Experimental results verify that CS-DPP achieves better practical performance than current MLC algorithms across different evaluation criteria, and demonstrate the importance of resolving the three issues simultaneously.

Recommendations

• Progressive random \(k\)-labelsets for cost-sensitive multi-label classification
• Cost-sensitive label embedding for multi-label classification
• Active learning for cost-sensitive classification
• Multilabel classification with principal label space transformation
• An incremental cost-sensitive support vector machine

Cites work

• An easy-to-hard learning paradigm for multiple classes and multiple labels
• scientific article; zbMATH DE number 5957338 (Why is no real title available?)
• scientific article; zbMATH DE number 6253944 (Why is no real title available?)
• Multi-label classification via multi-target regression on data streams
• Multilabel classification with principal label space transformation
• Objective-Guided Image Annotation
• Online PCA with optimal regrets
• Progressive random \(k\)-labelsets for cost-sensitive multi-label classification

Cited in

(3)

• Cost-sensitive label embedding for multi-label classification
• Multi-label learning with missing and completely unobserved labels
• Progressive random \(k\)-labelsets for cost-sensitive multi-label classification

Describes a project that uses

Uses Software

• NUS-WIDE
• MULAN

This page was built for publication: Dynamic principal projection for cost-sensitive online multi-label classification

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2320550)