Exploiting unlabeled data to enhance ensemble diversity

DOI10.1007/S10618-011-0243-9zbMATH Open1260.68354arXiv0909.3593OpenAlexW2570107029MaRDI QIDQ1944971FDOQ1944971

Authors: Min-Ling Zhang, Zhi-Hua Zhou 

Publication date: 28 March 2013

Published in: Data Mining and Knowledge Discovery (Search for Journal in Brave)

Abstract: Ensemble learning aims to improve generalization ability by using multiple base learners. It is well-known that to construct a good ensemble, the base learners should be accurate as well as diverse. In this paper, unlabeled data is exploited to facilitate ensemble learning by helping augment the diversity among the base learners. Specifically, a semi-supervised ensemble method named UDEED is proposed. Unlike existing semi-supervised ensemble methods where error-prone pseudo-labels are estimated for unlabeled data to enlarge the labeled data to improve accuracy, UDEED works by maximizing accuracies of base learners on labeled data while maximizing diversity among them on unlabeled data. Experiments show that UDEED can effectively utilize unlabeled data for ensemble learning and is highly competitive to well-established semi-supervised ensemble methods.

Full work available at URL: https://arxiv.org/abs/0909.3593

Recommendations

• Semi-supervised learning using ensembles of multiple 1D-embedding-based label boosting
• scientific article; zbMATH DE number 1928675
• Making use of unlabeled data in semi-supervised learning
• The value of agreement a new boosting algorithm
• scientific article; zbMATH DE number 1843022

zbMATH Keywords

machine learningensemble learningdiversityunlabeled data

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Cites Work

• Title not available (Why is that?)
• Bagging predictors
• Statistical comparisons of classifiers over multiple data sets
• Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy
• TUNING DIVERSITY IN BAGGED ENSEMBLES

Cited In (3)

• RandGA: injecting randomness into parallel genetic algorithm for variable selection
• Machine truth serum: a surprisingly popular approach to improving ensemble methods
• Graph-based sparse Bayesian broad learning system for semi-supervised learning

Uses Software

• UCI-ml
• AdaBoost.MH
• NeC4.5
• SemiBoost

This page was built for publication: Exploiting unlabeled data to enhance ensemble diversity

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1944971)