Semi-supervised active learning for support vector machines: a novel approach that exploits structure information in data

DOI10.1016/J.INS.2018.04.063zbMATH Open1440.68202arXiv1610.03995OpenAlexW2537084562MaRDI QIDQ2198077FDOQ2198077

Authors: Adrian Calma, Tobias Reitmaier, Bernhard Sick 

Publication date: 9 September 2020

Published in: Information Sciences (Search for Journal in Brave)

Abstract: In our today's information society more and more data emerges, e.g.~in social networks, technical applications, or business applications. Companies try to commercialize these data using data mining or machine learning methods. For this purpose, the data are categorized or classified, but often at high (monetary or temporal) costs. An effective approach to reduce these costs is to apply any kind of active learning (AL) methods, as AL controls the training process of a classifier by specific querying individual data points (samples), which are then labeled (e.g., provided with class memberships) by a domain expert. However, an analysis of current AL research shows that AL still has some shortcomings. In particular, the structure information given by the spatial pattern of the (un)labeled data in the input space of a classification model (e.g.,~cluster information), is used in an insufficient way. In addition, many existing AL techniques pay too little attention to their practical applicability. To meet these challenges, this article presents several techniques that together build a new approach for combining AL and semi-supervised learning (SSL) for support vector machines (SVM) in classification tasks. Structure information is captured by means of probabilistic models that are iteratively improved at runtime when label information becomes available. The probabilistic models are considered in a selection strategy based on distance, density, diversity, and distribution (4DS strategy) information for AL and in a kernel function (Responsibility Weighted Mahalanobis kernel) for SVM. The approach fuses generative and discriminative modeling techniques. With 20 benchmark data sets and with the MNIST data set it is shown that our new solution yields significantly better results than state-of-the-art methods.

Full work available at URL: https://arxiv.org/abs/1610.03995

Recommendations

• A novel semisupervised support vector machine classifier based on active learning and context information
• A new and informative active learning approach for support vector machine
• A novel support vector machine active learning strategy
• Adaptive active learning for semi-supervised learning

zbMATH Keywords

support vector machinesemi-supervised learningactive learning4DS strategyresponsibility-weighted Mahalanobis kernelstructure information

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05)

Cites Work

• Statistical comparisons of classifiers over multiple data sets
• Pattern classification.
• Support vector machine active learning with applications to text classification
• Fast kernel classifiers with online and active learning
• Training a Support Vector Machine in the Primal
• Sparse regularization for semi-supervised classification
• Two faces of active learning
• Active learning with adaptive regularization
• Support vector machine with manifold regularization and partially labeling privacy protection
• Title not available (Why is that?)

Cited In (11)

• Effective active learning strategies for the use of large-margin classifiers in semantic annotation: an optimal parameter discovery perspective
• A novel semi-supervised support vector machine with asymmetric squared loss
• On active learning methods for manifold data
• A novel semisupervised support vector machine classifier based on active learning and context information
• A new and informative active learning approach for support vector machine
• Toward optimal probabilistic active learning using a Bayesian approach
• Active learning Bayesian support vector regression model for global approximation
• Active learning for semi-supervised clustering based on locally linear propagation reconstruction
• Multi-class image classification with active learning and semi-supervised learning
• Roman Urdu Headline News Text Classification Using RNN, LSTM and CNN
• A novel support vector machine active learning strategy

Uses Software

• LIBSVM

This page was built for publication: Semi-supervised active learning for support vector machines: a novel approach that exploits structure information in data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2198077)