Semi-supervised active learning for support vector machines: a novel approach that exploits structure information in data
From MaRDI portal
Publication:2198077
Abstract: In our today's information society more and more data emerges, e.g.~in social networks, technical applications, or business applications. Companies try to commercialize these data using data mining or machine learning methods. For this purpose, the data are categorized or classified, but often at high (monetary or temporal) costs. An effective approach to reduce these costs is to apply any kind of active learning (AL) methods, as AL controls the training process of a classifier by specific querying individual data points (samples), which are then labeled (e.g., provided with class memberships) by a domain expert. However, an analysis of current AL research shows that AL still has some shortcomings. In particular, the structure information given by the spatial pattern of the (un)labeled data in the input space of a classification model (e.g.,~cluster information), is used in an insufficient way. In addition, many existing AL techniques pay too little attention to their practical applicability. To meet these challenges, this article presents several techniques that together build a new approach for combining AL and semi-supervised learning (SSL) for support vector machines (SVM) in classification tasks. Structure information is captured by means of probabilistic models that are iteratively improved at runtime when label information becomes available. The probabilistic models are considered in a selection strategy based on distance, density, diversity, and distribution (4DS strategy) information for AL and in a kernel function (Responsibility Weighted Mahalanobis kernel) for SVM. The approach fuses generative and discriminative modeling techniques. With 20 benchmark data sets and with the MNIST data set it is shown that our new solution yields significantly better results than state-of-the-art methods.
Recommendations
Cites work
- scientific article; zbMATH DE number 1975043 (Why is no real title available?)
- Active learning with adaptive regularization
- Fast kernel classifiers with online and active learning
- Pattern classification.
- Sparse regularization for semi-supervised classification
- Statistical comparisons of classifiers over multiple data sets
- Support vector machine active learning with applications to text classification
- Support vector machine with manifold regularization and partially labeling privacy protection
- Training a Support Vector Machine in the Primal
- Two faces of active learning
Cited in
(11)- Effective active learning strategies for the use of large-margin classifiers in semantic annotation: an optimal parameter discovery perspective
- A novel semi-supervised support vector machine with asymmetric squared loss
- On active learning methods for manifold data
- A novel semisupervised support vector machine classifier based on active learning and context information
- A new and informative active learning approach for support vector machine
- Toward optimal probabilistic active learning using a Bayesian approach
- Active learning Bayesian support vector regression model for global approximation
- Active learning for semi-supervised clustering based on locally linear propagation reconstruction
- Multi-class image classification with active learning and semi-supervised learning
- Roman Urdu Headline News Text Classification Using RNN, LSTM and CNN
- A novel support vector machine active learning strategy
This page was built for publication: Semi-supervised active learning for support vector machines: a novel approach that exploits structure information in data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2198077)
