Fractionally-supervised classification
From MaRDI portal
Abstract: Traditionally, there are three species of classification: unsupervised, supervised, and semi-supervised. Supervised and semi-supervised classification differ by whether or not weight is given to unlabelled observations in the classification procedure. In unsupervised classification, or clustering, all observations are unlabeled and hence full weight is given to unlabelled observations. When some observations are unlabelled, it can be very difficult to extit{a~priori} choose the optimal level of supervision, and the consequences of a sub-optimal choice can be non-trivial. A flexible fractionally-supervised approach to classification is introduced, where any level of supervision --- ranging from unsupervised to supervised --- can be attained. Our approach uses a weighted likelihood, wherein weights control the relative role that labelled and unlabelled data have in building a classifier. A comparison between our approach and the traditional species is presented using simulated and real data. Gaussian mixture models are used as a vehicle to illustrate our fractionally-supervised classification approach; however, it is broadly applicable and variations on the postulated model can be easily made.
Recommendations
- On fractionally-supervised classification: weight selection and extension to the multivariate t-distribution
- Semi-supervised logistic discrimination via labeled data and unlabeled data from different sampling distributions
- Semi-supervised logistic discrimination for functional data
- Unsupervised and semisupervised classification via absolute value inequalities
- Semisupervised spherical separation
Cites work
- A Family of Minimax Estimators of the Mean of a Multivariate Normal Distribution
- Algorithm AS 136: A K-Means Clustering Algorithm
- Analytic calculations for the EM algorithm for multivariate skew-t mixture models
- Approximating bayesian inference by weighted likelihood
- Asymptotic properties of maximum weighted likelihood estimators.
- Asymptotic properties of the MAMSE adaptive likelihood weights
- Estimating the dimension of a model
- Estimation with quadratic loss.
- scientific article; zbMATH DE number 3122730 (Why is no real title available?)
- scientific article; zbMATH DE number 3567782 (Why is no real title available?)
- scientific article; zbMATH DE number 3444596 (Why is no real title available?)
- Improving the James-Stein estimator using the Stein variance estimator
- Methods for merging Gaussian mixture components
- Model-based classification using latent Gaussian mixture models
- Model-based classification via mixtures of multivariate \(t\)-distributions
- Note on the Consistency of the Maximum Likelihood Estimate
- On Information and Sufficiency
- On mixtures of skew normal and skew t-distributions
- Parsimonious skew mixture models for model-based clustering and classification
- Proper Bayes minimax estimators of the multivariate normal mean vector for the case of common unknown variances
- Safe semi-supervised learning based on weighted likelihood
- Selecting likelihood weights by cross-validation
- Statistical Analysis of Financial Data in S-Plus
- Text classification from labeled and unlabeled documents using EM
- The asymptotic properties of the maximum-relevance weighted likelihood estimators
- The relative value of labeled and unlabeled samples in pattern recognition with an unknown mixing parameter
- The weighted likelihood
Cited in
(14)- Clustering, classification, discriminant analysis, and dimension reduction via generalized hyperbolic mixtures
- Mixtures of generalized hyperbolic distributions and mixtures of skew-t distributions for model-based clustering with incomplete data
- A variational approximations-DIC rubric for parameter estimation and mixture model selection within a family setting
- Discriminative clustering with representation learning with any ratio of labeled to unlabeled data
- An evolutionary algorithm with crossover and mutation for model-based clustering
- A mixture of coalesced generalized hyperbolic distributions
- Multiclass classification based on multi-criteria decision-making
- On fractionally-supervised classification: weight selection and extension to the multivariate t-distribution
- Model-based clustering
- Adaptive mixture discriminant analysis for supervised learning with unobserved classes
- Unsupervised classification via convex absolute value inequalities
- Algorithm FRiS-TDR for generalized classification of the labeled, semi-labeled and unlabeled datasets
- Model-based clustering and classification using mixtures of multivariate skewed power exponential distributions
- Mixtures of hidden truncation hyperbolic factor analyzers
This page was built for publication: Fractionally-supervised classification
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5964466)
