Least Ambiguous Set-Valued Classifiers With Bounded Error Levels
From MaRDI portal
Publication:5229906
Abstract: In most classification tasks there are observations that are ambiguous and therefore difficult to correctly label. Set-valued classifiers output sets of plausible labels rather than a single label, thereby giving a more appropriate and informative treatment to the labeling of ambiguous instances. We introduce a framework for multiclass set-valued classification, where the classifiers guarantee user-defined levels of coverage or confidence (the probability that the true label is contained in the set) while minimizing the ambiguity (the expected size of the output). We first derive oracle classifiers assuming the true distribution to be known. We show that the oracle classifiers are obtained from level sets of the functions that define the conditional probability of each class. Then we develop estimators with good asymptotic and finite sample properties. The proposed estimators build on existing single-label classifiers. The optimal classifier can sometimes output the empty set, but we provide two solutions to fix this issue that are suitable for various practical needs.
Recommendations
Cites work
- scientific article; zbMATH DE number 2168212 (Why is no real title available?)
- scientific article; zbMATH DE number 1931847 (Why is no real title available?)
- scientific article; zbMATH DE number 4001209 (Why is no real title available?)
- A conformal prediction approach to explore functional data
- A tutorial on conformal prediction
- Classification methods with reject option based on convex risk minimization
- Classification with a reject option using a hinge loss
- Classification with confidence
- Classification with reject option
- Conditional validity of inductive conformal predictors
- Consistent algorithms for multiclass classification with an abstain option
- Distribution-Free Prediction Sets
- Distribution-free Prediction Bands for Non-parametric Regression
- Fast learning rates for plug-in classifiers
- High-dimensional generalized linear models and the lasso
- Introduction to nonparametric estimation
- Learning nondeterministic classifiers
- ML-KNN: A lazy learning approach to multi-label learning
- On optimum recognition error and reject tradeoff
- Optimal global rates of convergence for nonparametric regression
- The uniform convergence of nearest neighbor regression function estimators and their application in optimization
Cited in
(19)- Conformal Prediction: A Gentle Introduction
- Selective Prediction-Set Models with Coverage Rate Guarantees
- Confidence sets with expected sizes for multiclass classification
- On soft computing with random fuzzy sets in econometrics and machine learning
- Criteria of efficiency for set-valued classification
- Distribution-Free Prediction Sets for Two-Layer Hierarchical Models
- Three-way decision and conformal prediction: isomorphisms, differences and theoretical properties of cautious learning approaches
- Is distribution-free inference possible for binary regression?
- Optimal rates for nonparametric F-score binary classification via post-processing
- Levelwise data disambiguation by cautious superset classification
- scientific article; zbMATH DE number 7370598 (Why is no real title available?)
- Classification with confidence
- Efficient set-valued prediction in multi-class classification
- Uncertainty in lung cancer stage for survival estimation via set-valued classification
- Minimax semi-supervised set-valued approach to multi-class classification
- Agnostic tests can control the type I and type II errors simultaneously
- Nested conformal prediction sets for classification with applications to probation data
- Set-Valued Support Vector Machine with Bounded Error Rates
- A confidence machine for sparse high-order interaction model
This page was built for publication: Least Ambiguous Set-Valued Classifiers With Bounded Error Levels
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5229906)
