Probabilistic confusion entropy for evaluating classifiers
Summary: For evaluating the classification model of an information system, a proper measure is usually needed to determine if the model is appropriate for dealing with the specific domain task. Though many performance measures have been proposed, few measures were specially defined for multi-class problems, which tend to be more complicated than two-class problems, especially in addressing the issue of class discrimination power. Confusion entropy was proposed for evaluating classifiers in the multi-class case. Nevertheless, it makes no use of the probabilities of samples classified into different classes. In this paper, we propose to calculate confusion entropy based on a probabilistic confusion matrix. Besides inheriting the merit of measuring if a classifier can classify with high accuracy and class discrimination power, probabilistic confusion entropy also tends to measure if samples are classified into true classes and separated from others with high probabilities. Analysis and experimental comparisons show the feasibility of the simply improved measure and demonstrate that the measure does not stand or fall over the classifiers on different datasets in comparison with the compared measures.
- scientific article; zbMATH DE number 7690427
- Entropy-based estimation in classification problems
- Symbolic and Quantitative Approaches to Reasoning with Uncertainty
- Error Entropy in Classification Problems: A Univariate Data Analysis
- scientific article; zbMATH DE number 1975246
- scientific article; zbMATH DE number 3864536
- Maximum-entropy estimated distribution model for classification problems
- scientific article; zbMATH DE number 1931841
- A simple generalisation of the area under the ROC curve for multiple class classification problems
- A unified view of performance metrics: translating threshold choice into expected classification loss
- Comparing two \(K\)-category assignments by a \(K\)-category correlation coefficient
- scientific article; zbMATH DE number 48702 (Why is no real title available?)
- scientific article; zbMATH DE number 1461524 (Why is no real title available?)
- scientific article; zbMATH DE number 835699 (Why is no real title available?)
- Measuring classifier performance: a coherent alternative to the area under the ROC curve
- Measuring Diagnostic Accuracy of Statistical Prediction Rules
- Measuring the accuracy of diagnostic systems
- PAV and the ROC convex hull
- Regression modeling strategies. With applications to linear models, logistic regression and survival analysis
- Robust classification for imprecise environments
- A Bayesian interpretation of the confusion matrix
- scientific article; zbMATH DE number 3864536 (Why is no real title available?)
- The 2x2 Matrix
- Symbolic and Quantitative Approaches to Reasoning with Uncertainty
- Multi-class and Cluster Evaluation Measures Based on Rényi and Tsallis Entropies and Mutual Information
- scientific article; zbMATH DE number 7690427 (Why is no real title available?)
- Measuring Features Strength in Probabilistic Classification
This page was built for publication: Probabilistic confusion entropy for evaluating classifiers
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q280701)
