Classifier variability: accounting for training and testing

DOI10.1016/J.PATCOG.2011.12.024MaRDI QIDQ411930zbMATH OpenOpenAlexFDO

Authors Brandon D. Gallas, Waleed A. Yousef, Weijie Chen

Publication date 2 May 2012

Published in Pattern Recognition (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1016/j.patcog.2011.12.024

zbMATH Keywords

AUCU-statisticsclassifier evaluationclassifier stabilitytraining variability

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Learning and adaptive systems in artificial intelligence (68T05)

Recommendations

• Assessing classifiers in terms of the partial area under the ROC curve
• scientific article; zbMATH DE number 1754533
• Assessing the performance of classification methods
• Inference for the generalization error
• Measuring classifier performance: a coherent alternative to the area under the ROC curve

Cites work

• scientific article; zbMATH DE number 1680164 (Why is no real title available?)
• scientific article; zbMATH DE number 3841064 (Why is no real title available?)
• scientific article; zbMATH DE number 46578 (Why is no real title available?)
• scientific article; zbMATH DE number 47593 (Why is no real title available?)
• scientific article; zbMATH DE number 47948 (Why is no real title available?)
• scientific article; zbMATH DE number 3567782 (Why is no real title available?)
• scientific article; zbMATH DE number 1865745 (Why is no real title available?)
• 10.1162/153244303322753616
• A Class of Statistics with Asymptotically Normal Distribution
• A Framework for Random-Effects ROC Analysis: Biases with the Bootstrap and Other Variance Estimators
• Comparing the Areas under Two or More Correlated Receiver Operating Characteristic Curves: A Nonparametric Approach
• High-dimensional graphs and variable selection with the Lasso
• High-dimensional variable selection
• Hypothesis testing of diagnostic accuracy for multiple readers and multiple tests an anova approach with dependent observations
• Improvements on Cross-Validation: The .632+ Bootstrap Method
• No unbiased estimator of the variance of K-fold cross-validation
• Stability Selection
• The area above the ordinal dominance graph and the area below the receiver operating characteristic graph

Cited in

(3)

• Assessing classifiers in terms of the partial area under the ROC curve
• Computationally efficient confidence intervals for cross-validated area under the ROC curve estimates
• Blocked \(3\times 2\) cross-validated \(t\)-test for comparing supervised classification learning algorithms

Describes a project that uses

Uses Software

• UCI

This page was built for publication: Classifier variability: accounting for training and testing

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q411930)