A Bayesian approach for comparing cross-validated algorithms on multiple data sets

DOI10.1007/S10994-015-5486-ZMaRDI QIDQ747253zbMATHOpenAlexWikidataFDO

Authors Giorgio Corani, A. Benavoli

Publication date 23 October 2015

Published in Machine Learning (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1007/s10994-015-5486-z

zbMATH Keywords

hypothesis testcross-validationPoisson-binomialBayesian hypothesis testsevaluation of classifierssigned-rank test

Mathematics Subject Classification ID

Bayesian inference (62F15)

Recommendations

• Statistical comparison of classifiers through Bayesian hierarchical modelling
• Bayesian nonparametric cross-study validation of prediction methods
• Statistical comparisons of classifiers over multiple data sets
• Blocked \(3\times 2\) cross-validated \(t\)-test for comparing supervised classification learning algorithms
• Publication:4636986

Cites work

• scientific article; zbMATH DE number 5719846 (Why is no real title available?)
• A new look at the statistical model identification
• An optimal algorithm for approximate nearest neighbor searching fixed dimensions
• Bootstrap analysis of multiple repetitions of experiments using an interval-valued multiple comparison procedure
• Inference for the generalization error
• Multiplicity of finite graphs over the real line
• On computing the distribution function for the Poisson binomial distribution
• Propagation of Probabilities, Means, and Variances in Mixed Graphical Association Models
• Statistical comparisons of classifiers over multiple data sets

Cited in

(9)

• Bootstrap analysis of multiple repetitions of experiments using an interval-valued multiple comparison procedure
• scientific article; zbMATH DE number 6860782 (Why is no real title available?)
• Bayesian nonparametric cross-study validation of prediction methods
• Statistical comparison of classifiers through Bayesian hierarchical modelling
• scientific article; zbMATH DE number 5944096 (Why is no real title available?)
• The effect of instance-space partition on significance
• Automated verification of multi-party agreements and scheduling of sending messages in distributed ledger systems
• Joint analysis of multiple algorithms and performance measures
• Blocked \(3\times 2\) cross-validated \(t\)-test for comparing supervised classification learning algorithms

Describes a project that uses

Uses Software

• PMTK

This page was built for publication: A Bayesian approach for comparing cross-validated algorithms on multiple data sets

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q747253)