Estimating classification error rate: repeated cross-validation, repeated hold-out and bootstrap
DOI10.1016/J.CSDA.2009.04.009zbMATH Open1453.62126OpenAlexW2073792037MaRDI QIDQ961845FDOQ961845
Authors: B. E. Eshmatov
Publication date: 1 April 2010
Published in: Computational Statistics and Data Analysis (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1016/j.csda.2009.04.009
Recommendations
- Improvements on Cross-Validation: The .632+ Bootstrap Method
- ASSESSING ERROR RATE ESTIMATORS: THE LEAVE‐ONE‐OUT METHOD RECONSIDERED
- A comparison of nonparametric error rate estimation methods in classification problems
- Bootstrapped and smoothed classification error rate estimators
- On the bias and variability of bootstrap and cross-validation estimates of error rate in discrimination problems
Computational methods for problems pertaining to statistics (62-08) Classification and discrimination; cluster analysis (statistical aspects) (62H30)
Cites Work
- A decision-theoretic generalization of on-line learning and an application to boosting
- Title not available (Why is that?)
- A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods
- Improvements on Cross-Validation: The .632+ Bootstrap Method
- Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation
- Ten More Years of Error Rate Research
- ASSESSING ERROR RATE ESTIMATORS: THE LEAVE‐ONE‐OUT METHOD RECONSIDERED
- A comparison of nonparametric error rate estimation methods in classification problems
Cited In (43)
- Machine learning for structural design models of continuous beam systems via influence zones
- Bootstrap analysis of multiple repetitions of experiments using an interval-valued multiple comparison procedure
- Bootstrapping the out-of-sample predictions for efficient and accurate cross-validation
- On the generative-discriminative tradeoff approach: interpretation, asymptotic efficiency and classification performance
- On the accuracy of cross-validation in the classification problem
- On the performance of the flexible maximum entropy distributions within partially adaptive estimation
- Gradient methods for solving Stackelberg games
- Exact performance of error estimators for discrete classifiers
- Bootstrapped and smoothed classification error rate estimators
- On the biases of error estimators in prediction problems
- Protecting classifiers from attacks
- Discriminant analysis with Gaussian graphical tree models
- A comparison of nonparametric error rate estimation methods in classification problems
- Support vector regression for polyhedral and missing data
- Estimation of predictive performance in high-dimensional data settings using learning curves
- Mean-variance-skewness-entropy measures: a multi-objective approach for portfolio selection
- Complete search for feature selection in decision trees
- Improvement of ID3 algorithm based on simplified information entropy and coordination degree
- Measuring the prediction error. A comparison of cross-validation, bootstrap and covariance penalty methods
- Markov cross-validation for time series model evaluations
- Approximate Bayesian inference in spatial GLMM with skew normal latent variables
- Fast robust estimation of prediction error based on resampling
- Machine learning based multiscale calibration of mesoscopic constitutive models for composite materials: application to brain white matter
- Nonconvex SVM for cancer diagnosis based on morphologic features of tumor microenvironment
- Adversarial classification: an adversarial risk analysis approach
- Optimal convex error estimators for classification
- Functional methods for classification of different petrographic varieties by means of reflectance spectra
- Mean field variational Bayesian inference for support vector machine classification
- Distribution-balanced stratified cross-validation for accuracy estimation
- Adversarial Machine Learning: Bayesian Perspectives
- Learning quantities of interest from dynamical systems for observation-consistent inversion
- Bolstered error estimation
- Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation
- Validation of average error rate over classifiers
- On the bias and variability of bootstrap and cross-validation estimates of error rate in discrimination problems
- An experimental comparison of cross-validation techniques for estimating the area under the ROC curve
- Discriminant analysis for discrete variables derived from a tree-structured graphical model
- Convex and nonconvex nonparametric frontier-based classification methods for anomaly detection
- Binary trees for dissimilarity data
- Group regularization for zero-inflated Poisson regression models with an application to insurance ratemaking
- Block-regularized repeated learning-testing for estimating generalization error
- A robust alternative to the Schemper-Henderson estimator of prediction error
- Bootstrap estimated true and false positive rates and ROC curve
Uses Software
This page was built for publication: Estimating classification error rate: repeated cross-validation, repeated hold-out and bootstrap
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q961845)