Improvements on Cross-Validation: The .632+ Bootstrap Method

DOI10.2307/2965703zbMATH Open0887.62044OpenAlexW4250236131WikidataQ56019665 ScholiaQ56019665MaRDI QIDQ4366231FDOQ4366231

Bradley Efron, Robert Tibshirani

Publication date: 7 January 1998

Published in: Journal of the American Statistical Association (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.2307/2965703

Recommendations

• Bootstrapping the out-of-sample predictions for efficient and accurate cross-validation
• Measuring the prediction error. A comparison of cross-validation, bootstrap and covariance penalty methods
• Bootstrap and cross-validation estimates of the prediction error for linear regression models
• Cross-validation revisited
• Residual bootstrap method: an approach to model validation
• On the relative accuracy of certain bootstrap procedures

zbMATH Keywords

classificationcross-validationbootstrap estimatesprediction rule

Mathematics Subject Classification ID

Nonparametric statistical resampling methods (62G09)

Cited In (only showing first 100 items - show all)

• Least angle regression. (With discussion)
• Title not available (Why is that?)
• An empirical study of PLAD regression using the bootstrap
• Bundling classifiers by bagging trees
• Ensemble component selection for improving ICA based microarray data prediction models
• Two-group classification via a biobjective margin maximization model
• Cross-Validation of Regression Models
• Double-bagging: Combining classifiers by bootstrap aggregation
• Classifier variability: accounting for training and testing
• Evaluation of new service development strategies using multicriteria analysis: predicting the success of innovative hospitality services
• Modeling of the algal atypical increase in La Barca reservoir using the DE optimized least square support vector machine approach with feature selection
• A new variable selection approach using random forests
• On the biases of error estimators in prediction problems
• Model selection by resampling penalization
• Selection bias in working with the top genes in supervised classification of tissue samples
• Assessing classifiers in terms of the partial area under the ROC curve
• Bandwidth choice for nonparametric classification
• The NPAIRS Computational Statistics Framework for Data Analysis in Neuroimaging
• On error-rate estimation in nonparametric classification
• A Statistical Framework for Hypothesis Testing in Real Data Comparison Studies
• A Clustered Gaussian Process Model for Computer Experiments
• Assessing the performance of an allocation rule
• Stochastic optimization with adaptive restart: a framework for integrated local and global learning
• An extended two-stage sequential optimization approach: properties and performance
• Measuring the prediction error. A comparison of cross-validation, bootstrap and covariance penalty methods
• Data-based interval estimation of classification error rates
• Embedding sample points uncertainty measures in learning algorithms
• Optimal Combinations of Diagnostic Tests Based on AUC
• Machine learning versus statistical modeling
• Title not available (Why is that?)
• Assessing the variability of posterior probabilities in Gaussian model-based clustering
• Estimation of varying coefficient models with measurement error
• Multiclass classification and gene selection with a stochastic algorithm
• Evaluating incremental values from new predictors with net reclassification improvement in survival analysis
• Sample size determination for training cancer classifiers from microarray and RNA-seq data
• An improved methodology for filling missing values in spatiotemporal climate data set. Application to Tanganyika Lake data set
• An alternative objective function for fitting regression trees to functional response variables
• A center sliding Bayesian binary classifier adopting orthogonal polynomials
• Exact bootstrap \(k\)-nearest neighbor learners
• Model Selection in Estimating Equations
• Resampling-based information criteria for best-subset regression
• The benefit of data-based model complexity selection via prediction error curves in time-to-event data
• The MELBS team winning entry for the EVA2017 competition for spatiotemporal prediction of extreme rainfall using generalized extreme value quantiles
• Bolstered error estimation
• Robust Prediction of t-Year Survival with Data from Multiple Studies
• Estimation and status prediction in a discrete mover‐stayer model with covariate effects on stayer's probability
• Estimating classification error rate: repeated cross-validation, repeated hold-out and bootstrap
• Predicting human behavior in unrepeated, simultaneous-move games
• Efron‐Type Measures of Prediction Error for Survival Analysis
• Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation
• Consistent validation of gray-level thresholding image segmentation algorithms based on machine learning classifiers
• On the predictive risk in misspecified quantile regression
• A theory of cross-validation error
• Applying randomness effectively based on random forests for classification task of datasets of insufficient information
• A survey of cross-validation procedures for model selection
• Bayesian nonparametric model selection and model testing
• Searching for the optimum value of the smoothing parameter for a radial basis function surface with feature area by using the bootstrap method
• Modified check loss for efficient estimation via model selection in quantile regression
• A kernel PLS based classification method with missing data handling
• The Lasso with general Gaussian designs with applications to hypothesis testing
• Block-regularized repeated learning-testing for estimating generalization error
• Multiple predictingK-fold cross-validation for model selection
• Bootstrap-based model selection criteria for beta regressions
• Bootstrap estimated true and false positive rates and ROC curve
• Recent developments in bootstrap methodology
• Cross-Validation: What Does It Estimate and How Well Does It Do It?
• A proportional-hazards model for survival analysis and long-term survivors modeling: application to amyotrophic lateral sclerosis data
• A two-stage bridge estimator for regression models with endogeneity based on control function method
• Discrimination of psychotropic drugs over‐consumers using a threshold exceedance based approach
• A comparison of parametric conditional error-rate estimators for the two-group linear discriminant function
• Bayesian classification for bivariate normal gene expression
• Meta‐learning approach to gene expression data classification
• Confidence intervals for the Cox model test error from cross‐validation
• New Bootstrap Applications in Supervised Learning
• Out-of-Sample R ²  : Estimation and Inference
• Bagging Tree Classifiers for Glaucoma Diagnosis
• A Robust Alternative to the Schemper-Henderson Estimator of Prediction Error
• The fraud loss for selecting the model complexity in fraud detection
• Spatial bootstrapped microeconometrics: Forecasting for out‐of‐sample geo‐locations in big data
• From Fixed-X to Random-X Regression: Bias-Variance Decompositions, Covariance Penalties, and Prediction Error Estimation: Rejoinder
• A method for constructing a confidence bound for the actual error rate of a prediction rule in high dimensions
• OR Practice–Data Analytics for Optimal Detection of Metastatic Prostate Cancer
• Improved feature selection with simulation optimization
• Stability estimation for unsupervised clustering: a review
• Prediction and model evaluation for space–time data
• Robust Data-Driven Fault Detection in Dynamic Process Environments Using Discrete Event Systems
• An overview of techniques for linking high‐dimensional molecular data to time‐to‐event endpoints by risk prediction models
• Evaluating Incremental Values from New Predictors with Net Reclassification Improvement in Survival Analysis
• Technical Efficiency and Spatial Econometric Model: Application to Rice Production of Thailand
• Comparing linear discriminant analysis and supervised learning algorithms for binary classification -- a method comparison study
• Penalized regression methods with modified cross-validation and bootstrap tuning produce better prediction models
• Confidence intervals of prediction accuracy measures for multivariable prediction models based on the bootstrap-based optimism correction methods
• Classification in postural style based on stochastic process modeling
• Three distributions in the extended occupancy problem
• Estimation of the Spatial Weighting Matrix for Spatiotemporal Data under the Presence of Structural Breaks
• Confidence scores for prediction models
• Estimating prediction error in microarray classification: modifications of the 0.632+ bootstrap when \(n<p\)
• Prediction of sports injuries in football: a recurrent time-to-event approach using regularized Cox models
• Forecast of the higher heating value in biomass torrefaction by means of machine learning techniques
• The comparison study of the model selection criteria on the Tobit regression model based on the bootstrap sample augmentation mechanisms

This page was built for publication: Improvements on Cross-Validation: The .632+ Bootstrap Method

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4366231)