A survey of cross-validation procedures for model selection

DOI10.1214/09-SS054zbMath1190.62080arXiv0907.4728WikidataQ56689497 ScholiaQ56689497MaRDI QIDQ975579

Sylvain Arlot, Alain Celisse

Publication date: 9 June 2010

Published in: Statistics Surveys (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/0907.4728

zbMATH Keywords

model selection; cross-validation; leave-one-out

Mathematics Subject Classification ID

62G08: Nonparametric regression and quantile regression

62G05: Nonparametric estimation

62G99: Nonparametric inference

Related Items

Efficient approximate k‐fold and leave‐one‐out cross‐validation for ridge regression, A comparison of regularization methods applied to the linear discriminant function with high-dimensional microarray data, The connection between cross-validation and Akaike information criterion in a semiparametric family, Model selection in reinforcement learning, Segmentation of the mean of heteroscedastic data via cross-validation, Derivation, identification and validation of a computational model of a novel synthetic regulatory network in yeast, Semiparametric zero-inflated modeling in multi-ethnic study of atherosclerosis (MESA), A cross-validation based estimation of the proportion of true null hypotheses, Oracle inequalities for cross-validation type procedures, A survey of Bayesian predictive methods for model assessment, selection and comparison, The adaptive and the thresholded Lasso for potentially misspecified models (and a lower bound for the Lasso)

Uses Software

• ElemStatLearn

Cites Work

• Histogram selection in non Gaussian regression
• Gaussian model selection
• Model selection and error estimation
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Segmentation of the mean of heteroscedastic data via cross-validation
• Cross validation model selection criteria for linear regression based on the Kullback-Leibler discrepancy
• Asymptotic properties of criteria for selection of variables in multiple regression
• Concentration inequalities and model selection. Ecole d'Eté de Probabilités de Saint-Flour XXXIII -- 2003.
• Data-driven bandwidth choice for density estimation based on dependent data
• Least angle and \(\ell _{1}\) penalized regression: a review
• Nonparametric density estimation by exact leave-\(p\)-out cross-validation
• Estimation of the conditional risk in classification: the swapping method
• A universal prior for integers and estimation by minimum description length
• Large sample optimality of least squares cross-validation in density estimation
• An asymptotically optimal window selection rule for kernel density estimates
• From Stein's unbiased risk estimates to the method of generalized cross- validation
• Asymptotic optimality for \(C_ p\), \(C_ L\), cross-validation and generalized cross-validation: Discrete index set
• A local cross-validation algorithm
• On Kullback-Leibler loss and density estimation
• Estimation of dependences based on empirical data. Transl. from the Russian by Samuel Kotz
• Smoothed cross-validation
• Comparison of two bandwidth selectors with dependent errors
• Smoothing noisy data with spline functions: Estimating the correct degree of smoothing by the method of generalized cross-validation
• Estimating the dimension of a model
• Risk bounds for model selection via penalization
• Weak convergence of dependent empirical measures with application to subsampling in function spaces
• Heuristics of instability and stabilization in model selection
• Model selection in nonparametric regression
• Inference for the generalization error
• Bayesian model averaging: A tutorial. (with comments and a rejoinder).
• Nonparametric regression with correlated errors.
• Asymptotic comparison of (partial) cross-validation, GCV and randomized GCV in nonparametric regression
• Consistent cross-validated density estimation
• A distribution-free theory of nonparametric regression
• On bandwidth choice in nonparametric regression with both short- and long-range dependent errors
• Model selection by resampling penalization
• Model selection via multifold cross validation
• Cross-validation in nonparametric regression with outliers
• Minimal penalties for Gaussian model selection
• Consistency of cross validation for comparing regression procedures
• Statistical predictor identification
• Bootstrap Model Selection
• Model selection for regression on a random design
• Approximate efficiency of a selection procedure for the number of regression variables
• Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation
• Cross-Validation of Regression Models
• Theory of Classification: a Survey of Some Recent Advances
• Bandwidth selection in robust smoothing
• Oracle inequalities for multi-fold cross validation
• The cross-validated adaptive epsilon-net estimator
• Can the strengths of AIC and BIC be shared? A conflict between model indentification and regression estimation
• How Biased is the Apparent Error Rate of a Prediction Rule?
• Kernel Regression Estimation Using Repeated Measurements Data
• How Far Are Automatically Chosen Regression Smoothing Parameters From Their Optimum?
• A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods
• Distribution-free performance bounds for potential function rules
• DATA-DEPENDENT ESTIMATION OF PREDICTION FUNCTIONS
• On the bias and variability of bootstrap and cross-validation estimates of error rate in discrimination problems
• Periodic splines for spectral density estimation: the use of cross validation for determining the degree of smoothing
• The Predictive Sample Reuse Method with Applications
• Asymptotics for and against cross-validation
• Practical Approximate Solutions to Linear Operator Equations When the Data are Noisy
• A cross-validatory method for dependent data
• Robust Linear Model Selection by Cross-Validation
• Improvements on Cross-Validation: The .632+ Bootstrap Method
• Adaptive Regression by Mixing
• Rademacher penalties and structural risk minimization
• Model Selection and Multimodel Inference
• The Relationship between Variable Selection and Data Agumentation and a Method for Prediction
• 10.1162/153244302760200704
• A predictive approach to the random effect model
• Linear Model Selection by Cross-Validation
• Optimal Oracle Inequality for Aggregation of Classifiers Under Low Noise Condition
• Suboptimality of Penalized Empirical Risk Minimization in Classification
• Robust Estimation of a Location Parameter
• Some Comments on C P
• The Estimation of Prediction Error