Asymptotics of cross-validated risk estimation in estimator selection and performance assess\-ment

DOI10.1016/J.STAMET.2005.02.003zbMath1248.62004OpenAlexW2032481853MaRDI QIDQ713643

No author found.

Publication date: 19 October 2012

Published in: Statistical Methodology (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.stamet.2005.02.003

zbMATH Keywords

predictionclassificationconfidence intervalsmodel selectioncross-validationloss functionriskdensity estimationregressionasymptotic optimalitygeneralization errorquadratic loss functionasymptotic linearityperformance assessment\(L_{2}\) loss functionindicator loss functionmultifold cross-validationresubstitution estimator

Mathematics Subject Classification ID

Density estimation (62G07) Statistical decision theory (62C99) Foundational topics in statistics (62A99)

Related Items (34)

Canonical thresholding for nonsparse high-dimensional linear regression ⋮ Concentration inequalities of the cross-validation estimator for empirical risk minimizer ⋮ Propensity score prediction for electronic healthcare databases using super learner and high-dimensional propensity score methods ⋮ Estimator selection and combination in scalar-on-function regression ⋮ Tree-based multivariate regression and density estimation with right-censored data ⋮ Cross-Validated Loss-based Covariance Matrix Estimator Selection in High Dimensions ⋮ Comparing different propensity score estimation methods for estimating the marginal causal effect through standardization to propensity scores ⋮ Computer assisted customer churn management: state-of-the-art and future trends ⋮ Regularization in statistics ⋮ Segmentation of the mean of heteroscedastic data via cross-validation ⋮ Adaptive kernel methods using the balancing principle ⋮ Measuring the prediction error. A comparison of cross-validation, bootstrap and covariance penalty methods ⋮ CROSS-VALIDATION BASED ADAPTATION FOR REGULARIZATION OPERATORS IN LEARNING THEORY ⋮ Cross-validated bagged learning ⋮ A deletion/substitution/addition algorithm for classification neural networks, with applications to biomedical data ⋮ Propensity score weighting for causal inference with multiple treatments ⋮ Rate of convergence of the density estimation of regression residual ⋮ Asymptotics of cross-validated risk estimation in estimator selection and performance assess\-ment ⋮ Covariance regularization by thresholding ⋮ Cross-Validation: What Does It Estimate and How Well Does It Do It? ⋮ Inference for Treatment-Specific Survival Curves Using Machine Learning ⋮ Cross-estimation for decision selection ⋮ Prediction and model evaluation for space–time data ⋮ Comparing predictive abilities of longitudinal child growth models ⋮ On estimation and cross-validation of dynamic treatment regimes with competing risks ⋮ Targeted estimation of nuisance parameters to obtain valid statistical inference ⋮ Statistical inference for data adaptive target parameters ⋮ Testing the relative performance of data adaptive prediction algorithms: a generalized test of conditional risk differences ⋮ A case study of the impact of data-adaptive versus model-based estimation of the propensity scores on causal inferences from three inverse probability weighting estimators ⋮ Optimal spatial prediction using ensemble machine learning ⋮ Super-learning of an optimal dynamic treatment rule ⋮ Efficient, adaptive cross-validation for tuning and comparing models, with application to drug discovery ⋮ Confidence sets with expected sizes for Multiclass Classification ⋮ Robust Q-Learning

Uses Software

• ElemStatLearn
• bootstrap

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Asymptotics of cross-validated risk estimation in estimator selection and performance assess\-ment
• Asymptotic optimality for \(C_ p\), \(C_ L\), cross-validation and generalized cross-validation: Discrete index set
• Risk bounds for model selection via penalization
• Heuristics of instability and stabilization in model selection
• On the rate of convergence of error estimates for the partitioning classification rule
• Asymptotically optimal model selection method with right censored outcomes
• A distribution-free theory of nonparametric regression
• Unified methods for censored longitudinal data and causality
• Tree-based multivariate regression and density estimation with right-censored data
• Weak convergence and empirical processes. With applications to statistics
• Model selection via multifold cross validation
• Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation
• Cross-Validation of Regression Models
• The cross-validated adaptive epsilon-net estimator
• A comparative study of ordinary cross-validation, v-fold cross-validation and the repeated learning-testing methods
• The Little Bootstrap and Other Methods for Dimensionality Selection in Regression: X-Fixed Prediction Error
• The Predictive Sample Reuse Method with Applications
• The Use of Balanced Half-Sample Replication in Cross-Validation Studies
• Asymptotics for and against cross-validation
• The estimation problem of minimum mean squared error
• Relative stability of global errors of nonparametric function estimators
• Linear Model Selection by Cross-Validation
• Deletion/Substitution/Addition Algorithm in Learning with Applications in Genomics
• The elements of statistical learning. Data mining, inference, and prediction

This page was built for publication: Asymptotics of cross-validated risk estimation in estimator selection and performance assess\-ment