Model selection in nonparametric regression

DOI10.1214/aos/1046294464zbMath1019.62037MaRDI QIDQ1394765

Marten H. Wegkamp

Publication date: 24 June 2003

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1214/aos/1046294464

zbMATH Keywords

classification; model selection; adaptive estimation; least squares estimation; penalized least squares; data splitting; VC-major classes

Mathematics Subject Classification ID

62G08: Nonparametric regression and quantile regression

62G20: Asymptotic properties of nonparametric inference

60E15: Inequalities; stochastic orderings

60F05: Central limit and other weak theorems

Related Items

Estimation and selection procedures in regression: anL₁approach, Two-stage model selection procedures in partially linear regression, Model-Free Variable Selection, Model selection in reinforcement learning, Estimator selection with respect to Hellinger-type risks, Generalized mirror averaging and \(D\)-convex aggregation, Learning by mirror averaging, A survey of cross-validation procedures for model selection, SPADES and mixture models, A universal procedure for aggregating estimators, Evaluation and selection of models for out-of-sample prediction when the sample size is small relative to the complexity of the data-generating process, Model selection for Gaussian regression with random design, Consistent covariate selection and post model selection inference in semiparametric regression., Aggregation for Gaussian regression, Consistency of cross validation for comparing regression procedures, Model selection for regression on a random design, Theory of Classification: a Survey of Some Recent Advances, LOCALIZED MODEL SELECTION FOR REGRESSION

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Estimating a regression function
• Risk bounds for model selection via penalization
• A universally acceptable smoothing factor for kernel density estimates
• Consistency for the least squares estimator in nonparametric regression
• Nonasymptotic universal smoothing factors, kernel complexity and Yatracos classes
• Information-theoretic determination of minimax rates of convergence
• Adaptive model selection using empirical complexities
• Model selection for regression on a fixed design
• Some universal results on the behavior of increments of partial sums
• О точной константе в неравенстве Розенталя
• Quasi-universal bandwidth selection for kernel density estimators
• Adaptive Regression by Mixing
• Estimation and selection procedures in regression: anL₁approach
• Bandwidth Selection for Local Linear Regression Smoothers
• Neural Network Learning
• Linear Model Selection by Cross-Validation
• Model selection and error estimation