Model selection for regression on a random design

DOI10.1051/ps:2002007zbMath1059.62038OpenAlexW2156218552MaRDI QIDQ3150221

Yannick Baraud

Publication date: 30 September 2002

Published in: ESAIM: Probability and Statistics (Search for Journal in Brave)

Full work available at URL: http://www.numdam.org/item?id=PS_2002__6__127_0

zbMATH Keywords

model selectionBesov spacesadaptive estimationleast-squares estimatorsminimax ratespenalized criteria

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) General nonlinear regression (62J02) Applications of functional analysis in probability theory and statistics (46N30)

Related Items

Statistical inference in sparse high-dimensional additive models ⋮ Consistent covariate selection and post model selection inference in semiparametric regression. ⋮ SLOPE is adaptive to unknown sparsity and asymptotically minimax ⋮ Model selection for (auto-)regression with dependent data ⋮ Local Rademacher complexities and oracle inequalities in risk minimization. (2004 IMS Medallion Lecture). (With discussions and rejoinder) ⋮ Penalized contrast estimation in functional linear models with circular data ⋮ Data-driven rate-optimal specification testing in regression models ⋮ A simple nonparametric approach to estimating the distribution of random coefficients in structural models ⋮ Estimation Strategies for Censored Lifetimes with a Lexis‐Diagram Type Model ⋮ On the stability and accuracy of least squares approximations ⋮ Adaptive estimation of the conditional cumulative distribution function from current status data ⋮ A sup-norm oracle inequality for a partially linear regression model ⋮ Nonparametric drift estimation from diffusions with correlated Brownian motions ⋮ Error guarantees for least squares approximation with noisy samples in domain adaptation ⋮ On a projection estimator of the regression function derivative ⋮ Unnamed Item ⋮ Non-asymptotic adaptive prediction in functional linear models ⋮ Nonparametric estimation of the density of the regression noise ⋮ Nonparametric multiple regression by projection on non-compactly supported bases ⋮ Nonparametric regression estimates with censored data based on block thresholding method ⋮ Segmentation of the mean of heteroscedastic data via cross-validation ⋮ Classification via local multi-resolution projections ⋮ Estimation of Gaussian graphs by model selection ⋮ Adaptive estimation of linear functionals by model selection ⋮ Cumulative distribution function estimation under interval censoring case 1 ⋮ Model selection by resampling penalization ⋮ Regression in random design and Bayesian warped wavelets estimators ⋮ Nonparametric estimation of covariance functions by model selection ⋮ Estimation of the density of regression errors by pointwise model selection ⋮ Model selection for hazard rate estimation in presence of censoring ⋮ Parametric or nonparametric? A parametricness index for model selection ⋮ Adaptive estimation under single-index constraint in a regression model ⋮ Minimax-rate adaptive nonparametric regression with unknown correlations of errors ⋮ Aggregation for Gaussian regression ⋮ Gaussian linear model selection in a dependent context ⋮ Penalized nonparametric mean square estimation of the coefficients of diffusion processes ⋮ The Goldenshluger-Lepski method for constrained least-squares estimators over RKHSs ⋮ A new method for estimation and model selection: \(\rho\)-estimation ⋮ Two-stage model selection procedures in partially linear regression ⋮ Multivariate adaptive warped kernel estimation ⋮ Model selection for Gaussian regression with random design ⋮ A new algorithm for fixed design regression and denoising ⋮ A survey of cross-validation procedures for model selection ⋮ On pointwise adaptive curve estimation based on inhomogeneous data ⋮ Maxisets for model selection ⋮ Drift estimation on non compact support for diffusion models ⋮ Nonparametric drift estimation for diffusions with jumps driven by a Hawkes process ⋮ Evaluation and selection of models for out-of-sample prediction when the sample size is small relative to the complexity of the data-generating process ⋮ On a Nadaraya-Watson estimator with two bandwidths ⋮ Minimax bounds for Besov classes in density estimation ⋮ Regression function estimation on non compact support in an heteroscesdastic model ⋮ Nonparametric survival function estimation for data subject to interval censoring case 2 ⋮ Regression function estimation as a partly inverse problem ⋮ High-dimensional additive modeling ⋮ Inequalities for uniform deviations of averages from expectations with applications to nonparametric regression ⋮ Adaptive Warped Kernel Estimators ⋮ Adaptive estimation in autoregression or \(\beta\)-mixing regression via model selection

Cites Work

• Minimax theory of image reconstruction
• Additive regression and other nonparametric models
• Minimum contrast estimators on sieves: Exponential bounds and rates of convergence
• Risk bounds for model selection via penalization
• Wavelets on the interval and fast wavelet transforms
• Model selection in nonparametric regression
• Information-theoretic determination of minimax rates of convergence
• Inequalities for uniform deviations of averages from expectations with applications to nonparametric regression
• Combining different procedures for adaptive regression
• Model selection for regression on a fixed design
• Minimax estimation via wavelet shrinkage
• Statistical learning theory and stochastic optimization. Ecole d'Eté de Probabilitiés de Saint-Flour XXXI -- 2001.
• An adaptive compression algorithm in Besov spaces
• How many bins should be put in a regular histogram
• Minimum complexity density estimation
• Ten Lectures on Wavelets
• Ideal spatial adaptation by wavelet shrinkage
• Gaussian model selection
• Nonparametric regression function estimation using interaction least squares splines and complexity regularization.
• Unnamed Item
• Unnamed Item