Optimal model selection in heteroscedastic regression using piecewise polynomial functions
From MaRDI portal
Abstract: We consider the estimation of a regression function with random design and heteroscedastic noise in a nonparametric setting. More precisely, we address the problem of characterizing the optimal penalty when the regression function is estimated by using a penalized least-squares model selection method. In this context, we show the existence of a minimal penalty, defined to be the maximum level of penalization under which the model selection procedure totally misbehaves. The optimal penalty is shown to be twice the minimal one and to satisfy a non-asymptotic pathwise oracle inequality with leading constant almost one. Finally, the ideal penalty being unknown in general, we propose a hold-out penalization procedure and show that the latter is asymptotically optimal.
Recommendations
Cites work
- A high-dimensional Wilks phenomenon
- A tail inequality for suprema of unbounded empirical processes with applications to Markov chains
- Aggregation by Exponential Weighting and Sharp Oracle Inequalities
- Aggregation for Gaussian regression
- Aggregation via empirical risk minimization
- Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation
- Gaussian model selection
- Gaussian model selection with an unknown variance
- scientific article; zbMATH DE number 1064642 (Why is no real title available?)
- scientific article; zbMATH DE number 3444596 (Why is no real title available?)
- Information Theory and Mixing Least-Squares Regressions
- Local Rademacher complexities
- Local Rademacher complexities and oracle inequalities in risk minimization. (2004 IMS Medallion Lecture). (With discussions and rejoinder)
- Minimal penalties for Gaussian model selection
- Minimum contrast estimators on sieves: Exponential bounds and rates of convergence
- Model selection and error estimation
- Model selection by resampling penalization
- Optimal model selection for density estimation of stationary data under various mixing condi\-tions
- Optimal model selection in density estimation
- Optimal upper and lower bounds for the true and empirical excess risks in heteroscedastic least-squares regression
- Rademacher penalties and structural risk minimization
- Rates of convergence for minimum contrast estimators
- Risk bounds for model selection via penalization
- Sharp oracle inequalities for aggregation of affine estimators
- Slope heuristics: overview and implementation
- Some Comments on C P
- Sparse estimation by exponential weighting
- Statistical predictor identification
Cited in
(7)- Discussion of ``On concentration for (regularized) empirical risk minimization by Sara van de Geer and Martin Wainwright
- Estimator selection: a new method with applications to kernel density estimation
- Non-parametric Poisson regression from independent and weakly dependent observations by model selection
- Sparse model selection under heterogeneous noise: exact penalisation and data-driven thresholding
- Slope heuristics and V-fold model selection in heteroscedastic regression using strongly localized bases
- Sharp oracle inequalities and slope heuristic for specification probabilities estimation in discrete random fields
- Concentration behavior of the penalized least squares estimator
This page was built for publication: Optimal model selection in heteroscedastic regression using piecewise polynomial functions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1951154)
