Abstract: The main goal in this paper is to propose a new method for deriving oracle inequalities related to the exponential weighting method. For the sake of simplicity we focus on recovering an unknown vector from noisy data with the help of a family of ordered smoothers. The estimators withing this family are aggregated using the exponential weighting and the aim is to control the risk of the aggregated estimate. Based on simple probabilistic properties of the unbiased risk estimate, we derive new oracle inequalities and show that the exponential weighting permits to improve Kneip's oracle inequality.
Recommendations
Cites work
- scientific article; zbMATH DE number 45848 (Why is no real title available?)
- scientific article; zbMATH DE number 3551792 (Why is no real title available?)
- scientific article; zbMATH DE number 700016 (Why is no real title available?)
- scientific article; zbMATH DE number 1522808 (Why is no real title available?)
- scientific article; zbMATH DE number 3444596 (Why is no real title available?)
- scientific article; zbMATH DE number 936298 (Why is no real title available?)
- Combining different procedures for adaptive regression
- Estimation and variable selection with exponential weights
- Estimation of the mean of a multivariate normal distribution
- Exponential weighting and oracle inequalities for projection estimates
- Functional aggregation for nonparametric regression.
- Information Theory and Mixing Least-Squares Regressions
- Linear and convex aggregation of density estimators
- On universal oracle inequalities related to high-dimensional linear models
- Ordered linear smoothers
- Oscillation matrices with spline smoothing
- PAC-Bayesian bounds for sparse regression estimation with exponential weights
- Sharp oracle inequalities for aggregation of affine estimators
- Simultaneous adaptation to the margin and to complexity in classification
- Some Comments on C P
- Sparse estimation by exponential weighting
- Spline smoothing and optimal rates of convergence in nonparametric regression models
- Spline smoothing in regression models and asymptotic efficiency in \(L_ 2\)
- Statistical learning theory and stochastic optimization. Ecole d'Eté de Probabilitiés de Saint-Flour XXXI -- 2001.
Cited in
(6)- Early stopping for statistical inverse problems via truncated SVD estimation
- scientific article; zbMATH DE number 7123997 (Why is no real title available?)
- Rank order smoothers with two-dimensional data model
- Concentration inequalities for the exponential weighting method
- Simple proof of the risk bound for denoising by exponential weights for asymmetric noise distributions
- On the exponentially weighted aggregate with the Laplace prior
This page was built for publication: Ordered smoothers with exponential weighting
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q372129)
