Sharp estimation in sup norm with random design

DOI10.1016/J.SPL.2006.11.017MaRDI QIDQ997249zbMATH OpenOpenAlexFDO

Authors Stéphane Gaïffas

Publication date 23 July 2007

Published in Statistics \& Probability Letters (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/math/0509634

zbMATH Keywords

random designinhomogeneous data

Mathematics Subject Classification ID

Nonparametric estimation (62G05) Nonparametric regression and quantile regression (62G08) Asymptotic properties of nonparametric inference (62G20)

Abstract: The aim of this paper is to recover the regression function with sup norm loss. We construct an asymptotically sharp estimator which converges with the spatially dependent rate r_{n, mu}(x) = P �ig(log n / (n mu(x)) �ig)^{s / (2s + 1)}, where $mu$ is the design density, $s$ the regression smoothness, $n$ the sample size and $P$ is a constant expressed in terms of a solution to a problem of optimal recovery as in Donoho (1994). We prove this result under the assumption that $mu$ is positive and continuous. This estimator combines kernel and local polynomial methods, where the kernel is given by optimal recovery, which allows to prove the result up to the constants for any $s>0$. Moreover, the estimator does not depend on $mu$. We prove that $r_{n,mu}(x)$ is optimal in a sense which is stronger than the classical minimax lower bound. Then, an inhomogeneous confidence band is proposed. This band has a non constant length which depends on the local amount of data.

Recommendations

• Sharp estimates of deviations of the sample mean in many dimensions
• Sharp estimate on the supremum of a class of sums of small i.i.d. random variables
• Sharp large deviations in nonparametric estimation
• Minimax exact constant in sup-norm for nonparametric regression with random design
• On sharp nonparametric estimation of differentiable functions
• Sharp bounds on the variance in randomized experiments
• Sharp bounds on l-estimates and their expectations for dependent samples
• A sharp estimate for probability distributions
• SHRINKAGE ESTIMATION FOR NEARLY SINGULAR DESIGNS

Cites work

• scientific article; zbMATH DE number 49190 (Why is no real title available?)
• scientific article; zbMATH DE number 3601500 (Why is no real title available?)
• An Asymptotically Minimax Regression Estimator in the Uniform Norm up to Exact Constant
• Asymptotic equivalence of nonparametric regression and white noise
• Asymptotic equivalence theory for nonparametric regression with random design
• Asymptotic minimax risk for sup-norm loss: Solution via optimal recovery
• Asymptotically exact minimax estimation in sup-norm for anisotropic Hölder classes
• Asymptotically exact nonparametric hypothesis testing in sup-norm and at a fixed point
• Minimax exact constant in sup-norm for nonparametric regression with random design
• On the solution of an optimal recovery problem and its applications in nonparametric regression
• Optimal global rates of convergence for nonparametric regression
• Optimal recovery of operators, and related problems
• Optimal spatial adaptation to inhomogeneous smoothness: An approach based on kernel estimates with variable bandwidth selectors
• Remarks on extremal problems in nonparametric curve estimation
• Renormalization exponents and optimal pointwise rates of convergence
• The asymptotic minimax constant for sup-norm loss in nonparametric density estimation

Cited in

(9)

• A sup-norm oracle inequality for a partially linear regression model
• On pointwise adaptive curve estimation based on inhomogeneous data
• Spatially inhomogeneous linear inverse problems with possible singularities
• A note on wavelet estimation of the derivatives of a regression function in a random design setting
• Asymptotic equivalence for nonparametric regression with multivariate and random design
• Minimax exact constant in sup-norm for nonparametric regression with random design
• A robust, adaptive M-estimator for pointwise estimation in heteroscedastic regression
• Classification via local multi-resolution projections
• Uniform estimation of a signal based on inhomogeneous data

This page was built for publication: Sharp estimation in sup norm with random design

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q997249)