Minimax linear smoothers
Consider the standard model for a random vector \(y=(y_{1},\dots,y_{n})\) such that \[ y_{i}=\mu_{i}+\epsilon_{i},\tag{1} \] \(i=1,\dots,\) where \((\epsilon_{i})\) are i.i.d. zero mean random variables with \(Var \epsilon_{i}=\sigma^{2}<\infty.\) The interest focuses on estimating \(\mu=(\mu_{1},...,\mu_{n})\) subject to the condition \[ \mu'B\mu\leq\rho, \tag{2} \] where \(B\) is symmetric. The standard estimation method for this problem is penalized least squares which minimizes \(\|y-\mu\|^{2}\) subject to the previous inequality or its Lagrangian form \[ \min_{\mu}\{\|y-\mu\|^{2}+k\mu'B\mu\}, \] where \(k\) depends on \(\rho.\) The purpose of this paper is to study an alternative estimation method based on the minimax principle. An estimator \(\hat\mu\) is minimax (relative to the parameter space \(\Theta\)) if \[ \inf_{\mu^{*}}\sup_{\mu\in\Theta}E\|\mu^{*}-\mu\|^{2}= \sup_{\mu\in\Theta}E\|\hat\mu-\mu\|^{2}, \] where the \(\inf\) is taken over all estimators \(\mu^{*}.\) The paper provides a complete characterization of minimax linear estimators for the model (1) when (2) is fulfilled. Based on Mallows' \(C_{L}\)- statistic, a way of constructing adaptive estimators for unknown \(\rho\) and \(\sigma^{2}\) is given which are asymptotically minimax. A comparison of minimax risk with the risk of penalized least squares estimators in a special case motivated by nonparametric regression is contained.
- Ordered linear smoothers
- Hypercube estimators: penalized least squares, submodel selection, and numerical stability
- On a method of empirical risk minimization
- Minimax estimation of linear functionals, particularly in nonparametric regression and positron emission tomography
- Minimax estimation for time series models
- Minimal realization and dynamic properties of optimal smoothers
- Minimax estimators of regression functions under normalized quadratic loss functions and inequality restrictions
- scientific article; zbMATH DE number 4201363 (Why is no real title available?)
- REACT Scatterplot Smoothers: Superefficiency through Basis Economy
- scientific article; zbMATH DE number 2160563 (Why is no real title available?)
- Adaptation over parametric families of symmetric linear estimators
This page was built for publication: Minimax linear smoothers
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2722230)