Adaptive robust estimation in sparse vector model

From MaRDI portal
Publication:820801



Abstract: For the sparse vector model, we consider estimation of the target vector, of its L2-norm and of the noise variance. We construct adaptive estimators and establish the optimal rates of adaptive estimation when adaptation is considered with respect to the triplet "noise level - noise distribution - sparsity". We consider classes of noise distributions with polynomially and exponentially decreasing tails as well as the case of Gaussian noise. The obtained rates turn out to be different from the minimax non-adaptive rates when the triplet is known. A crucial issue is the ignorance of the noise variance. Moreover, knowing or not knowing the noise distribution can also influence the rate. For example, the rates of estimation of the noise variance can differ depending on whether the noise is Gaussian or sub-Gaussian without a precise knowledge of the distribution. Estimation of noise variance in our setting can be viewed as an adaptive variant of robust estimation of scale in the contamination model, where instead of fixing the "nominal" distribution in advance, we assume that it belongs to some class of distributions.


This paper is a study on construction of estimators that are optimally adaptive in a minimax sense with respect to the noise level, to the form of the noise distribution, and to the sparsity. For the sparse vector model, the authors consider estimation of the target vector, of its l2-norm and of the noise variance. The noise random variables are assumed to be i.i.d.. The authors consider classes of noise distributions with polynomially and exponentially decreasing tails as well as the case of Gaussian noise. They obtained rates turn out to be different from the minimax nonadaptive rates when the triplet is known. They study estimation of sparse vector in l2-norm when the variance of noise and the distribution of random variables are both unknown. They only assume that the noise distribution belongs to a given class, which can be either a class of distributions with polynomial tails, or a class with exponential decay of the tails. They show the estimation of the l2-norm, the estimation of the variance of the noise. They also show the proofs of the upper bounds and the lower bounds.





Describes a project that uses

Uses Software






This page was built for publication: Adaptive robust estimation in sparse vector model

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q820801)