An \_1,_2,_\-regularization approach to high-dimensional errors-in-variables models

DOI10.1214/15-EJS1095zbMATH Open1397.62246arXiv1412.7216MaRDI QIDQ309537FDOQ309537

Mathieu Rosenbaum, A. Belloni, Alexandre B. Tsybakov

Publication date: 7 September 2016

Published in: Electronic Journal of Statistics (Search for Journal in Brave)

Abstract: Several new estimation methods have been recently proposed for the linear regression model with observation error in the design. Different assumptions on the data generating process have motivated different estimators and analysis. In particular, the literature considered (1) observation errors in the design uniformly bounded by some $$, and (2) zero mean independent observation errors. Under the first assumption, the rates of convergence of the proposed estimators depend explicitly on $$, while the second assumption has been applied when an estimator for the second moment of the observational error is available. This work proposes and studies two new estimators which, compared to other procedures for regression models with errors in the design, exploit an additional $l_{infty}$-norm regularization. The first estimator is applicable when both (1) and (2) hold but does not require an estimator for the second moment of the observational error. The second estimator is applicable under (2) and requires an estimator for the second moment of the observation error. Importantly, we impose no assumption on the accuracy of this pilot estimator, in contrast to the previously known procedures. As the recent proposals, we allow the number of covariates to be much larger than the sample size. We establish the rates of convergence of the estimators and compare them with the bounds obtained for related estimators in the literature. These comparisons show interesting insights on the interplay of the assumptions and the achievable rates of convergence.

Full work available at URL: https://arxiv.org/abs/1412.7216

zbMATH Keywords

linear regression modelestimation method

Mathematics Subject Classification ID

Linear regression; mixed models (62J05) Estimation in multivariate analysis (62H12)

Cites Work

• Measurement error in Lasso: impact and likelihood bias correction
• Improved matrix uncertainty selector
• Sparse recovery under matrix uncertainty
• High-dimensional regression with noisy and missing data: provable guarantees with nonconvexity
• Pivotal Estimation in High-Dimensional Regression via Linear Programming

Cited In (9)

• High dimensional semiparametric moment restriction models
• Rate optimal estimation and confidence intervals for high-dimensional regression with missing covariates
• Tikhonov-Phillips regularizations in linear models with blurred design
• On high-dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization
• Calibrated zero-norm regularized LS estimator for high-dimensional error-in-variables regression
• Low-rank matrix estimation via nonconvex optimization methods in multi-response errors-in-variables regression
• Sparse estimation in high-dimensional linear errors-in-variables regression via a covariate relaxation method
• On Parameter Estimation for High Dimensional Errors-in-Variables Models
• Poisson Regression With Error Corrupted High Dimensional Features

This page was built for publication: An \(\{\ell_{1},\ell_{2},\ell_{\infty}\}\)-regularization approach to high-dimensional errors-in-variables models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q309537)