A shrinkage principle for heavy-tailed data: high-dimensional robust low-rank matrix recovery (Q820791): Difference between revisions

The popular assumption of sub-Gaussian or subexponential noises in the theoretical analysis of standard statistical procedures is contradictory and has adverse impact on the popularly used methods. Hence, simple and effective principles for robust statistical inference are needed for dealing with heavy tailed data. The paper under review addresses this problem. Its authors propose truncation of univariate data and,more generally, shrinkage of multivariate data to achieve the robustness. The authors' approach is illustrated through a general model, which embraces the linear model, matrix compressed sensing, matrix completion, and multitask regression as specific examples. The authors develop the generalized loss, the truncated and shrinkage sample covariance, and corresponding M-estimators. Then, the conditions required on the robust covariance inputs to ensure the desired statistical error rates of the M-estimator are presented. These results are thereafter applied to all the specific above-mentioned problems in order to explicitly derive the specific error rates. Next, the convergence properties of the shrinkage covariance estimator under the spectral norm are studied. It is found that under high dimensions the proposed robust covariance is minimax optimal up to a logarithmic factor, whereas traditional sample covariance is not. Finally, simulation analyses is presented, which demonstrate the advantage of proposed robust estimators over the standard ones.