Gaining Outlier Resistance With Progressive Quantiles: Fast Algorithms and Theoretical Studies
From MaRDI portal
Abstract: Outliers widely occur in big-data applications and may severely affect statistical estimation and inference. In this paper, a framework of outlier-resistant estimation is introduced to robustify an arbitrarily given loss function. It has a close connection to the method of trimming and includes explicit outlyingness parameters for all samples, which in turn facilitates computation, theory, and parameter tuning. To tackle the issues of nonconvexity and nonsmoothness, we develop scalable algorithms with implementation ease and guaranteed fast convergence. In particular, a new technique is proposed to alleviate the requirement on the starting point such that on regular datasets, the number of data resamplings can be substantially reduced. Based on combined statistical and computational treatments, we are able to perform nonasymptotic analysis beyond M-estimation. The obtained resistant estimators, though not necessarily globally or even locally optimal, enjoy minimax rate optimality in both low dimensions and high dimensions. Experiments in regression, classification, and neural networks show excellent performance of the proposed methodology at the occurrence of gross outliers.
Recommendations
Cites work
- \(\ell_1\)-penalized quantile regression in high-dimensional sparse models
- About Regression Estimators with High Breakdown Point
- Analysis of generalized Bregman surrogate algorithms for nonsmooth nonconvex statistical learning
- Asymptotic Statistics
- Boosting With theL2Loss
- CoSaMP: Iterative signal recovery from incomplete and inaccurate samples
- Decoding by Linear Programming
- Group Iterative Spectrum Thresholding for Super-Resolution Sparse Spectral Selection
- scientific article; zbMATH DE number 3905646 (Why is no real title available?)
- scientific article; zbMATH DE number 3986407 (Why is no real title available?)
- scientific article; zbMATH DE number 1124626 (Why is no real title available?)
- scientific article; zbMATH DE number 2107836 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 850143 (Why is no real title available?)
- scientific article; zbMATH DE number 6438182 (Why is no real title available?)
- scientific article; zbMATH DE number 3296905 (Why is no real title available?)
- Implementing the Bianco and Yohai estimator for logistic regression
- Influence functions for penalized M-estimators
- Maximum trimmed likelihood estimators: a unified approach, examples, and algorithms
- Multi-stage convex relaxation for feature selection
- On Cross-Validation for Sparse Reduced Rank Regression
- On the conditions used to prove oracle results for the Lasso
- Outlier detection using nonconvex penalized regression
- Outlier Robust Model Selection in Linear Regression
- Robust and consistent variable selection in high-dimensional generalized linear models
- Robust elastic net estimators for variable selection and identification of proteomic biomarkers
- Robust Inference for Generalized Linear Models
- Robust Linear Model Selection Based on Least Angle Regression
- Robust Linear Model Selection by Cross-Validation
- Robust model selection using fast and robust bootstrap
- Robust reduced-rank regression
- Robust Statistics
- Robust Statistics
- Sparse least trimmed squares regression for analyzing high-dimensional large data sets
- Statistical consistency and asymptotic normality for high-dimensional robust \(M\)-estimators
- The influence function of penalized regression estimators
- Training a Support Vector Machine in the Primal
Cited in
(16)- Design-based estimation for geometric quantiles with application to outlier detection
- A greedy Newton-type method for multiple sparse constraint problem
- Pointwise probability reinforcements for robust statistical inference
- Resilience: a criterion for learning in the presence of arbitrary outliers
- Robust variable selection and estimation via adaptive elastic net S-estimators for linear regression
- The Cellwise Minimum Covariance Determinant Estimator
- Distribution-insensitive influential point detection for high dimensional regression model
- Robust multitask feature learning with adaptive Huber regressions
- Tilted least squares robust estimators
- High-dimensional outlier detection and variable selection via adaptive weighted mean regression
- The half-quadratic approach for high-dimensional robust M-estimation
- Influential Observations Detection by Random Projection in High-Dimensional Multivariate Response Linear Model
- Robustness aspects of optimal transport
- Information Sharing for Robust and Stable Cross-Validation
- Distributed learning with adversarial contamination: an efficient and optimal approach based on dynamic regularization
- A resistant learning procedure for coping with outliers
This page was built for publication: Gaining Outlier Resistance With Progressive Quantiles: Fast Algorithms and Theoretical Studies
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5881134)
