Convergence rates of least squares regression estimators with heavy-tailed errors
From MaRDI portal
Publication:2313287
DOI10.1214/18-AOS1748zbMath1466.60033arXiv1706.02410OpenAlexW2884654644WikidataQ127862466 ScholiaQ127862466MaRDI QIDQ2313287
Publication date: 18 July 2019
Published in: The Annals of Statistics (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1706.02410
nonparametric regressionleast squares estimationsparse linear regressionheavy-tailed errorsmultiplier inequalitymultiplier empirical process
Inequalities; stochastic orderings (60E15) Nonparametric estimation (62G05) (L^p)-limit theorems (60F25)
Related Items
On least squares estimation under heteroscedastic and heavy-tailed errors, On robust learning in the canonical change point problem under heavy tailed errors in finite and growing dimensions, Sufficient dimension reduction for average causal effect estimation, Complex sampling designs: uniform limit theorems and applications, Robust statistical learning with Lipschitz and convex loss functions, Posterior concentration and fast convergence rates for generalized Bayesian learning, Generic error bounds for the generalized Lasso with sub-exponential data, An Online Projection Estimator for Nonparametric Regression in Reproducing Kernel Hilbert Spaces, Bootstrap Inference for Quantile-based Modal Regression, High-dimensional CLT: improvements, non-uniform extensions and large deviations, Regression in Tensor Product Spaces by the Method of Sieves, Inference for local distributions at high sampling frequencies: a bootstrap approach, Set structured global empirical risk minimizers are rate optimal in general dimensions, Convergence rates of least squares regression estimators with heavy-tailed errors, Multiplier \(U\)-processes: sharp bounds and applications, Sample selection models with monotone control functions, Multiscale change-point segmentation: beyond step functions, Distribution-free robust linear regression
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- On asymptotically optimal confidence regions and tests for high-dimensional models
- Geometric median and robust estimation in Banach spaces
- Upper bounds on product and multiplier empirical processes
- A new method for estimation and model selection: \(\rho\)-estimation
- Sub-Gaussian mean estimators
- Sparse recovery under weak moment assumptions
- On the estimation of the mean of a random vector
- Statistics for high-dimensional data. Methods, theory and applications.
- Probability in Banach spaces. Isoperimetry and processes
- A new approach to least-squares estimation, with applications
- Robust linear least squares regression
- Limit of the smallest eigenvalue of a large dimensional sample covariance matrix
- Minimax theory of image reconstruction
- Some limit theorems for empirical processes (with discussion)
- Risk bounds for statistical learning
- Empirical risk minimization for heavy-tailed losses
- Estimating a regression function
- Consistencies and rates of convergence of jump-penalized least squares estimators
- Conditions d'intégrabilité pour les multiplicateurs dans le TLC banachique. (Integrability conditions for multiplicators in the central limit theorem in Banach spaces)
- A note on the largest eigenvalue of a large dimensional sample covariance matrix
- Rates of convergence for minimum contrast estimators
- Consistency for the least squares estimator in nonparametric regression
- Information-theoretic determination of minimax rates of convergence
- The Gaussian hare and the Laplacian tortoise: computability of squared-error versus absolute-error estimators. With comments by Ronald A. Thisted and M. R. Osborne and a rejoinder by the authors
- ``Local vs. ``global parameters -- breaking the Gaussian complexity barrier
- Sub-Gaussian estimators of the mean of a random vector
- Regularization and the small-ball method. I: Sparse recovery
- The asymptotic distribution of weighted empirical distribution functions
- Risk bounds in isotonic regression
- Weak convergence and empirical processes. With applications to statistics
- Challenging the empirical mean and empirical variance: a deviation study
- A local maximal inequality under uniform entropy
- Convergence rates of least squares regression estimators with heavy-tailed errors
- On aggregation for heavy-tailed classes
- Local Rademacher complexities and oracle inequalities in risk minimization. (2004 IMS Medallion Lecture). (With discussions and rejoinder)
- Regularization, sparse recovery, and median-of-means tournaments
- Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors
- Confidence sets in sparse regression
- Empirical minimization
- Concentration inequalities and asymptotic results for ratio type empirical processes
- Local Rademacher complexities
- Learning without Concentration
- Empirical Processes with Applications to Statistics
- Mathematical Foundations of Infinite-Dimensional Statistical Models
- Near-Optimal Detection of Geometric Objects by Fast Multiscale Methods
- The Central Limit Theorem for Empirical Processes Under Local Conditions: The Case of Radon Infinitely Divisible Limits without Gaussian Component
- Tests for change-points with epidemic alternatives
- Extending the scope of the small-ball method
- Uniform Central Limit Theorems
- Minimax Rates of Estimation for High-Dimensional Linear Regression Over $\ell_q$-Balls
- On Multiplier Processes Under Weak Moment Assumptions
- Bandits With Heavy Tail
- Upper and Lower Bounds for Stochastic Processes
- Nonparametric regression with dependent errors