Ridge regression and asymptotic minimax estimation over spheres of growing dimension
From MaRDI portal
Publication:5963493
DOI10.3150/14-BEJ609zbMath1388.62205arXiv1601.03900OpenAlexW3105622673MaRDI QIDQ5963493
Publication date: 22 February 2016
Published in: Bernoulli (Search for Journal in Brave)
Full work available at URL: https://arxiv.org/abs/1601.03900
Nonparametric regression and quantile regression (62G08) Estimation in multivariate analysis (62H12) Ridge regression; shrinkage estimators (Lasso) (62J07) Linear regression; mixed models (62J05) Minimax procedures in statistical decision theory (62C20)
Related Items (18)
Significance testing in non-sparse high-dimensional linear models ⋮ On the Behavior of the Risk of a LASSO-Type Estimator ⋮ Adaptive estimation in multivariate response regression with hidden variables ⋮ Surprises in high-dimensional ridgeless least squares interpolation ⋮ WONDER: Weighted one-shot distributed ridge regression in high dimensions ⋮ Generalization error rates in kernel regression: the crossover from the noiseless to noisy regime* ⋮ High-Dimensional Factor Regression for Heterogeneous Subpopulations ⋮ A Universal Trade-off Between the Model Size, Test Loss, and Training Loss of Linear Predictors ⋮ Smoothly varying regularization ⋮ Universality of regularized regression estimators in high dimensions ⋮ Unnamed Item ⋮ On the accuracy in high‐dimensional linear models and its application to genomic selection ⋮ In Nonparametric and High-Dimensional Models, Bayesian Ignorability is an Informative Prior ⋮ High-dimensional asymptotics of prediction: ridge regression and classification ⋮ Cleaning large correlation matrices: tools from random matrix theory ⋮ Ridge Regression Under Dense Factor Augmented Models ⋮ On the asymptotic risk of ridge regression with many predictors ⋮ Exact minimax risk for linear least squares, and the lower tail of sample covariance matrices
Cites Work
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Unnamed Item
- Nearly unbiased variable selection under minimax concave penalty
- Optimal equivariant prediction for high-dimensional linear models with arbitrary predictor covariance
- Convergence rate of expected spectral distributions of large random matrices. II: Sample covariance matrices
- Information inequalities for the Bayes risk
- Quasilinear estimates of signals in \(L_ 2\)
- Conditional predictive inference post model selection
- Inequalities for the gamma function
- Spectrum estimation for large dimensional covariance matrices using random matrix theory
- Statistical decision theory and Bayesian analysis. 2nd ed
- A dozen de Finetti-style results in search of a theory
- Optimal filtering of square-integrable signals in Gaussian noise
- Minimax estimation of the mean of a normal distribution when the parameter space is restricted
- Information inequality bounds on the minimax risk (with an application to nonparametric regression)
- Modified Bessel functions and their applications in probability and statistics
- Minimax risk over \(l_ p\)-balls for \(l_ q\)-error
- Adaptive prediction and estimation in linear regression with infinitely many parameters.
- Optimal prediction for linear regression with infinitely many parameters.
- On minimax filtering over ellipsoids
- Strong convergence of the empirical distribution of eigenvalues of large dimensional random matrices
- Inadmissibility of maximum likelihood estimators in some multiple regression problems with three or more independent variables
- Simultaneous analysis of Lasso and Dantzig selector
- Sparsity oracle inequalities for the Lasso
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- An ancillarity paradox which appears in multiple linear regression
- Variance estimation in high-dimensional linear models
- Square-root lasso: pivotal recovery of sparse signals via conic programming
- Scaled sparse linear regression
- Some inequalities satisfied by the quantities of information of Fisher and Shannon
- How Many Variables Should be Entered in a Regression Equation?
- Amenability: A survey for statistical applications of hunt-stein and related conditions on groups
- Ridge Regression and James-Stein Estimation: Review and Comments
- Estimation of a multivariate mean with constraints on the norm
- A proof of the Fisher information inequality via a data processing argument
- Convergence Rates of Spectral Distributions of Large Sample Covariance Matrices
- Minimax Rates of Estimation for High-Dimensional Linear Regression Over $\ell_q$-Balls
- DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES
- Ridge Regression: Biased Estimation for Nonorthogonal Problems
- Admissible Estimators, Recurrent Diffusions, and Insoluble Boundary Value Problems
This page was built for publication: Ridge regression and asymptotic minimax estimation over spheres of growing dimension
