Confidence intervals for high-dimensional linear regression: minimax rates and adaptivity
From MaRDI portal
Publication:2012200
Abstract: Confidence sets play a fundamental role in statistical inference. In this paper, we consider confidence intervals for high dimensional linear regression with random design. We first establish the convergence rates of the minimax expected length for confidence intervals in the oracle setting where the sparsity parameter is given. The focus is then on the problem of adaptation to sparsity for the construction of confidence intervals. Ideally, an adaptive confidence interval should have its length automatically adjusted to the sparsity of the unknown regression vector, while maintaining a prespecified coverage probability. It is shown that such a goal is in general not attainable, except when the sparsity parameter is restricted to a small region over which the confidence intervals have the optimal length of the usual parametric rate. It is further demonstrated that the lack of adaptivity is not due to the conservativeness of the minimax framework, but is fundamentally caused by the difficulty of learning the bias accurately.
Recommendations
- Confidence sets in sparse regression
- Confidence intervals for low dimensional parameters in high dimensional linear models
- Exact adaptive confidence intervals for linear regression coefficients
- Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
- Confidence sets based on thresholding estimators in high-dimensional Gaussian regression models
Cited in
(92)- Exact adaptive confidence intervals for linear regression coefficients
- Significance testing in non-sparse high-dimensional linear models
- A unified theory of confidence regions and testing for high-dimensional estimating equations
- Adaptive estimation of the sparsity in the Gaussian vector model
- Adaptive estimation of high-dimensional signal-to-noise ratios
- Semiparametric efficiency bounds for high-dimensional models
- Debiasing the Lasso: optimal sample size for Gaussian designs
- Empirical Bayes oracle uncertainty quantification for regression
- Rate optimal estimation and confidence intervals for high-dimensional regression with missing covariates
- Optimal sparsity testing in linear regression model
- Multicarving for high-dimensional post-selection inference
- Scale calibration for high-dimensional robust regression
- Some perspectives on inference in high dimensions
- Stochastic continuum-armed bandits with additive models: minimax regrets and adaptive algorithm
- Design of c-optimal experiments for high-dimensional linear models
- Testability of high-dimensional linear models with nonsparse structures
- De-biasing the Lasso with degrees-of-freedom adjustment
- Thresholding tests based on affine Lasso to achieve non-asymptotic nominal level and high power under sparse and dense alternatives in high dimension
- Doubly debiased Lasso: high-dimensional inference under hidden confounding
- Robust post-selection inference of high-dimensional mean regression with heavy-tailed asymmetric or heteroskedastic errors
- Efficient estimation of linear functionals of principal components
- Debiasing the debiased Lasso with bootstrap
- Variable selection via adaptive false negative control in linear regression
- Dynamic linear discriminant analysis in high dimensional space
- On the asymptotic variance of the debiased Lasso
- Accuracy assessment for high-dimensional linear regression
- Predictor ranking and false discovery proportion control in high-dimensional regression
- Confidence sets in sparse regression
- Double-estimation-friendly inference for high-dimensional misspecified models
- Statistical inference via conditional Bayesian posteriors in high-dimensional linear regression
- Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
- Confidence Intervals for Maximin Effects in Inhomogeneous Large-Scale Data
- Linear hypothesis testing in dense high-dimensional linear models
- Minimum-volume confidence sets for normal linear regression models
- High-dimensional inference for cluster-based graphical models
- Global and Simultaneous Hypothesis Testing for High-Dimensional Logistic Regression Models
- scientific article; zbMATH DE number 7626707 (Why is no real title available?)
- scientific article; zbMATH DE number 7626769 (Why is no real title available?)
- Projection-based Inference for High-dimensional Linear Models
- Confidence intervals for sparse penalized regression with random designs
- A bootstrap Lasso+partial ridge method to construct confidence intervals for parameters in high-dimensional sparse linear models
- Fixed effects testing in high-dimensional linear mixed models
- Confidence intervals for low dimensional parameters in high dimensional linear models
- Confidence sets based on thresholding estimators in high-dimensional Gaussian regression models
- IFAA: Robust Association Identification and Inference for Absolute Abundance in Microbiome Analyses
- Comments on: ``High-dimensional simultaneous inference with the bootstrap
- Inference and Estimation for Random Effects in High-Dimensional Linear Mixed Models
- Orthogonalized Kernel Debiased Machine Learning for Multimodal Data Analysis
- Sparse Topic Modeling: Computational Efficiency, Near-Optimal Algorithms, and Statistical Inference
- Controlling False Discovery Rate Using Gaussian Mirrors
- Model-Assisted Uniformly Honest Inference for Optimal Treatment Regimes in High Dimension
- Honest Confidence Sets for High-Dimensional Regression by Projection and Shrinkage
- Statistical Inference for High-Dimensional Generalized Linear Models With Binary Outcomes
- Inference for High-Dimensional Linear Mixed-Effects Models: A Quasi-Likelihood Approach
- Integrative Factor Regression and Its Inference for Multimodal Data Analysis
- Debiasing convex regularized estimators and interval estimation in linear models
- LIC criterion for optimal subset selection in distributed interval estimation
- Online Debiasing for Adaptively Collected High-Dimensional Data With Applications to Time Series Analysis
- On lower bounds for the bias-variance trade-off
- Inference for heteroskedastic PCA with missing data
- Estimation and Inference for High-Dimensional Generalized Linear Models with Knowledge Transfer
- Test of Significance for High-Dimensional Thresholds with Application to Individualized Minimal Clinically Important Difference
- Estimation of Linear Functionals in High-Dimensional Linear Models: From Sparsity to Nonsparsity
- Group inference in high dimensions with applications to hierarchical testing
- Inference for high-dimensional linear expectile regression with de-biasing method
- Statistical Inference for Maximin Effects: Identifying Stable Associations across Multiple Studies
- Transfer Learning with Large-Scale Quantile Regression
- Statistical inference for high dimensional regression with proxy data
- On adaptive confidence ellipsoids for sparse high-dimensional linear models
- Linear hypothesis testing in high-dimensional expected shortfall regression with heavy-tailed errors
- Semi-supervised linear regression: enhancing efficiency and robustness in high dimensions
- Communication-Efficient Distributed Estimation and Inference for Cox’s Model
- Prediction sets for high-dimensional mixture of experts models
- Linear hypothesis testing for high dimensional Tobit models
- Projection-posterior for variable selection: weak limit and coverage
- Correlation adjusted debiased Lasso: debiasing the Lasso with inaccurate covariate model
- Sparsified simultaneous confidence intervals for high-dimensional linear models
- Controlling the False Split Rate in Tree-Based Aggregation
- F statistics for high-dimensional inference of linear model
- Posterior consistency in multi-response regression models with non-informative priors for the error covariance matrix in growing dimensions
- Subsampling from features in large regression to find ``winning features
- Testing Many Zero Restrictions in a High Dimensional Linear Regression Setting
- _1-penalized multinomial regression: estimation, inference, and prediction, with an application to risk factor identification for different dementia subtypes
- Spectrum-aware debiasing: a modern inference framework with applications to principal components regression
- Finite- and large sample inference for model and coefficients in high-dimensional linear regression with repro samples
- Small Tuning Parameter Selection for the Debiased Lasso
- Adaptive robust confidence intervals
- Statistical inference for low-rank tensors: heteroskedasticity, subgaussianity, and applications
- Uncertainty quantification for iterative algorithms in linear models with application to early stopping
- Adaptive reweighting for joint estimation of sparse and non-sparse components
- Efficient inference on high-dimensional linear models with missing outcomes
- Testing endogeneity with high dimensional covariates
This page was built for publication: Confidence intervals for high-dimensional linear regression: minimax rates and adaptivity
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2012200)
