Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
From MaRDI portal
Abstract: Fitting high-dimensional statistical models often requires the use of non-linear parameter estimation procedures. As a consequence, it is generally impossible to obtain an exact characterization of the probability distribution of the parameter estimates. This in turn implies that it is extremely challenging to quantify the emph{uncertainty} associated with a certain parameter estimate. Concretely, no commonly accepted procedure exists for computing classical measures of uncertainty and statistical significance as confidence intervals or -values for these models. We consider here high-dimensional linear regression problem, and propose an efficient algorithm for constructing confidence intervals and -values. The resulting confidence intervals have nearly optimal size. When testing for the null hypothesis that a certain parameter is vanishing, our method has nearly optimal power. Our approach is based on constructing a `de-biased' version of regularized M-estimators. The new construction improves over recent work in the field in that it does not assume a special structure on the design matrix. We test our method on synthetic data and a high-throughput genomic data set about riboflavin production rate.
Recommendations
- Confidence intervals for low dimensional parameters in high dimensional linear models
- Confidence intervals for high-dimensional linear regression: minimax rates and adaptivity
- \(\chi^{2}\)-confidence sets in high-dimensional regression
- Testing linear hypotheses in high-dimensional regressions
- A unified theory of confidence regions and testing for high-dimensional estimating equations
- On asymptotically optimal confidence regions and tests for high-dimensional models
- \(p\)-values for high-dimensional regression
- Testing regression coefficients in high-dimensional and sparse settings
- Confidence intervals for high-dimensional partially linear single-index models
- Hypothesis testing for high-dimensional multivariate regression with false discovery rate control
Cited in
(only showing first 100 items - show all)- Distribution-free predictive inference for regression
- Confidence intervals for high-dimensional inverse covariance estimation
- Model-assisted inference for treatment effects using regularized calibrated estimation with high-dimensional data
- Flexible and Interpretable Models for Survival Data
- Non-asymptotic error controlled sparse high dimensional precision matrix estimation
- Honest confidence regions and optimality in high-dimensional precision matrix estimation
- Significance testing in non-sparse high-dimensional linear models
- A unified theory of confidence regions and testing for high-dimensional estimating equations
- Distributed testing and estimation under sparse high dimensional models
- Sparse linear models and \(l_1\)-regularized 2SLS with high-dimensional endogenous regressors and instruments
- Variable selection for high dimensional Gaussian copula regression model: an adaptive hypothesis testing procedure
- High-dimensional simultaneous inference with the bootstrap
- Rejoinder on: ``High-dimensional simultaneous inference with the bootstrap
- Asymptotically honest confidence regions for high dimensional parameters by the desparsified conservative Lasso
- Analysis of phenotypic- and estimated breeding values (EBV) to dissect the genetic architecture of complex traits in a Scots pine three-generation pedigree design
- Adaptive estimation of high-dimensional signal-to-noise ratios
- Online rules for control of false discovery rate and false discovery exceedance
- Selective inference with a randomized response
- Uniformly valid confidence sets based on the Lasso
- High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
- Semiparametric efficiency bounds for high-dimensional models
- ROCKET: robust confidence intervals via Kendall's tau for transelliptical graphical models
- Uniformly valid post-regularization confidence regions for many functional parameters in z-estimation framework
- Debiasing the Lasso: optimal sample size for Gaussian designs
- Usage of the GO estimator in high dimensional linear models
- Nonparametric inference via bootstrapping the debiased estimator
- Rate optimal estimation and confidence intervals for high-dimensional regression with missing covariates
- Confidence intervals for high-dimensional linear regression: minimax rates and adaptivity
- Inference in high dimensional linear measurement error models
- Optimal sparsity testing in linear regression model
- Inference without compatibility: using exponential weighting for inference on a parameter of a linear model
- Multicarving for high-dimensional post-selection inference
- The de-biased group Lasso estimation for varying coefficient models
- Second-order Stein: SURE for SURE and other applications in high-dimensional inference
- The distribution of the Lasso: uniform control over sparse balls and adaptive parameter tuning
- Augmented minimax linear estimation
- Scale calibration for high-dimensional robust regression
- High-dimensional inference for linear model with correlated errors
- In defense of the indefensible: a very naïve approach to high-dimensional inference
- Some perspectives on inference in high dimensions
- A convex programming solution based debiased estimator for quantile with missing response and high-dimensional covariables
- Confidence intervals for parameters in high-dimensional sparse vector autoregression
- Spatially relaxed inference on high-dimensional linear models
- Network differential connectivity analysis
- Asymptotic normality of robust M-estimators with convex penalty
- Design of c-optimal experiments for high-dimensional linear models
- High-dimensional linear models with many endogenous variables
- Powerful knockoffs via minimizing reconstructability
- Covariate-adjusted inference for differential analysis of high-dimensional networks
- Mathematical foundations of machine learning. Abstracts from the workshop held March 21--27, 2021 (hybrid meeting)
- Testability of high-dimensional linear models with nonsparse structures
- Inference for low-rank tensors -- no need to debias
- Recent advances in statistical methodologies in evaluating program for high-dimensional data
- Sparse matrix linear models for structured high-throughput data
- Semi-supervised empirical risk minimization: using unlabeled data to improve prediction
- High-dimensional sufficient dimension reduction through principal projections
- De-biasing the Lasso with degrees-of-freedom adjustment
- Doubly robust semiparametric inference using regularized calibrated estimation with high-dimensional data
- The asymptotic distribution of the MLE in high-dimensional logistic models: arbitrary covariance
- Post-model-selection inference in linear regression models: an integrated review
- Meta-analytic Gaussian network aggregation
- Thresholding tests based on affine Lasso to achieve non-asymptotic nominal level and high power under sparse and dense alternatives in high dimension
- Doubly debiased Lasso: high-dimensional inference under hidden confounding
- Hierarchical correction of \(p\)-values via an ultrametric tree running Ornstein-Uhlenbeck process
- Single-index composite quantile regression for ultra-high-dimensional data
- A unifying framework of high-dimensional sparse estimation with difference-of-convex (DC) regularizations
- Robust post-selection inference of high-dimensional mean regression with heavy-tailed asymmetric or heteroskedastic errors
- Statistical inference for model parameters in stochastic gradient descent
- Efficient estimation of linear functionals of principal components
- Hierarchical inference for genome-wide association studies: a view on methodology with software
- Inference for high-dimensional instrumental variables regression
- Debiasing the debiased Lasso with bootstrap
- Detangling robustness in high dimensions: composite versus model-averaged estimation
- Relaxing the assumptions of knockoffs by conditioning
- Ill-posed estimation in high-dimensional models with instrumental variables
- Robust regression with compositional covariates
- Innovated scalable efficient inference for ultra-large graphical models
- A significance test for the lasso
- Discussion: ``A significance test for the lasso
- Rejoinder: ``A significance test for the lasso
- A global homogeneity test for high-dimensional linear regression
- Testing for high-dimensional network parameters in auto-regressive models
- Variable selection via adaptive false negative control in linear regression
- Bootstrapping and sample splitting for high-dimensional, assumption-lean inference
- Lasso meets horseshoe: a survey
- Optimal designs in sparse linear models
- Composite versus model-averaged quantile regression
- On the asymptotic variance of the debiased Lasso
- A knockoff filter for high-dimensional selective inference
- Accuracy assessment for high-dimensional linear regression
- Penalized expectile regression: an alternative to penalized quantile regression
- Confidence sets in sparse regression
- Penalised robust estimators for sparse and high-dimensional linear models
- The costs and benefits of uniformly valid causal inference with high-dimensional nuisance parameters
- Worst possible sub-directions in high-dimensional models
- Statistical inference via conditional Bayesian posteriors in high-dimensional linear regression
- Communication-efficient sparse composite quantile regression for distributed data
- Distributed Bayesian posterior voting strategy for massive data
- Most powerful test against a sequence of high dimensional local alternatives
- Familywise error rate control via knockoffs
This page was built for publication: Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2934105)
