On asymptotically optimal confidence regions and tests for high-dimensional models

DOI10.1214/14-AOS1221zbMATH Open1305.62259OpenAlexW3099550161MaRDI QIDQ95759FDOQ95759

Authors: Sara van de Geer, Peter Bühlmann, Ya’Acov Ritov, Ruben Dezeure, Sara Van De Geer, Yaacov Ritov, Ruben Dezeure, Peter Bühlmann 

Publication date: 1 June 2014

Published in: The Annals of Statistics (Search for Journal in Brave)

Abstract: We propose a general method for constructing confidence intervals and statistical tests for single or low-dimensional components of a large parameter vector in a high-dimensional model. It can be easily adjusted for multiplicity taking dependence among tests into account. For linear models, our method is essentially the same as in Zhang and Zhang [J. R. Stat. Soc. Ser. B Stat. Methodol. 76 (2014) 217-242]: we analyze its asymptotic properties and establish its asymptotic optimality in terms of semiparametric efficiency. Our method naturally extends to generalized linear models with convex loss functions. We develop the corresponding theory which includes a careful analysis for Gaussian, sub-Gaussian and bounded correlated designs.

Full work available at URL: https://arxiv.org/abs/1303.0518

Recommendations

• Confidence intervals for low dimensional parameters in high dimensional linear models
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• A general theory of hypothesis tests and confidence regions for sparse high dimensional models
• Statistical inference for the optimal approximating model
• A unified theory of confidence regions and testing for high-dimensional estimating equations

zbMATH Keywords

lassogeneralized linear modellinear modelcentral limit theoremmultiple testingsemiparametric efficiencysparsity

Mathematics Subject Classification ID

Asymptotic properties of parametric estimators (62F12) Parametric tolerance and confidence regions (62F25) Ridge regression; shrinkage estimators (Lasso) (62J07) Generalized linear models (logistic models) (62J12)

Cites Work

• Title not available (Why is that?)
• Statistics for high-dimensional data. Methods, theory and applications.
• Lasso-type recovery of sparse representations for high-dimensional data
• On the conditions used to prove oracle results for the Lasso
• Simultaneous analysis of Lasso and Dantzig selector
• High-dimensional generalized linear models and the lasso
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• High-dimensional graphs and variable selection with the Lasso
• Restricted eigenvalue properties for correlated Gaussian designs
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• \(p\)-values for high-dimensional regression
• Square-root lasso: pivotal recovery of sparse signals via conic programming
• Title not available (Why is that?)
• Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$-Constrained Quadratic Programming (Lasso)
• Title not available (Why is that?)
• A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers
• On asymptotically optimal confidence regions and tests for high-dimensional models
• Sparse inverse covariance estimation with the graphical lasso
• Persistene in high-dimensional linear predictor-selection and the virtue of overparametrization
• Honest confidence regions for nonparametric regression
• Asymptotics for Lasso-type estimators.
• Least squares after model selection in high-dimensional sparse models
• Sign-constrained least squares estimation for high-dimensional regression
• Sparsity oracle inequalities for the Lasso
• Confidence sets in sparse regression
• Boosting for high-dimensional linear models
• Hypothesis Testing in High-Dimensional Regression Under the Gaussian Random Design Model: Asymptotic Theory
• Nemirovski's inequalities revisited
• Bootstrapping Lasso estimators
• Scaled sparse linear regression
• A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
• Valid post-selection inference
• The Group Lasso for Logistic Regression
• Rates of convergence of the adaptive LASSO estimators to the oracle distribution and higher order refinements by the bootstrap
• Statistical significance in high-dimensional linear models
• Root-N-Consistent Semiparametric Regression
• New concentration inequalities for suprema of empirical processes
• A central limit theorem applicable to robust regression estimators
• Quasi-likelihood and/or robust estimation in high dimensions
• Accuracy guaranties for \(\ell_{1}\) recovery of block-sparse signals
• High-dimensional variable selection
• On the distribution of penalized maximum likelihood estimators: the LASSO, SCAD, and thresholding
• The sparsity and bias of the LASSO selection in high-dimensional linear regression
• Confidence sets based on sparse estimators are necessarily large

Cited In (only showing first 100 items - show all)

• Confidence intervals for sparse precision matrix estimation via Lasso penalized D-trace loss
• Asymptotic normality of robust \(M\)-estimators with convex penalty
• Relaxing the assumptions of knockoffs by conditioning
• Design of c-optimal experiments for high-dimensional linear models
• Confidence sets for high-dimensional empirical linear prediction (HELP) models with dependent error structure
• Optimal designs in sparse linear models
• Optimal linear discriminators for the discrete choice model in growing dimensions
• Inference for high-dimensional instrumental variables regression
• Nearly optimal Bayesian shrinkage for high-dimensional regression
• Inference under Fine-Gray competing risks model with high-dimensional covariates
• Rate optimal estimation and confidence intervals for high-dimensional regression with missing covariates
• Time-dependent Poisson reduced rank models for political text data analysis
• The likelihood ratio test in high-dimensional logistic regression is asymptotically a rescaled Chi-square
• Online rules for control of false discovery rate and false discovery exceedance
• Bootstrap inference for penalized GMM estimators with oracle properties
• Network classification with applications to brain connectomics
• Hypothesis Testing for Network Data with Power Enhancement
• Rejoinder to “A Tuning-Free Robust and Efficient Approach to High-Dimensional Regression”
• Directed graphs and variable selection in large vector autoregressive models
• Local optimization-based statistical inference
• Asymptotically efficient estimation of smooth functionals of covariance operators
• Inference without compatibility: using exponential weighting for inference on a parameter of a linear model
• Model selection with mixed variables on the Lasso path
• Efficient distributed estimation of high-dimensional sparse precision matrix for transelliptical graphical models
• High-dimensional variable selection via low-dimensional adaptive learning
• Multicarving for high-dimensional post-selection inference
• Prediction regions through inverse regression
• Online inference in high-dimensional generalized linear models with streaming data
• Efficient estimation of linear functionals of principal components
• Inference on the change point under a high dimensional sparse mean shift
• Lasso meets horseshoe: a survey
• The distribution of the Lasso: uniform control over sparse balls and adaptive parameter tuning
• Predictor ranking and false discovery proportion control in high-dimensional regression
• Statistical inference for Cox proportional hazards models with a diverging number of covariates
• In defense of the indefensible: a very naïve approach to high-dimensional inference
• Hypothesis testing in large-scale functional linear regression
• An overview of tests on high-dimensional means
• Tests for coefficients in high-dimensional additive hazard models
• Post-regularization inference for time-varying nonparanormal graphical models
• Nonuniformity of \(p\)-values can occur early in diverging dimensions
• Linear hypothesis testing for high dimensional generalized linear models
• Kernel meets sieve: post-regularization confidence bands for sparse additive model
• Doubly robust tests of exposure effects under high‐dimensional confounding
• Inference for high-dimensional varying-coefficient quantile regression
• Scale calibration for high-dimensional robust regression
• A convex programming solution based debiased estimator for quantile with missing response and high-dimensional covariables
• Distributed adaptive Huber regression
• Confidence intervals for parameters in high-dimensional sparse vector autoregression
• Some perspectives on inference in high dimensions
• Debiasing convex regularized estimators and interval estimation in linear models
• Composite versus model-averaged quantile regression
• Structural inference in sparse high-dimensional vector autoregressions
• A weak‐signal‐assisted procedure for variable selection and statistical inference with an informative subsample
• Network differential connectivity analysis
• Spatially relaxed inference on high-dimensional linear models
• De-biasing the Lasso with degrees-of-freedom adjustment
• Robust post-selection inference of high-dimensional mean regression with heavy-tailed asymmetric or heteroskedastic errors
• A selective review of statistical methods using calibration information from similar studies
• Debiased Inference on Treatment Effect in a High-Dimensional Model
• An adaptively resized parametric bootstrap for inference in high-dimensional generalized linear models
• Statistical inference for high-dimensional linear regression with blockwise missing data
• Global and Simultaneous Hypothesis Testing for High-Dimensional Logistic Regression Models
• Title not available (Why is that?)
• Sparse Poisson regression with penalized weighted score function
• Title not available (Why is that?)
• High-dimensional robust inference for censored linear models
• A Scale-Free Approach for False Discovery Rate Control in Generalized Linear Models
• Elastic-net Regularized High-dimensional Negative Binomial Regression: Consistency and Weak Signal Detection
• Integrative Factor Regression and Its Inference for Multimodal Data Analysis
• Panel data quantile regression with grouped fixed effects
• Markov Neighborhood Regression for High-Dimensional Inference
• Rejoinder
• Ill-posed estimation in high-dimensional models with instrumental variables
• The costs and benefits of uniformly valid causal inference with high-dimensional nuisance parameters
• Deconfounding and Causal Regularisation for Stability and External Validity
• Covariate-adjusted inference for differential analysis of high-dimensional networks
• Finite sample performance of linear least squares estimation
• Statistical Inference for High-Dimensional Models via Recursive Online-Score Estimation
• Targeted Inference Involving High-Dimensional Data Using Nuisance Penalized Regression
• Variable importance assessments and backward variable selection for multi-sample problems
• Inference for low-rank tensors -- no need to debias
• Testability of high-dimensional linear models with nonsparse structures
• High-dimensional statistical inference via DATE
• On high-dimensional Poisson models with measurement error: hypothesis testing for nonlinear nonconvex optimization
• Testing for inequality constraints in singular models by trimming or winsorizing the variance matrix
• Debiased lasso for generalized linear models with a diverging number of covariates
• Inference of large modified Poisson-type graphical models: application to RNA-seq data in childhood atopic asthma studies
• Recent advances in statistical methodologies in evaluating program for high-dimensional data
• Constructing confidence intervals for the signals in sparse phase retrieval
• High-dimensional sufficient dimension reduction through principal projections
• Doubly robust semiparametric inference using regularized calibrated estimation with high-dimensional data
• The asymptotic distribution of the MLE in high-dimensional logistic models: arbitrary covariance
• Post-model-selection inference in linear regression models: an integrated review
• Estimation of a multiplicative correlation structure in the large dimensional case
• Discussion on ‘A review of distributed statistical inference’
• Synthesizing external aggregated information in the penalized Cox regression under population heterogeneity
• Sparse Topic Modeling: Computational Efficiency, Near-Optimal Algorithms, and Statistical Inference
• Meta-analytic Gaussian network aggregation
• Objective Bayesian edge screening and structure selection for Ising networks
• Thresholding tests based on affine Lasso to achieve non-asymptotic nominal level and high power under sparse and dense alternatives in high dimension

Uses Software

• glasso
• glmnet

This page was built for publication: On asymptotically optimal confidence regions and tests for high-dimensional models

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q95759)