High-dimensional inference: confidence intervals, p-values and R-software \texttt{hdi}

DOI10.1214/15-STS527MaRDI QIDQ1790302zbMATHOpenAlexFDO

Authors Ruben Dezeure, Lukas Meier, Nicolai Meinshausen, Peter Bühlmann

Publication date 2 October 2018

Published in Statistical Science (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1408.4026

zbMATH Keywords

clusteringconfidence intervalgeneralized linear modellinear modelmultiple testing\(p\)-valuehigh-dimensional statistical inference

Mathematics Subject Classification ID

Classification and discrimination; cluster analysis (statistical aspects) (62H30) Linear regression; mixed models (62J05) Software, source code, etc. for problems pertaining to statistics (62-04) Parametric tolerance and confidence regions (62F25) Generalized linear models (logistic models) (62J12) Paired and multiple comparisons; multiple testing (62J15)

Abstract: We present a (selective) review of recent frequentist high-dimensional inference methods for constructing $p$-values and confidence intervals in linear and generalized linear models. We include a broad, comparative empirical study which complements the viewpoint from statistical methodology and theory. Furthermore, we introduce and illustrate the R-package hdi which easily allows the use of different methods and supports reproducibility.

Recommendations

• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• Confidence intervals for low dimensional parameters in high dimensional linear models
• On asymptotically optimal confidence regions and tests for high-dimensional models
• Statistical significance in high-dimensional linear models
• Markov Neighborhood Regression for High-Dimensional Inference

Cites work

• scientific article; zbMATH DE number 3945130 (Why is no real title available?)
• scientific article; zbMATH DE number 3567782 (Why is no real title available?)
• scientific article; zbMATH DE number 3579840 (Why is no real title available?)
• scientific article; zbMATH DE number 1493045 (Why is no real title available?)
• scientific article; zbMATH DE number 845714 (Why is no real title available?)
• scientific article; zbMATH DE number 7168272 (Why is no real title available?)
• A Selective Overview of Variable Selection in High Dimensional Feature Space (Invited Review Article)
• A significance test for the lasso
• A study of error variance estimation in Lasso regression
• Asymptotic properties of Lasso+mLS and Lasso+Ridge in sparse high-dimensional linear regression
• Asymptotics for Lasso-type estimators.
• Bagging predictors
• Causation, prediction, and search
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• Confidence intervals for low dimensional parameters in high dimensional linear models
• Controlling the false discovery rate via knockoffs
• Discussion: ``A significance test for the lasso
• Discussion: ``A significance test for the lasso
• Estimation in high-dimensional linear models with deterministic design matrices
• Exact post-selection inference, with application to the Lasso
• False Discovery Rate–Adjusted Multiple Confidence Intervals for Selected Parameters
• Group Bound: Confidence Intervals for Groups of Variables in Sparse High Dimensional Regression Without Assumptions on the Design
• Heuristics of instability and stabilization in model selection
• Hierarchical testing of variable importance
• High-dimensional graphs and variable selection with the Lasso
• High-dimensional inference in misspecified linear models
• High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
• High-dimensional variable screening and bias in subsequent inference, with an empirical comparison
• High-dimensional variable selection
• Latent variable graphical model selection via convex optimization
• Model Selection and Estimation in Regression with Grouped Variables
• Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies?
• Nearly unbiased variable selection under minimax concave penalty
• On asymptotically optimal confidence regions and tests for high-dimensional models
• On the conditions used to prove oracle results for the Lasso
• Rates of convergence of the adaptive LASSO estimators to the oracle distribution and higher order refinements by the bootstrap
• Regularization and Variable Selection Via the Elastic Net
• SLOPE-adaptive variable selection via convex optimization
• Scaled sparse linear regression
• Sparse models and methods for optimal instruments with an application to eminent domain
• Square-root lasso: pivotal recovery of sparse signals via conic programming
• Stability Selection
• Statistical significance in high-dimensional linear models
• Statistics for high-dimensional data. Methods, theory and applications.
• Strong oracle optimality of folded concave penalized estimation
• Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
• THE FINITE-SAMPLE DISTRIBUTION OF POST-MODEL-SELECTION ESTIMATORS AND UNIFORM VERSUS NONUNIFORM APPROXIMATIONS
• The Adaptive Lasso and Its Oracle Properties
• The adaptive and the thresholded Lasso for potentially misspecified models (and a lower bound for the Lasso)
• The control of the false discovery rate in multiple testing under dependency.
• Uniform post-selection inference for least absolute deviation regression and other Z-estimation problems
• Valid post-selection inference
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• Variable Selection with Error Control: Another Look at Stability Selection
• \(p\)-values for high-dimensional regression

Cited in

(69)

• Adaptive step-length selection in gradient boosting for Gaussian location and scale models
• Hierarchical inference for genome-wide association studies: a view on methodology with software
• Identification of outlying observations for large-dimensional data
• Permutation testing in high-dimensional linear models: an empirical investigation
• High-dimensional inference in misspecified linear models
• A bootstrap Lasso+partial ridge method to construct confidence intervals for parameters in high-dimensional sparse linear models
• Group inference in high dimensions with applications to hierarchical testing
• Inference without compatibility: using exponential weighting for inference on a parameter of a linear model
• In defense of the indefensible: a very naïve approach to high-dimensional inference
• Honest Confidence Sets for High-Dimensional Regression by Projection and Shrinkage
• Robust high-dimensional regression for data with anomalous responses
• High-dimensional variable selection via low-dimensional adaptive learning
• Multicarving for high-dimensional post-selection inference
• Estimating global and country-specific excess mortality during the COVID-19 pandemic
• High-dimensional simultaneous inference with the bootstrap
• Variable selection in high-dimensional linear model with possibly asymmetric errors
• Learning causal structure from mixed data with missing values using Gaussian copula models
• Rejoinder on: ``High-dimensional simultaneous inference with the bootstrap
• Targeted Inference Involving High-Dimensional Data Using Nuisance Penalized Regression
• Survival analysis of DNA mutation motifs with penalized proportional hazards
• Double-estimation-friendly inference for high-dimensional misspecified models
• Comments on: ``High-dimensional simultaneous inference with the bootstrap
• High-dimensional regression with potential prior information on variable importance
• Statistical inference via conditional Bayesian posteriors in high-dimensional linear regression
• Online inference in high-dimensional generalized linear models with streaming data
• Nearly optimal Bayesian shrinkage for high-dimensional regression
• Regularized projection score estimation of treatment effects in high-dimensional quantile regression
• Debiasing the Lasso: optimal sample size for Gaussian designs
• Multivariate functional generalized additive models
• Spatially relaxed inference on high-dimensional linear models
• Linear hypothesis testing for high dimensional generalized linear models
• Post-model-selection inference in linear regression models: an integrated review
• Inference for high dimensional linear models with error-in-variables
• High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}
• High-dimensional linear model selection motivated by multiple testing
• Variable selection in discrete survival models including heterogeneity
• An update on statistical boosting in biomedicine
• The benefit of group sparsity in group inference with de-biased scaled group Lasso
• Confidence intervals for parameters in high-dimensional sparse vector autoregression
• scientific article; zbMATH DE number 7370575 (Why is no real title available?)
• Markov Neighborhood Regression for High-Dimensional Inference
• Post hoc confidence bounds on false positives using reference families
• High-dimensional inference for personalized treatment decision
• An integrated panel data approach to modelling economic growth
• Goodness-of-Fit Tests for High Dimensional Linear Models
• False Discovery Rate Control via Data Splitting
• Confidence intervals centred on bootstrap smoothed estimators
• scientific article; zbMATH DE number 7306869 (Why is no real title available?)
• scientific article; zbMATH DE number 7626769 (Why is no real title available?)
• Bootstrapping and sample splitting for high-dimensional, assumption-lean inference
• Deconfounding and Causal Regularisation for Stability and External Validity
• A Critical Review of LASSO and Its Derivatives for Variable Selection Under Dependence Among Covariates
• Variable selection via adaptive false negative control in linear regression
• Composite versus model-averaged quantile regression
• Inference for sparse linear regression based on the leave-one-covariate-out solution path
• Modern approaches for evaluating treatment effect heterogeneity from clinical trials and observational data
• Statistical Inference for High-Dimensional Models via Recursive Online-Score Estimation
• High-dimensional sparse single-index regression via Hilbert-Schmidt independence criterion
• Estimation of covariance and precision matrix, network structure, and a view toward systems biology
• Distributionally robust and generalizable inference
• A bootstrap model comparison test for identifying genes with context-specific patterns of genetic regulation
• Feature-specific inference for penalized regression using local false discovery rates
• Overview of debiased Lasso in high-dimensional linear model
• Knockoffs with side information
• Markov neighborhood regression for statistical inference of high-dimensional generalized linear models
• SuRF: A new method for sparse variable selection, with application in microbiome data analysis
• On the Hauck–Donner Effect in Wald Tests: Detection, Tipping Points, and Parameter Space Characterization
• A three-stage approach to identify biomarker signatures for cancer genetic data with survival endpoints
• Statistical inference and large-scale multiple testing for high-dimensional regression models

Describes a project that uses

Uses Software

• R
• hdi

This page was built for publication: High-dimensional inference: confidence intervals, \(p\)-values and R-software \texttt{hdi}

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1790302)