Detection boundary in sparse regression

DOI10.1214/10-EJS589zbMath1329.62314arXiv1009.1706MaRDI QIDQ1952112

Nicolas Verzelen, Alexandre B. Tsybakov, Yuri I. Ingster

Publication date: 27 May 2013

Published in: Electronic Journal of Statistics (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1009.1706

zbMATH Keywords

sparsityhigh-dimensional regressionminimax hypothesis testingdetection boundarysparse vectors

Mathematics Subject Classification ID

Nonparametric hypothesis testing (62G10) Asymptotic properties of nonparametric inference (62G20) Linear regression; mixed models (62J05) Nonparametric estimation (62G05) Minimax procedures in statistical decision theory (62C20)

Related Items

High-dimensional asymptotics of likelihood ratio tests in the Gaussian sequence model under convex constraints, Significance testing in non-sparse high-dimensional linear models, Hypothesis testing for high-dimensional multinomials: a selective review, Testability of high-dimensional linear models with nonsparse structures, Global testing against sparse alternatives in time-frequency analysis, Thresholding tests based on affine Lasso to achieve non-asymptotic nominal level and high power under sparse and dense alternatives in high dimension, Higher criticism to compare two large frequency tables, with sensitivity to possible rare and weak differences, Powerful test based on conditional effects for genome-wide screening, Detection thresholds for the \(\beta\)-model on sparse graphs, Distribution-free tests for sparse heterogeneous mixtures, Minimax rate of testing in sparse linear regression, Statistical significance in high-dimensional linear models, TFisher: a powerful truncation and weighting procedure for combining \(p\)-values, Optimal detection of sparse principal components in high dimension, Accuracy assessment for high-dimensional linear regression, Heritability estimation in high dimensional sparse linear mixed models, Detection boundary and higher criticism approach for rare and weak genetic effects, Estimation of the \(\ell_2\)-norm and testing in sparse linear regression with unknown variance, Change detection via affine and quadratic detectors, Honest Confidence Sets for High-Dimensional Regression by Projection and Shrinkage, A tuning-free efficient test for marginal linear effects in high-dimensional quantile regression, On signal detection and confidence sets for low rank inference problems, To the memory of Yu. I. Ingster, Minimax risks for sparse regressions: ultra-high dimensional phenomenons, Detecting a vector based on linear measurements, Detection of sparse additive functions, Most powerful test against a sequence of high dimensional local alternatives, Detectability of nonparametric signals: higher criticism versus likelihood ratio, Confidence sets in sparse regression, Adaptive confidence sets in shape restricted regression, Moderate-Dimensional Inferences on Quadratic Functionals in Ordinary Least Squares, Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism, Combinatorial inference for graphical models, Adaptive estimation of the sparsity in the Gaussian vector model, Adaptive estimation of high-dimensional signal-to-noise ratios, Group Inference in High Dimensions with Applications to Hierarchical Testing, Optimal testing for planted satisfiability problems, A global homogeneity test for high-dimensional linear regression, Model Selection for Classification with a Large Number of Classes, Community detection in dense random networks, A novel detection scheme with multiple observations for sparse signal based on likelihood ratio test with sparse estimation, Optimal sparsity testing in linear regression model, Higher Criticism for Discriminating Word-Frequency Tables and Testing Authorship, Global testing against sparse alternatives under Ising models, Optimality and sub-optimality of PCA. I: Spiked random matrix models, Sparse Sliced Inverse Regression Via Lasso, Adaptive Global Testing for Functional Linear Models, A Bayesian-motivated test for high-dimensional linear regression models with fixed design matrix, Hypothesis testing for densities and high-dimensional multinomials: sharp local minimax rates, Optimal adaptivity of signed-polygon statistics for network testing, Testing degree corrections in stochastic block models, Signal detection via Phi-divergences for general mixtures, The all-or-nothing phenomenon in sparse linear regression, Global and Simultaneous Hypothesis Testing for High-Dimensional Logistic Regression Models, Comments on: ``High-dimensional simultaneous inference with the bootstrap, Hypothesis testing for high-dimensional sparse binary regression, Two-sample testing of high-dimensional linear regression coefficients via complementary sketching, Higher criticism for large-scale inference, especially for rare and weak effects

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Innovated higher criticism for detecting sparse signals in correlated noise
• Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
• Some problems of hypothesis testing leading to infinitely divisible distributions
• Nonparametric goodness-of-fit testing under Gaussian models
• Adaptive detection of a signal of growing dimension. I
• Adaptive detection of a signal of growing dimension. II
• Higher criticism for detecting sparse heterogeneous mixtures.
• Minimax risks for sparse regressions: ultra-high dimensional phenomenons
• Goodness-of-fit tests for high-dimensional Gaussian linear models
• Simultaneous analysis of Lasso and Dantzig selector
• Goodness-of-fit tests via phi-divergences
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• Estimation and confidence sets for sparse normal mixtures
• Detection of a signal of known shape in a multichannel system
• Higher criticism thresholding: Optimal feature selection when useful features are rare and weak
• Classification of sparse high-dimensional vectors
• Feature selection by higher criticism thresholding achieves the optimal phase diagram
• Information-Theoretic Limits on Sparsity Recovery in the High-Dimensional and Noisy Setting
• Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$-Constrained Quadratic Programming (Lasso)
• Distilled Sensing: Adaptive Sampling for Sparse Detection and Estimation
• Compressed sensing