Detection boundary in sparse regression
From MaRDI portal
Abstract: We study the problem of detection of a p-dimensional sparse vector of parameters in the linear regression model with Gaussian noise. We establish the detection boundary, i.e., the necessary and sufficient conditions for the possibility of successful detection as both the sample size n and the dimension p tend to the infinity. Testing procedures that achieve this boundary are also exhibited. Our results encompass the high-dimensional setting (p>> n). The main message is that, under some conditions, the detection boundary phenomenon that has been proved for the Gaussian sequence model, extends to high-dimensional linear regression. Finally, we establish the detection boundaries when the variance of the noise is unknown. Interestingly, the detection boundaries sometimes depend on the knowledge of the variance in a high-dimensional setting.
Recommendations
- Detection boundary for a sparse gamma scale mixture model
- Detection thresholds in very sparse matrix completion
- Statistical and computational limits for sparse matrix detection
- Statistical limits of sparse mixture detection
- scientific article; zbMATH DE number 7759288
- Detection of sparse positive dependence
- Detection of a sparse variable function
- Detection and feature selection in sparse mixture models
- Marginalized Lasso in sparse regression
- Detection Tests Using Sparse Models, With Application to Hyperspectral Data
Cites work
- scientific article; zbMATH DE number 5604036 (Why is no real title available?)
- scientific article; zbMATH DE number 3896009 (Why is no real title available?)
- scientific article; zbMATH DE number 741240 (Why is no real title available?)
- scientific article; zbMATH DE number 796428 (Why is no real title available?)
- Adaptive detection of a signal of growing dimension. I
- Adaptive detection of a signal of growing dimension. II
- Classification of sparse high-dimensional vectors
- Compressed sensing
- Detecting a target in very noisy data from mutliple looks
- Detection of a signal of known shape in a multichannel system
- Distilled Sensing: Adaptive Sampling for Sparse Detection and Estimation
- Estimation and confidence sets for sparse normal mixtures
- Feature selection by higher criticism thresholding achieves the optimal phase diagram
- Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
- Goodness-of-fit tests for high-dimensional Gaussian linear models
- Goodness-of-fit tests via phi-divergences
- Higher criticism for detecting sparse heterogeneous mixtures.
- Higher criticism thresholding: Optimal feature selection when useful features are rare and weak
- Information-Theoretic Limits on Sparsity Recovery in the High-Dimensional and Noisy Setting
- Innovated higher criticism for detecting sparse signals in correlated noise
- Local operator theory, random matrices and Banach spaces.
- Minimax risks for sparse regressions: ultra-high dimensional phenomenons
- Nonparametric goodness-of-fit testing under Gaussian models
- Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$-Constrained Quadratic Programming (Lasso)
- Simultaneous analysis of Lasso and Dantzig selector
- Some problems of hypothesis testing leading to infinitely divisible distributions
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
Cited in
(68)- On signal detection and confidence sets for low rank inference problems
- Adaptive estimation of high-dimensional signal-to-noise ratios
- High-dimensional regression with unknown variance
- Detection boundary and higher criticism approach for rare and weak genetic effects
- Two-sample testing of high-dimensional linear regression coefficients via complementary sketching
- Bump detection in heterogeneous Gaussian regression
- A tuning-free efficient test for marginal linear effects in high-dimensional quantile regression
- Accuracy assessment for high-dimensional linear regression
- Combinatorial inference for graphical models
- A global homogeneity test for high-dimensional linear regression
- Sparse signal detection in heteroscedastic Gaussian sequence models: sharp minimax rates
- Sparse anomaly detection across referentials: a rank-based higher criticism approach
- Hypothesis testing for high-dimensional multinomials: a selective review
- Model selection for classification with a large number of classes
- High-dimensional asymptotics of likelihood ratio tests in the Gaussian sequence model under convex constraints
- Powerful test based on conditional effects for genome-wide screening
- Adaptive global testing for functional linear models
- Optimal testing for planted satisfiability problems
- Confidence sets in sparse regression
- Optimal adaptivity of signed-polygon statistics for network testing
- Sparse sliced inverse regression via Lasso
- Unification of rare and weak multiple testing models using moderate deviations analysis and log-chisquared P-values
- Optimal sparsity testing in linear regression model
- Higher criticism to compare two large frequency tables, with sensitivity to possible rare and weak differences
- Testability of high-dimensional linear models with nonsparse structures
- Hypothesis testing for densities and high-dimensional multinomials: sharp local minimax rates
- Minimax rate of testing in sparse linear regression
- Testing degree corrections in stochastic block models
- Hypothesis testing for high-dimensional sparse binary regression
- Off-the-grid prediction and testing for linear combination of translated features
- Global testing against sparse alternatives in time-frequency analysis
- Locally sharp goodness-of-fit testing in sup norm for high-dimensional counts
- Community detection in dense random networks
- Detection of sparse additive functions
- Minimax risks for sparse regressions: ultra-high dimensional phenomenons
- Thresholding tests based on affine Lasso to achieve non-asymptotic nominal level and high power under sparse and dense alternatives in high dimension
- Adaptive confidence sets in shape restricted regression
- Signal detection via Phi-divergences for general mixtures
- Fundamental limits of exact support recovery in high dimensions
- Detection thresholds for the \(\beta\)-model on sparse graphs
- Sharp multiple testing boundary for sparse sequences
- Distribution-free tests for sparse heterogeneous mixtures
- A novel detection scheme with multiple observations for sparse signal based on likelihood ratio test with sparse estimation
- To the memory of Yu. I. Ingster
- On adaptive confidence ellipsoids for sparse high-dimensional linear models
- Group inference in high dimensions with applications to hierarchical testing
- Global testing against sparse alternatives under Ising models
- Estimation of the \(\ell_2\)-norm and testing in sparse linear regression with unknown variance
- Change detection via affine and quadratic detectors
- Moderate-Dimensional Inferences on Quadratic Functionals in Ordinary Least Squares
- TFisher: a powerful truncation and weighting procedure for combining \(p\)-values
- A Bayesian-motivated test for high-dimensional linear regression models with fixed design matrix
- Honest Confidence Sets for High-Dimensional Regression by Projection and Shrinkage
- Statistical significance in high-dimensional linear models
- Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
- Detecting a vector based on linear measurements
- Heritability estimation in high dimensional sparse linear mixed models
- Higher criticism for discriminating word-frequency tables and authorship attribution
- Comments on: ``High-dimensional simultaneous inference with the bootstrap
- Higher criticism for large-scale inference, especially for rare and weak effects
- The all-or-nothing phenomenon in sparse linear regression
- Optimal detection of sparse principal components in high dimension
- Significance testing in non-sparse high-dimensional linear models
- Global and Simultaneous Hypothesis Testing for High-Dimensional Logistic Regression Models
- Most powerful test against a sequence of high dimensional local alternatives
- Detectability of nonparametric signals: higher criticism versus likelihood ratio
- Adaptive estimation of the sparsity in the Gaussian vector model
- Optimality and sub-optimality of PCA. I: Spiked random matrix models
This page was built for publication: Detection boundary in sparse regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1952112)
