Detection boundary in sparse regression
From MaRDI portal
Abstract: We study the problem of detection of a p-dimensional sparse vector of parameters in the linear regression model with Gaussian noise. We establish the detection boundary, i.e., the necessary and sufficient conditions for the possibility of successful detection as both the sample size n and the dimension p tend to the infinity. Testing procedures that achieve this boundary are also exhibited. Our results encompass the high-dimensional setting (p>> n). The main message is that, under some conditions, the detection boundary phenomenon that has been proved for the Gaussian sequence model, extends to high-dimensional linear regression. Finally, we establish the detection boundaries when the variance of the noise is unknown. Interestingly, the detection boundaries sometimes depend on the knowledge of the variance in a high-dimensional setting.
Recommendations
- Detection boundary for a sparse gamma scale mixture model
- Detection thresholds in very sparse matrix completion
- Statistical and computational limits for sparse matrix detection
- Statistical limits of sparse mixture detection
- scientific article; zbMATH DE number 7759288
- Detection of sparse positive dependence
- Detection of a sparse variable function
- Detection and feature selection in sparse mixture models
- Marginalized Lasso in sparse regression
- Detection Tests Using Sparse Models, With Application to Hyperspectral Data
Cites work
- Adaptive detection of a signal of growing dimension. I
- Adaptive detection of a signal of growing dimension. II
- Classification of sparse high-dimensional vectors
- Compressed sensing
- Detecting a target in very noisy data from mutliple looks
- Detection of a signal of known shape in a multichannel system
- Distilled Sensing: Adaptive Sampling for Sparse Detection and Estimation
- Estimation and confidence sets for sparse normal mixtures
- Feature selection by higher criticism thresholding achieves the optimal phase diagram
- Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
- Goodness-of-fit tests for high-dimensional Gaussian linear models
- Goodness-of-fit tests via phi-divergences
- Higher criticism for detecting sparse heterogeneous mixtures.
- Higher criticism thresholding: Optimal feature selection when useful features are rare and weak
- scientific article; zbMATH DE number 5604036 (Why is no real title available?)
- scientific article; zbMATH DE number 3896009 (Why is no real title available?)
- scientific article; zbMATH DE number 741240 (Why is no real title available?)
- scientific article; zbMATH DE number 796428 (Why is no real title available?)
- Information-Theoretic Limits on Sparsity Recovery in the High-Dimensional and Noisy Setting
- Innovated higher criticism for detecting sparse signals in correlated noise
- Local operator theory, random matrices and Banach spaces.
- Minimax risks for sparse regressions: ultra-high dimensional phenomenons
- Nonparametric goodness-of-fit testing under Gaussian models
- Sharp Thresholds for High-Dimensional and Noisy Sparsity Recovery Using $\ell _{1}$-Constrained Quadratic Programming (Lasso)
- Simultaneous analysis of Lasso and Dantzig selector
- Some problems of hypothesis testing leading to infinitely divisible distributions
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
Cited in
(69)- Higher criticism for discriminating word-frequency tables and authorship attribution
- Sparse sliced inverse regression via Lasso
- Significance testing in non-sparse high-dimensional linear models
- Hypothesis testing for high-dimensional multinomials: a selective review
- Powerful test based on conditional effects for genome-wide screening
- Detection thresholds for the \(\beta\)-model on sparse graphs
- Change detection via affine and quadratic detectors
- Detectability of nonparametric signals: higher criticism versus likelihood ratio
- Combinatorial inference for graphical models
- Adaptive estimation of the sparsity in the Gaussian vector model
- Adaptive estimation of high-dimensional signal-to-noise ratios
- A novel detection scheme with multiple observations for sparse signal based on likelihood ratio test with sparse estimation
- Global testing against sparse alternatives under Ising models
- Optimality and sub-optimality of PCA. I: Spiked random matrix models
- Minimax risks for sparse regressions: ultra-high dimensional phenomenons
- Detecting a vector based on linear measurements
- Detection of sparse additive functions
- Optimal sparsity testing in linear regression model
- A Bayesian-motivated test for high-dimensional linear regression models with fixed design matrix
- Optimal adaptivity of signed-polygon statistics for network testing
- Testing degree corrections in stochastic block models
- The all-or-nothing phenomenon in sparse linear regression
- Two-sample testing of high-dimensional linear regression coefficients via complementary sketching
- High-dimensional asymptotics of likelihood ratio tests in the Gaussian sequence model under convex constraints
- Testability of high-dimensional linear models with nonsparse structures
- Thresholding tests based on affine Lasso to achieve non-asymptotic nominal level and high power under sparse and dense alternatives in high dimension
- Higher criticism to compare two large frequency tables, with sensitivity to possible rare and weak differences
- Minimax rate of testing in sparse linear regression
- TFisher: a powerful truncation and weighting procedure for combining \(p\)-values
- Fundamental limits of exact support recovery in high dimensions
- Adaptive confidence sets in shape restricted regression
- Optimal testing for planted satisfiability problems
- A global homogeneity test for high-dimensional linear regression
- Hypothesis testing for densities and high-dimensional multinomials: sharp local minimax rates
- Signal detection via Phi-divergences for general mixtures
- Hypothesis testing for high-dimensional sparse binary regression
- Distribution-free tests for sparse heterogeneous mixtures
- Bump detection in heterogeneous Gaussian regression
- Accuracy assessment for high-dimensional linear regression
- Confidence sets in sparse regression
- Community detection in dense random networks
- Higher criticism for large-scale inference, especially for rare and weak effects
- Estimation of the \(\ell_2\)-norm and testing in sparse linear regression with unknown variance
- Most powerful test against a sequence of high dimensional local alternatives
- Model selection for classification with a large number of classes
- Global testing against sparse alternatives in time-frequency analysis
- Statistical significance in high-dimensional linear models
- Optimal detection of sparse principal components in high dimension
- Detection boundary and higher criticism approach for rare and weak genetic effects
- Adaptive global testing for functional linear models
- Global and Simultaneous Hypothesis Testing for High-Dimensional Logistic Regression Models
- High-dimensional regression with unknown variance
- Comments on: ``High-dimensional simultaneous inference with the bootstrap
- Honest Confidence Sets for High-Dimensional Regression by Projection and Shrinkage
- Moderate-Dimensional Inferences on Quadratic Functionals in Ordinary Least Squares
- A tuning-free efficient test for marginal linear effects in high-dimensional quantile regression
- Sparse signal detection in heteroscedastic Gaussian sequence models: sharp minimax rates
- Off-the-grid prediction and testing for linear combination of translated features
- Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
- Group inference in high dimensions with applications to hierarchical testing
- Sharp multiple testing boundary for sparse sequences
- Locally sharp goodness-of-fit testing in sup norm for high-dimensional counts
- On adaptive confidence ellipsoids for sparse high-dimensional linear models
- Sparse anomaly detection across referentials: a rank-based higher criticism approach
- Unification of rare and weak multiple testing models using moderate deviations analysis and log-chisquared P-values
- Can we spot a fake?
- Heritability estimation in high dimensional sparse linear mixed models
- On signal detection and confidence sets for low rank inference problems
- To the memory of Yu. I. Ingster
This page was built for publication: Detection boundary in sparse regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1952112)
