Detection of sparse positive dependence
From MaRDI portal
Publication:2293723
Abstract: In a bivariate setting, we consider the problem of detecting a sparse contamination or mixture component, where the effect manifests itself as a positive dependence between the variables, which are otherwise independent in the main component. We first look at this problem in the context of a normal mixture model. In essence, the situation reduces to a univariate setting where the effect is a decrease in variance. In particular, a higher criticism test based on the pairwise differences is shown to achieve the detection boundary defined by the (oracle) likelihood ratio test. We then turn to a Gaussian copula model where the marginal distributions are unknown. Standard invariance considerations lead us to consider rank tests. In fact, a higher criticism test based on the pairwise rank differences achieves the detection boundary in the normal mixture model, although not in the very sparse regime. We do not know of any rank test that has any power in that regime.
Recommendations
Cites work
- A Combinatorial Central Limit Theorem
- Assessing replicability of findings across two studies of multiple features
- Asymptotic theory of statistics and probability
- Distribution-free tests for sparse heterogeneous mixtures
- Higher criticism for detecting sparse heterogeneous mixtures.
- Higher criticism for large-scale inference, especially for rare and weak effects
- Higher criticism thresholding: Optimal feature selection when useful features are rare and weak
- scientific article; zbMATH DE number 2119079 (Why is no real title available?)
- Innovated higher criticism for detecting sparse signals in correlated noise
- Measuring reproducibility of high-throughput experiments
- On the exact Berk-Jones statistics and their p-value calculation
- Optimal detection of heterogeneous and heteroscedastic mixtures
- Optimal Detection of Sparse Mixtures Against a Given Null Distribution
- Optimal detection of weak positive latent dependence between two sequences of multiple tests
- Poisson approximation and the Chen-Stein method. With comments and a rejoinder by the authors
- Some problems of hypothesis testing leading to infinitely divisible distributions
- Stein's method for concentration inequalities
- Testing Statistical Hypotheses
- The sparse variance contamination model
Cited in
(12)- Detection and feature selection in sparse mixture models
- Detection boundary in sparse regression
- Testing equivalence of clustering
- Optimal detection of weak positive latent dependence between two sequences of multiple tests
- Positive Dependence of Signals
- The sparse variance contamination model
- Fast calculation of p-values for one-sided Kolmogorov-Smirnov type statistics
- Signal-noise ratio of genetic associations and statistical power of SNP-set tests
- Exact detection thresholds and minimax optimality of Chatterjee's correlation coefficient
- Sparse anomaly detection across referentials: a rank-based higher criticism approach
- Unification of rare and weak multiple testing models using moderate deviations analysis and log-chisquared P-values
- The sparse Poisson means model
This page was built for publication: Detection of sparse positive dependence
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2293723)
