Distribution-free tests for sparse heterogeneous mixtures
From MaRDI portal
Publication:2398079
Abstract: We consider the problem of detecting sparse heterogeneous mixtures from a nonparametric perspective, and develop distribution-free tests when all effects have the same sign. Specifically, we assume that the null distribution is symmetric about zero, while the true effects have positive median. We evaluate the precise performance of classical tests for the median (t-test, sign test) and classical tests for symmetry (signed-rank, Smirnov, total number of runs, longest run tests) showing that none of them is asymptotically optimal for the normal mixture model in all sparsity regimes. We then suggest two new tests. The main one is a form of Higher Criticism, or Anderson-Darling, test for symmetry. It is shown to be asymptotically optimal for the normal mixture model, and other generalized Gaussian mixture models, in all sparsity regimes. Our numerical experiments confirm our theoretical findings.
Recommendations
- Higher criticism for detecting sparse heterogeneous mixtures.
- Optimal detection of heterogeneous and heteroscedastic mixtures
- Detection of sparse mixtures: higher criticism and scan statistic
- The sparse variance contamination model
- Non-asymptotic detection of two-component mixtures with unknown means
Cites work
- scientific article; zbMATH DE number 3951797 (Why is no real title available?)
- A limit theorem for the maximum of normalized sums of independent random variables
- Adaptive detection of a signal of growing dimension. I
- Adaptive detection of a signal of growing dimension. II
- Asymptotic Theory of Certain "Goodness of Fit" Criteria Based on Stochastic Processes
- Detection boundary in sparse regression
- Distribution-free tests for sparse heterogeneous mixtures
- Global testing under sparse alternatives: ANOVA, multiple comparisons and the higher criticism
- Goodness-of-fit tests via phi-divergences
- Higher criticism for detecting sparse heterogeneous mixtures.
- Innovated higher criticism for detecting sparse signals in correlated noise
- Multiple testing procedures with applications to genomics.
- Optimal Detection of Sparse Mixtures Against a Given Null Distribution
- Optimal detection of heterogeneous and heteroscedastic mixtures
- Properties of higher criticism under strong dependence
- Robustness and accuracy of methods for high dimensional data analysis based on Student's \(t\)-statistic
- Some problems of hypothesis testing leading to infinitely divisible distributions
- TESTING SYMMETRY USING A TRIMMED LONGEST RUN STATISTIC
- Testing Statistical Hypotheses
Cited in
(24)- The impossibility region for detecting sparse mixtures using the higher criticism
- AdaReg: data adaptive robust estimation in linear regression with application in GTEx gene expressions
- Anomaly Detection for a Large Number of Streams: A Permutation-Based Higher Criticism Approach
- Testing independent sparse heterogeneous mixtures
- Signal detection via Phi-divergences for general mixtures
- Supplementary score test for sparse signals in large-scale truncated one-sided sequential tests
- Optimal detection of multi-sample aligned sparse signals
- Signal-noise ratio of genetic associations and statistical power of SNP-set tests
- Detecting sparse heterogeneous mixtures in a two-sample problem
- Higher criticism for detecting sparse heterogeneous mixtures.
- Higher criticism for large-scale inference, especially for rare and weak effects
- Consistency of the generalized likelihood ratio test for heteroscedastic normal mixtures
- \(L_2\)-tests for sparse multinomials
- Detectability of nonparametric signals: higher criticism versus likelihood ratio
- Detection of sparse mixtures: higher criticism and scan statistic
- Optimal Detection of Sparse Mixtures Against a Given Null Distribution
- Optimal detection of heterogeneous and heteroscedastic mixtures
- Optimal detection of weak positive latent dependence between two sequences of multiple tests
- Distribution-free tests for sparse heterogeneous mixtures
- Detection boundary for a sparse gamma scale mixture model
- Beyond HC: more sensitive tests for rare/weak alternatives
- Detection of sparse positive dependence
- The sparse Poisson means model
- Detection and feature selection in sparse mixture models
This page was built for publication: Distribution-free tests for sparse heterogeneous mixtures
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2398079)
