The sparse Poisson means model

DOI10.1214/15-EJS1066zbMATH Open1337.62088arXiv1505.01247OpenAlexW2963153079MaRDI QIDQ887263FDOQ887263

Authors: Ery Arias-Castro, Meng Wang 

Publication date: 28 October 2015

Published in: Electronic Journal of Statistics (Search for Journal in Brave)

Abstract: We consider the problem of detecting a sparse Poisson mixture. Our results parallel those for the detection of a sparse normal mixture, pioneered by Ingster (1997) and Donoho and Jin (2004), when the Poisson means are larger than logarithmic in the sample size. In particular, a form of higher criticism achieves the detection boundary in the whole sparse regime. When the Poisson means are smaller than logarithmic in the sample size, a different regime arises in which simple multiple testing with Bonferroni correction is enough in the sparse regime. We present some numerical experiments that confirm our theoretical findings.

Full work available at URL: https://arxiv.org/abs/1505.01247

Recommendations

• Detection of sparse mixtures: higher criticism and scan statistic
• Higher criticism for detecting sparse heterogeneous mixtures.
• Detection of sparse positive dependence
• Distribution-free tests for sparse heterogeneous mixtures
• Optimal detection of multi-sample aligned sparse signals

zbMATH Keywords

multiple testinggoodness-of-fit testsPearson's chi-squared testBonferroni's methodFisher's methodsparse normal means modelsparse Poisson means modelTukey's higher criticism

Mathematics Subject Classification ID

Nonparametric hypothesis testing (62G10) Asymptotic properties of nonparametric inference (62G20) Point processes (e.g., Poisson, Cox, Hawkes processes) (60G55) Paired and multiple comparisons; multiple testing (62J15)

Cites Work

• Testing Statistical Hypotheses
• Some problems of hypothesis testing leading to infinitely divisible distributions
• Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses
• Higher criticism for detecting sparse heterogeneous mixtures.
• Asymptotic theory of statistics and probability
• Hypothesis testing for high-dimensional sparse binary regression
• Optimal detection of heterogeneous and heteroscedastic mixtures
• Title not available (Why is that?)
• Detection of a sparse submatrix of a high-dimensional noisy matrix
• Distribution-free tests for sparse heterogeneous mixtures
• Title not available (Why is that?)
• Central limit theorems for multinomial sums
• Asymptotic normality and efficiency for certain goodness-of-fit tests

Cited In (15)

• The sparse variance contamination model
• Estimation and confidence sets for sparse normal mixtures
• Higher criticism to compare two large frequency tables, with sensitivity to possible rare and weak differences
• Testing degree corrections in stochastic block models
• Signal detection via Phi-divergences for general mixtures
• Detection thresholds for the \(\beta\)-model on sparse graphs
• The impossibility region for detecting sparse mixtures using the higher criticism
• Estimating linear functionals of a sparse family of Poisson means
• Detection boundary for a sparse gamma scale mixture model
• Global testing against sparse alternatives under Ising models
• Higher criticism for discriminating word-frequency tables and authorship attribution
• Optimal detection of multi-sample aligned sparse signals
• Detectability of nonparametric signals: higher criticism versus likelihood ratio
• Detection of sparse mixtures: higher criticism and scan statistic
• Statistical limits of sparse mixture detection

This page was built for publication: The sparse Poisson means model

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q887263)