Where to find needles in a haystack?

DOI10.1007/S11749-021-00775-XzbMATH Open1484.62071arXiv1910.02597OpenAlexW3157846903MaRDI QIDQ2125478FDOQ2125478

Zhigen Zhao

Publication date: 14 April 2022

Published in: Test (Search for Journal in Brave)

Abstract: In many existing methods in multiple comparison, one starts with either Fisher's p-values or the local fdr scores. The former one, with a usual definition as the tail probability exceeding the observed test statistic under the null distribution, fails to use the information from the alternative hypothesis and the targeted region of signals could be completely wrong especially when the likelihood ratio function is not monotone. The local fdr based approaches, usually relying on the density functions, are optimal oracally. However, the targeted region of the signals of the data-driven version is problematic because of the slow convergence of the non-parametric density estimation especially on the boundaries. In this paper, we propose a new method: Cdf and Local fdr Assisted multiple Testing method (CLAT), which is optimal for cases when the p-values based method are not. Additionally, the data-driven version only relies on the estimation of the cumulative distribution function and converges to the oracle version quickly. Both simulations and real data analysis demonstrate the superior performance of the proposed method than the existing ones. Furthermore, the computation is instantaneous based on a novel algorithm and is scalable to the large data set.

Full work available at URL: https://arxiv.org/abs/1910.02597

zbMATH Keywords

convergence rateNeyman-Pearson lemmamonotone likelihood ratio

Mathematics Subject Classification ID

Hypothesis testing in multivariate analysis (62H15)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Large-scale multiple testing under dependence
• Oracle and Adaptive Compound Decision Rules for False Discovery Rate Control
• Empirical Bayes Analysis of a Microarray Experiment
• Asymptotic Minimax Character of the Sample Distribution Function and of the Classical Multinomial Estimator
• Microarrays, empirical Bayes and the two-groups model
• Operating Characteristics and Extensions of the False Discovery Rate Procedure
• A new approach to multiple testing of grouped hypotheses
• Capturing the severity of type II errors in high-dimensional multiple testing
• Multiple testing via \(\mathrm{FDR}_L\) for large-scale imaging data
• The Theory of Decision Procedures for Distributions with Monotone Likelihood Ratio
• The optimal power puzzle: scrutiny of the monotone likelihood ratio assumption in multiple testing
• Distributions Possessing a Monotone Likelihood Ratio
• Empirical Bayes Confidence Intervals Shrinking Both Means and Variances

Cited In (1)

• Local false discovery rate based methods for multiple testing of one-way classified hypotheses

This page was built for publication: Where to find needles in a haystack?

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2125478)