Data Volume and Power of Multiple Tests with Small Sample Size Per Null
From MaRDI portal
Publication:3645006
Abstract: In multiple hypothesis testing, the volume of data, defined as the number of replications per null times the total number of nulls, usually defines the amount of resource required. On the other hand, power is an important measure of performance for multiple testing. Due to practical constraints, the number of replications per null may not be large enough in terms of the difference between false and true nulls. For the case where the population fraction of false nulls is constant, we show that, as the difference between false and true nulls becomes increasingly subtle while the number of replications per null cannot increase fast enough, (1) in order to have enough chance that the data to be collected will yield some trustworthy findings, as measured by a conditional version of the positive false discovery rate (pFDR), the volume of data has to grow at a rate much faster than in the case where the number of replications per null can be large enough, and (2) in order to control the pFDR asymptotically, power has to decay to 0 in a rate highly sensitive to rejection criterion and there is no asymptotically most powerful procedures among those that control the pFDR asymptotically at the same level.
Recommendations
- Sample size and positive false discovery rate control for multiple testing
- Power-enhanced multiple decision functions controlling family-wise error and false discovery rates
- Size, power and false discovery rates
- scientific article; zbMATH DE number 720689
- The optimal power puzzle: scrutiny of the monotone likelihood ratio assumption in multiple testing
Cites work
- scientific article; zbMATH DE number 1158743 (Why is no real title available?)
- Convergence of stochastic processes
- Empirical Bayes Analysis of a Microarray Experiment
- False discovery rate control with multivariate \(p\)-values
- Higher criticism for detecting sparse heterogeneous mixtures.
- Large deviations of sums of independent random variables
- On the performance of FDR control: constraints and a partial solution
- Operating Characteristics and Extensions of the False Discovery Rate Procedure
- Sample size and positive false discovery rate control for multiple testing
- Size, power and false discovery rates
- The positive false discovery rate: A Bayesian interpretation and the \(q\)-value
Cited in
(2)
This page was built for publication: Data Volume and Power of Multiple Tests with Small Sample Size Per Null
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3645006)
