On the performance of FDR control: constraints and a partial solution
From MaRDI portal
Publication:2456005
DOI10.1214/009053607000000037zbMATH Open1125.62075arXiv0710.3287OpenAlexW3105450569MaRDI QIDQ2456005FDOQ2456005
Authors: Zhiyi Chi 
Publication date: 17 October 2007
Published in: The Annals of Statistics (Search for Journal in Brave)
Abstract: The False Discovery Rate (FDR) paradigm aims to attain certain control on Type I errors with relatively high power for multiple hypothesis testing. The Benjamini--Hochberg (BH) procedure is a well-known FDR controlling procedure. Under a random effects model, we show that, in general, unlike the FDR, the positive FDR (pFDR) of the BH procedure cannot be controlled at an arbitrarily low level due to the limited evidence provided by the observations to separate false and true nulls. This results in a criticality phenomenon, which is characterized by a transition of the procedure's power from being positive to asymptotically 0 without any reduction in the pFDR, once the target FDR control level is below a positive critical value. To address the constraints on the power and pFDR control imposed by the criticality phenomenon, we propose a procedure which applies BH-type procedures at multiple locations in the domain of -values. Both analysis and simulations show that the proposed procedure can attain substantially improved power and pFDR control.
Full work available at URL: https://arxiv.org/abs/0710.3287
Recommendations
- FDR control with adaptive procedures and FDR monotonicity
- A clarifying comparison of methods for controlling the false discovery rate
- A powerful FDR control procedure for multiple hypotheses
- Positive false discovery proportions: intrinsic bounds and adaptive control
- On control of the false discovery rate under no assumption of dependency
Nonparametric hypothesis testing (62G10) Hypothesis testing in multivariate analysis (62H15) Signal detection and filtering (aspects of stochastic processes) (60G35) Paired and multiple comparisons; multiple testing (62J15)
Cites Work
- Title not available (Why is that?)
- An improved Bonferroni procedure for multiple tests of significance
- Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses
- Resampling-based false discovery rate controlling multiple test procedures for correlated test statistics.
- Higher criticism for detecting sparse heterogeneous mixtures.
- A stochastic process approach to false discovery control.
- Adapting to unknown sparsity by controlling the false discovery rate
- A Direct Approach to False Discovery Rates
- Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach
- Empirical Bayes Analysis of a Microarray Experiment
- Title not available (Why is that?)
- The positive false discovery rate: A Bayesian interpretation and the \(q\)-value
- Operating Characteristics and Extensions of the False Discovery Rate Procedure
- Multiple hypotheses testing and expected number of type I errors
- Sample size and positive false discovery rate control for multiple testing
- False discovery and false nondiscovery rates in single-step multiple testing procedures
Cited In (20)
- A scan procedure for multiple testing: beyond threshold-type procedures
- Powerful multiple testing of paired null hypotheses using a latent graph model
- Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
- FDR- and FWE-controlling methods using data-driven weights
- Data Volume and Power of Multiple Tests with Small Sample Size Per Null
- Asymptotic properties of false discovery rate controlling procedures under independence
- Exact calculations for false discovery proportion with application to least favorable configura\-tions
- A central limit theorem for the Benjamini-Hochberg false discovery proportion under a factor model
- Robust high-dimensional tuning free multiple testing
- On false discovery rate thresholding for classification under sparsity
- A scoring criterion for rejection of clustered \(p\)-values
- New procedures controlling the false discovery proportion via Romano-Wolf's heuristic
- Simultaneous critical values for \(t\)-tests in very high dimensions
- Strong consistency and asymptotic normality for quantities related to the Benjamini-Hochberg false discovery rate procedure
- A double application of the Benjamini-Hochberg procedure for testing batched hypotheses
- Adaptive \(p\)-value weighting with power optimality
- False discovery rate control with multivariate \(p\)-values
- Some optimality properties of FDR controlling rules under sparsity
- Farmtest: factor-adjusted robust multiple testing with approximate false discovery control
- On the false discovery rate and an asymptotically optimal rejection curve
Uses Software
This page was built for publication: On the performance of FDR control: constraints and a partial solution
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2456005)
