Controlling the false discovery exceedance for heterogeneous tests
From MaRDI portal
Abstract: Several classical methods exist for controlling the false discovery exceedance (FDX) for large scale multiple testing problems, among them the Lehmann-Romano procedure ([LR] below) and the Guo-Romano procedure ([GR] below). While these two procedures are the most prominent, they were originally designed for homogeneous test statistics, that is, when the null distribution functions of the -values , , are all equal. In many applications, however, the data are heterogeneous which leads to heterogeneous null distribution functions. Ignoring this heterogeneity usually induces a conservativeness for the aforementioned procedures. In this paper, we develop three new procedures that incorporate the 's, while ensuring the FDX control. The heterogeneous version of [LR], denoted [HLR], is based on the arithmetic average of the 's, while the heterogeneous version of [GR], denoted [HGR], is based on the geometric average of the 's. We also introduce a procedure [PB], that is based on the Poisson-binomial distribution and that uniformly improves [HLR] and [HGR], at the price of a higher computational complexity. Perhaps surprisingly, this shows that, contrary to the known theory of false discovery rate (FDR) control under heterogeneity, the way to incorporate the 's can be particularly simple in the case of FDX control, and does not require any further correction term. The performances of the new proposed procedures are illustrated by real and simulated data in two important heterogeneous settings: first, when the test statistics are continuous but the -values are weighted by some known independent weight vector, e.g., coming from co-data sets; second, when the test statistics are discretely distributed, as is the case for data representing frequencies or counts.
Recommendations
Cites work
- A Generalized Sidak-Holm Procedure and Control of Generalized Error Rates under Independence
- A Method to Increase the Power of Multiple Testing Procedures Through Sample Splitting
- A Modified Bonferroni Method for Discrete Data
- A Modified False Discovery Rate Multiple-Comparisons Procedure for Discrete Data, Applied to Human Immunodeficiency Virus Genetics
- A stochastic process approach to false discovery control.
- A unified treatment of multiple testing with prior knowledge using the p-filter
- A weighted FDR procedure under discrete and heterogeneous null distributions
- Adaptive \(p\)-value weighting with power optimality
- Asymptotic properties of false discovery rate controlling procedures under independence
- Control of generalized error rates in multiple testing
- Controlling the number of false discoveries: application to high-dimensional genomic data
- Exact calculations for false discovery proportion with application to least favorable configura\-tions
- Exceedance Control of the False Discovery Proportion
- False Discovery Control for Random Fields
- False discovery control with p-value weighting
- False discovery rate control with groups
- Further results on controlling the false discovery proportion
- Generalizations of the familywise error rate
- Genome-wide significance levels and weighted hypothesis testing
- How to analyze many contingency tables simultaneously in genetic association studies
- scientific article; zbMATH DE number 3624650 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- Multiple test functions and adjusted \(p\)-values for test statistics with discrete distributions
- Multiple testing for exploratory research
- Multiple testing with discrete data: proportion of true null hypotheses and two adaptive FDR procedures
- New FDR bounds for discrete and heterogeneous tests
- New procedures controlling the false discovery proportion via Romano-Wolf's heuristic
- On empirical distribution function of high-dimensional Gaussian vector components with an application to multiple testing
- On the false discovery proportion convergence under Gaussian equi-correlation
- Optimal weighting for false discovery rate control
- Permutation-based simultaneous confidence bounds for the false discovery proportion
- Post hoc confidence bounds on false positives using reference families
- Simultaneous high-probability bounds on the false discovery proportion in structured, regression and online settings
- Stochastic orders
- Two simple sufficient conditions for FDR control
- Type I error rate control for testing many hypotheses: a survey with proofs
- Variability and stability of the false discovery proportion
- Weighted \(p\)-value procedures for controlling FDR of grouped hypotheses
Cited in
(18)- A clarifying comparison of methods for controlling the false discovery rate
- New FDR bounds for discrete and heterogeneous tests
- Testing over a continuum of null hypotheses with false discovery rate control
- Further results on controlling the false discovery proportion
- Multiple Comparisons Controlling Expected Number of False Discoveries
- Generalized Augmentation to Control the False Discovery Exceedance in Multiple Testing
- Weighted False Discovery Rate Control in Large-Scale Multiple Testing
- Adaptive false discovery rate control for heterogeneous data
- Multiple testing of composite null hypotheses in heteroscedastic models
- Simultaneous control of all false discovery proportions in large-scale multiple hypothesis testing
- Multiple testing with heterogeneous multinomial distributions
- False Discovery Control in Large-Scale Spatial Multiple Testing
- Heteroscedasticity-Adjusted Ranking and Thresholding for Large-Scale Multiple Testing
- An Empirical Bayes Approach to Controlling the False Discovery Exceedance
- Controlling the number of significant effects in multiple testing
- Flexible control of the median of the false discovery proportion
- Large-scale multiple testing: fundamental limits of false discovery rate control and compound oracle
- Nonparametric methods controlling the median of the false discovery proportion
This page was built for publication: Controlling the false discovery exceedance for heterogeneous tests
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2215957)
