Multiple testing with the structure-adaptive Benjamini-Hochberg algorithm
From MaRDI portal
Abstract: In multiple testing problems, where a large number of hypotheses are tested simultaneously, false discovery rate (FDR) control can be achieved with the well-known Benjamini-Hochberg procedure, which adapts to the amount of signal present in the data. Many modifications of this procedure have been proposed to improve power in scenarios where the hypotheses are organized into groups or into a hierarchy, as well as other structured settings. Here we introduce SABHA, the "structure-adaptive Benjamini-Hochberg algorithm", as a generalization of these adaptive testing methods. SABHA incorporates prior information about any pre-determined type of structure in the pattern of locations of the signals and nulls within the list of hypotheses, to reweight the p-values in a data-adaptive way. This raises the power by making more discoveries in regions where signals appear to be more common. Our main theoretical result proves that SABHA controls FDR at a level that is at most slightly higher than the target FDR level, as long as the adaptive weights are constrained sufficiently so as not to overfit too much to the data-interestingly, the excess FDR can be related to the Rademacher complexity or Gaussian width of the class from which we choose our data-adaptive weights. We apply this general framework to various structured settings, including ordered, grouped, and low total variation structures, and get the bounds on FDR for each specific setting. We also examine the empirical performance of SABHA on fMRI activity data and on gene/drug response data, as well as on simulated data.
Recommendations
- Adapting to one- and two-way classified structures of hypotheses while controlling the false discovery rate
- Dynamic adaptive multiple tests with finite sample FDR control
- Hierarchical False Discovery Rate–Controlling Methodology
- FDR control with adaptive procedures and FDR monotonicity
- Optimal weighting for false discovery rate control
Cites work
- 10.1162/153244303321897690
- A Direct Approach to False Discovery Rates
- A general interactive framework for false discovery rate control under structural constraints
- A powerful FDR control procedure for multiple hypotheses
- A unified treatment of multiple testing with prior knowledge using the p-filter
- AdaPT: an interactive procedure for multiple testing with side information
- Controlling the false discovery rate via knockoffs
- Detecting simultaneous variant intervals in aligned sequences
- Distributed optimization and statistical learning via the alternating direction method of multipliers
- False discovery control with p-value weighting
- False discovery rate control with groups
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 1508662 (Why is no real title available?)
- scientific article; zbMATH DE number 3390139 (Why is no real title available?)
- Multiple testing of local extrema for detection of change points
- Multiple testing of local maxima for detection of peaks in 1D
- On the Benjamini-Hochberg method
- Oracle and Adaptive Compound Decision Rules for False Discovery Rate Control
- ROCKET: robust confidence intervals via Kendall's tau for transelliptical graphical models
- Selective inference on multiple families of hypotheses
- Sequential selection procedures and false discovery rate control
- Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach
- The p-filter: multilayer false discovery rate control for grouped hypotheses
- The control of the false discovery rate in multiple testing under dependency.
- The nonparanormal: semiparametric estimation of high dimensional undirected graphs
Cited in
(36)- False Discovery Rate Control Under General Dependence By Symmetrized Data Aggregation
- Testing and estimation for clustered signals
- Statistical limits of sparse mixture detection
- Detecting multiple replicating signals using adaptive filtering procedures
- Conditional calibration for false discovery rate control under dependence
- Optimal false discovery rate control for large scale multiple testing with auxiliary information
- Empirical Bayes cumulative \(\ell\)-value multiple testing procedure for sparse sequences
- Adapting to one- and two-way classified structures of hypotheses while controlling the false discovery rate
- Large-scale multiple inference of collective dependence with applications to protein function
- Adaptive \(p\)-value weighting with power optimality
- Estimating minimum effect with outlier selection
- A Multiple Comparisons Procedure for Use in Conjunction with the Benard-van Elteren Test
- An improved Hochberg procedure for multiple tests of significance
- Post hoc false positive control for structured hypotheses
- Covariate-assisted ranking and screening for large-scale two-sample inference
- The p-filter: multilayer false discovery rate control for grouped hypotheses
- Multiple Testing and Data Adaptive Regression: An Application to HIV-1 Sequence Data.
- A sequential algorithm for false discovery rate control on directed acyclic graphs
- Covariate Adaptive False Discovery Rate Control With Applications to Omics-Wide Multiple Testing
- LAWS: A Locally Adaptive Weighting and Screening Approach to Spatial Multiple Testing
- Heteroscedasticity-Adjusted Ranking and Thresholding for Large-Scale Multiple Testing
- Testing for outliers with conformal p-values
- A powerful procedure that controls the false discovery rate with directional information
- Further results on controlling the false discovery rate under some complex grouping structure of hypotheses
- Knockoffs with side information
- Structure–Adaptive Sequential Testing for Online False Discovery Rate Control
- Two-Component Mixture Model in the Presence of Covariates
- New results for adaptive false discovery rate control with \(p\)-value weighting
- A spatially adaptive large-scale multiple-testing procedure
- False discovery rate control for lesion-symptom mapping with heterogeneous data via weighted p-values
- Alteration detection of tensor dependence structure via sparsity-exploited reranking algorithm
- Large-scale multiple testing of composite null hypotheses under heteroskedasticity
- NAPA: neighborhood-assisted and posterior-adjusted two-sample inference
- Empirical partially Bayes multiple testing and compound ^2 decisions
- STRAW: structure-adaptive weighting procedure for large-scale spatial multiple testing
- Powerful spatial multiple testing via borrowing neighboring information
This page was built for publication: Multiple testing with the structure-adaptive Benjamini-Hochberg algorithm
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3120100)
