Multiple testing with the structure-adaptive Benjamini-Hochberg algorithm
From MaRDI portal
Publication:3120100
Abstract: In multiple testing problems, where a large number of hypotheses are tested simultaneously, false discovery rate (FDR) control can be achieved with the well-known Benjamini-Hochberg procedure, which adapts to the amount of signal present in the data. Many modifications of this procedure have been proposed to improve power in scenarios where the hypotheses are organized into groups or into a hierarchy, as well as other structured settings. Here we introduce SABHA, the "structure-adaptive Benjamini-Hochberg algorithm", as a generalization of these adaptive testing methods. SABHA incorporates prior information about any pre-determined type of structure in the pattern of locations of the signals and nulls within the list of hypotheses, to reweight the p-values in a data-adaptive way. This raises the power by making more discoveries in regions where signals appear to be more common. Our main theoretical result proves that SABHA controls FDR at a level that is at most slightly higher than the target FDR level, as long as the adaptive weights are constrained sufficiently so as not to overfit too much to the data-interestingly, the excess FDR can be related to the Rademacher complexity or Gaussian width of the class from which we choose our data-adaptive weights. We apply this general framework to various structured settings, including ordered, grouped, and low total variation structures, and get the bounds on FDR for each specific setting. We also examine the empirical performance of SABHA on fMRI activity data and on gene/drug response data, as well as on simulated data.
Recommendations
- Adapting to one- and two-way classified structures of hypotheses while controlling the false discovery rate
- Dynamic adaptive multiple tests with finite sample FDR control
- Hierarchical False Discovery Rate–Controlling Methodology
- FDR control with adaptive procedures and FDR monotonicity
- Optimal weighting for false discovery rate control
Cites work
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 1508662 (Why is no real title available?)
- scientific article; zbMATH DE number 3390139 (Why is no real title available?)
- 10.1162/153244303321897690
- A Direct Approach to False Discovery Rates
- A general interactive framework for false discovery rate control under structural constraints
- A powerful FDR control procedure for multiple hypotheses
- A unified treatment of multiple testing with prior knowledge using the p-filter
- AdaPT: an interactive procedure for multiple testing with side information
- Controlling the false discovery rate via knockoffs
- Detecting simultaneous variant intervals in aligned sequences
- Distributed optimization and statistical learning via the alternating direction method of multipliers
- False discovery control with p-value weighting
- False discovery rate control with groups
- Multiple testing of local extrema for detection of change points
- Multiple testing of local maxima for detection of peaks in 1D
- On the Benjamini-Hochberg method
- Oracle and Adaptive Compound Decision Rules for False Discovery Rate Control
- ROCKET: robust confidence intervals via Kendall's tau for transelliptical graphical models
- Selective inference on multiple families of hypotheses
- Sequential selection procedures and false discovery rate control
- Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach
- The \(p\)-filter: multilayer false discovery rate control for grouped hypotheses
- The control of the false discovery rate in multiple testing under dependency.
- The nonparanormal: semiparametric estimation of high dimensional undirected graphs
Cited in
(31)- Statistical limits of sparse mixture detection
- Estimating minimum effect with outlier selection
- Adapting to one- and two-way classified structures of hypotheses while controlling the false discovery rate
- An improved Hochberg procedure for multiple tests of significance
- Conditional calibration for false discovery rate control under dependence
- Covariate Adaptive False Discovery Rate Control With Applications to Omics-Wide Multiple Testing
- The \(p\)-filter: multilayer false discovery rate control for grouped hypotheses
- Optimal false discovery rate control for large scale multiple testing with auxiliary information
- Large-scale multiple inference of collective dependence with applications to protein function
- Empirical Bayes cumulative \(\ell\)-value multiple testing procedure for sparse sequences
- Detecting multiple replicating signals using adaptive filtering procedures
- LAWS: A Locally Adaptive Weighting and Screening Approach to Spatial Multiple Testing
- Heteroscedasticity-Adjusted Ranking and Thresholding for Large-Scale Multiple Testing
- A powerful procedure that controls the false discovery rate with directional information
- Testing for outliers with conformal p-values
- Testing and estimation for clustered signals
- Post hoc false positive control for structured hypotheses
- Further results on controlling the false discovery rate under some complex grouping structure of hypotheses
- New results for adaptive false discovery rate control with \(p\)-value weighting
- A sequential algorithm for false discovery rate control on directed acyclic graphs
- False discovery rate control for lesion-symptom mapping with heterogeneous data via weighted \(p\)-values
- Adaptive \(p\)-value weighting with power optimality
- Knockoffs with side information
- False Discovery Rate Control Under General Dependence By Symmetrized Data Aggregation
- Structure–Adaptive Sequential Testing for Online False Discovery Rate Control
- Two-Component Mixture Model in the Presence of Covariates
- Alteration detection of tensor dependence structure via sparsity-exploited reranking algorithm
- A Multiple Comparisons Procedure for Use in Conjunction with the Benard-van Elteren Test
- A spatially adaptive large-scale multiple-testing procedure
- Multiple Testing and Data Adaptive Regression: An Application to HIV-1 Sequence Data.
- Covariate-assisted ranking and screening for large-scale two-sample inference
This page was built for publication: Multiple testing with the structure-adaptive Benjamini-Hochberg algorithm
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3120100)
