Multiple testing with the structure-adaptive Benjamini-Hochberg algorithm
From MaRDI portal
Publication:3120100
DOI10.1111/RSSB.12298zbMATH Open1407.62284arXiv1606.07926OpenAlexW2962981429MaRDI QIDQ3120100FDOQ3120100
Authors: Ang Li, Rina Foygel Barber 
Publication date: 1 March 2019
Published in: Journal of the Royal Statistical Society Series B: Statistical Methodology (Search for Journal in Brave)
Abstract: In multiple testing problems, where a large number of hypotheses are tested simultaneously, false discovery rate (FDR) control can be achieved with the well-known Benjamini-Hochberg procedure, which adapts to the amount of signal present in the data. Many modifications of this procedure have been proposed to improve power in scenarios where the hypotheses are organized into groups or into a hierarchy, as well as other structured settings. Here we introduce SABHA, the "structure-adaptive Benjamini-Hochberg algorithm", as a generalization of these adaptive testing methods. SABHA incorporates prior information about any pre-determined type of structure in the pattern of locations of the signals and nulls within the list of hypotheses, to reweight the p-values in a data-adaptive way. This raises the power by making more discoveries in regions where signals appear to be more common. Our main theoretical result proves that SABHA controls FDR at a level that is at most slightly higher than the target FDR level, as long as the adaptive weights are constrained sufficiently so as not to overfit too much to the data-interestingly, the excess FDR can be related to the Rademacher complexity or Gaussian width of the class from which we choose our data-adaptive weights. We apply this general framework to various structured settings, including ordered, grouped, and low total variation structures, and get the bounds on FDR for each specific setting. We also examine the empirical performance of SABHA on fMRI activity data and on gene/drug response data, as well as on simulated data.
Full work available at URL: https://arxiv.org/abs/1606.07926
Recommendations
- Adapting to one- and two-way classified structures of hypotheses while controlling the false discovery rate
- Dynamic adaptive multiple tests with finite sample FDR control
- Hierarchical False Discovery Rate–Controlling Methodology
- FDR control with adaptive procedures and FDR monotonicity
- Optimal weighting for false discovery rate control
false discovery ratepowermultiple testingBenjamini-Hochberg procedureordered, grouped and low total variation structuresstructure-adaptive Benjamini-Hochberg algorithm
Order statistics; empirical distribution functions (62G30) Paired and multiple comparisons; multiple testing (62J15)
Cites Work
- ROCKET: robust confidence intervals via Kendall's tau for transelliptical graphical models
- AdaPT: an interactive procedure for multiple testing with side information
- Multiple testing of local extrema for detection of change points
- Distributed optimization and statistical learning via the alternating direction method of multipliers
- The nonparanormal: semiparametric estimation of high dimensional undirected graphs
- Title not available (Why is that?)
- The control of the false discovery rate in multiple testing under dependency.
- A Direct Approach to False Discovery Rates
- Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach
- Oracle and Adaptive Compound Decision Rules for False Discovery Rate Control
- On the Benjamini-Hochberg method
- Controlling the false discovery rate via knockoffs
- Multiple testing of local maxima for detection of peaks in 1D
- A general interactive framework for false discovery rate control under structural constraints
- The \(p\)-filter: multilayer false discovery rate control for grouped hypotheses
- Sequential selection procedures and false discovery rate control
- Title not available (Why is that?)
- Detecting simultaneous variant intervals in aligned sequences
- 10.1162/153244303321897690
- Title not available (Why is that?)
- False discovery rate control with groups
- False discovery control with p-value weighting
- A powerful FDR control procedure for multiple hypotheses
- A unified treatment of multiple testing with prior knowledge using the p-filter
- Selective Inference on Multiple Families of Hypotheses
Cited In (31)
- Estimating minimum effect with outlier selection
- An improved Hochberg procedure for multiple tests of significance
- Adapting to one- and two-way classified structures of hypotheses while controlling the false discovery rate
- Conditional calibration for false discovery rate control under dependence
- Covariate Adaptive False Discovery Rate Control With Applications to Omics-Wide Multiple Testing
- The \(p\)-filter: multilayer false discovery rate control for grouped hypotheses
- Optimal false discovery rate control for large scale multiple testing with auxiliary information
- Large-scale multiple inference of collective dependence with applications to protein function
- Empirical Bayes cumulative \(\ell\)-value multiple testing procedure for sparse sequences
- Detecting multiple replicating signals using adaptive filtering procedures
- LAWS: A Locally Adaptive Weighting and Screening Approach to Spatial Multiple Testing
- Heteroscedasticity-Adjusted Ranking and Thresholding for Large-Scale Multiple Testing
- A powerful procedure that controls the false discovery rate with directional information
- Testing for outliers with conformal p-values
- Post hoc false positive control for structured hypotheses
- Testing and estimation for clustered signals
- Further results on controlling the false discovery rate under some complex grouping structure of hypotheses
- New results for adaptive false discovery rate control with \(p\)-value weighting
- A sequential algorithm for false discovery rate control on directed acyclic graphs
- False discovery rate control for lesion-symptom mapping with heterogeneous data via weighted \(p\)-values
- Adaptive \(p\)-value weighting with power optimality
- Knockoffs with side information
- Structure–Adaptive Sequential Testing for Online False Discovery Rate Control
- Two-Component Mixture Model in the Presence of Covariates
- Alteration detection of tensor dependence structure via sparsity-exploited reranking algorithm
- False Discovery Rate Control Under General Dependence By Symmetrized Data Aggregation
- A Multiple Comparisons Procedure for Use in Conjunction with the Benard-van Elteren Test
- A spatially adaptive large-scale multiple-testing procedure
- Multiple Testing and Data Adaptive Regression: An Application to HIV-1 Sequence Data.
- Covariate-assisted ranking and screening for large-scale two-sample inference
- Statistical limits of sparse mixture detection
Uses Software
This page was built for publication: Multiple testing with the structure-adaptive Benjamini-Hochberg algorithm
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3120100)
