Sequential tests of multiple hypotheses controlling false discovery and nondiscovery rates
From MaRDI portal
Publication:5113795
Abstract: We propose a general and flexible procedure for testing multiple hypotheses about sequential (or streaming) data that simultaneously controls both the false discovery rate (FDR) and false nondiscovery rate (FNR) under minimal assumptions about the data streams which may differ in distribution, dimension, and be dependent. All that is needed is a test statistic for each data stream that controls the conventional type I and II error probabilities, and no information or assumptions are required about the joint distribution of the statistics or data streams. The procedure can be used with sequential, group sequential, truncated, or other sampling schemes. The procedure is a natural extension of Benjamini and Hochberg's (1995) widely-used fixed sample size procedure to the domain of sequential data, with the added benefit of simultaneous FDR and FNR control that sequential sampling affords. We prove the procedure's error control and give some tips for implementation in commonly encountered testing situations.
Recommendations
- Multiple hypothesis tests controlling generalized error rates for sequential data
- Sequential tests of multiple hypotheses controlling type I and II familywise error rates
- On-line control of false discovery rates for multiple datastreams
- Sequential multiple testing with generalized error control: an asymptotic optimality theory
- Online rules for control of false discovery rate and false discovery exceedance
Cites work
- scientific article; zbMATH DE number 6114088 (Why is no real title available?)
- scientific article; zbMATH DE number 1348603 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 3418486 (Why is no real title available?)
- scientific article; zbMATH DE number 3418509 (Why is no real title available?)
- scientific article; zbMATH DE number 3045589 (Why is no real title available?)
- A Direct Approach to False Discovery Rates
- A Two-Sample Test for a Linear Hypothesis Whose Power is Independent of the Variance
- A rejection principle for sequential tests of multiple hypotheses controlling familywise error rates
- Accounting for Multiplicities in Assessing Drug Safety: A Three-Level Hierarchical Mixture Model
- An improved Bonferroni procedure for multiple tests of significance
- Decision theory results for one-sided multiple comparison procedures
- Detecting differential gene expression with a semiparametric hierarchical mixture method
- Detecting the emergence of a signal in a noisy image
- Efficient three-stage \(t\)-tests
- Empirical Bayes Analysis of a Microarray Experiment
- Group-Sequential Analysis Incorporating Covariate Information
- Multiple hypothesis tests controlling generalized error rates for sequential data
- Multistage tests of multiple hypotheses
- On the Non-Existence of Tests of "Student's" Hypothesis Having Power Functions Independent of $\sigma$
- Online rules for control of false discovery rate and false discovery exceedance
- Operating Characteristics and Extensions of the False Discovery Rate Procedure
- Sequential Methods and Their Applications
- Sequential analysis. Tests and confidence intervals
- Sequential experimentation in clinical trials. Design and analysis
- Sequential tests of multiple hypotheses controlling type I and II familywise error rates
- Some probability inequalities for ordered MTP\(_2\) random variables: a proof of the Simes conjecture
- Statistical significance for genomewide studies
- Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach
- Testing Statistical Hypotheses
- The control of the false discovery rate in multiple testing under dependency.
Cited in
(20)- Sequential tests controlling generalized familywise error rates
- A rejection principle for sequential tests of multiple hypotheses controlling familywise error rates
- Multiple hypothesis tests controlling generalized error rates for sequential data
- Testing over a continuum of null hypotheses with false discovery rate control
- Sequential tests of multiple hypotheses controlling type I and II familywise error rates
- Optimal rates and trade-offs in multiple testing
- Control of Directional Errors in Fixed Sequence Multiple Testing
- On the power of some sequential multiple testing procedures
- Risk inflation of sequential tests controlled by alpha investing
- On-line control of false discovery rates for multiple datastreams
- Sequential Multiple Comparisons With the Best
- The control of the false discovery rate in fixed sequence multiple testing
- Sequential selection procedures and false discovery rate control
- Multiple Comparisons Controlling Expected Number of False Discoveries
- Structure–Adaptive Sequential Testing for Online False Discovery Rate Control
- Asymptotically optimal sequential FDR and pFDR control with (or without) prior information on the number of signals
- Group sequential BH and its adaptive versions controlling the FDR
- Asymptotically optimal, sequential, multiple testing procedures with prior information on the number of signals
- α-Investing: a Procedure for Sequential Control of Expected False Discoveries
- Online rules for control of false discovery rate and false discovery exceedance
This page was built for publication: Sequential tests of multiple hypotheses controlling false discovery and nondiscovery rates
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5113795)
