Sequential tests of multiple hypotheses controlling false discovery and nondiscovery rates
From MaRDI portal
Publication:5113795
Abstract: We propose a general and flexible procedure for testing multiple hypotheses about sequential (or streaming) data that simultaneously controls both the false discovery rate (FDR) and false nondiscovery rate (FNR) under minimal assumptions about the data streams which may differ in distribution, dimension, and be dependent. All that is needed is a test statistic for each data stream that controls the conventional type I and II error probabilities, and no information or assumptions are required about the joint distribution of the statistics or data streams. The procedure can be used with sequential, group sequential, truncated, or other sampling schemes. The procedure is a natural extension of Benjamini and Hochberg's (1995) widely-used fixed sample size procedure to the domain of sequential data, with the added benefit of simultaneous FDR and FNR control that sequential sampling affords. We prove the procedure's error control and give some tips for implementation in commonly encountered testing situations.
Recommendations
- Multiple hypothesis tests controlling generalized error rates for sequential data
- Sequential tests of multiple hypotheses controlling type I and II familywise error rates
- On-line control of false discovery rates for multiple datastreams
- Sequential multiple testing with generalized error control: an asymptotic optimality theory
- Online rules for control of false discovery rate and false discovery exceedance
Cites work
- A Direct Approach to False Discovery Rates
- A rejection principle for sequential tests of multiple hypotheses controlling familywise error rates
- A Two-Sample Test for a Linear Hypothesis Whose Power is Independent of the Variance
- Accounting for Multiplicities in Assessing Drug Safety: A Three-Level Hierarchical Mixture Model
- An improved Bonferroni procedure for multiple tests of significance
- Decision theory results for one-sided multiple comparison procedures
- Detecting differential gene expression with a semiparametric hierarchical mixture method
- Detecting the emergence of a signal in a noisy image
- Efficient three-stage t-tests
- Empirical Bayes Analysis of a Microarray Experiment
- Group-Sequential Analysis Incorporating Covariate Information
- scientific article; zbMATH DE number 6114088 (Why is no real title available?)
- scientific article; zbMATH DE number 1348603 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 3418486 (Why is no real title available?)
- scientific article; zbMATH DE number 3418509 (Why is no real title available?)
- scientific article; zbMATH DE number 3045589 (Why is no real title available?)
- Multiple hypothesis tests controlling generalized error rates for sequential data
- Multistage tests of multiple hypotheses
- On the Non-Existence of Tests of "Student's" Hypothesis Having Power Functions Independent of \sigma
- Online rules for control of false discovery rate and false discovery exceedance
- Operating Characteristics and Extensions of the False Discovery Rate Procedure
- Sequential analysis. Tests and confidence intervals
- Sequential experimentation in clinical trials. Design and analysis
- Sequential Methods and Their Applications
- Sequential tests of multiple hypotheses controlling type I and II familywise error rates
- Some probability inequalities for ordered MTP₂ random variables: a proof of the Simes conjecture
- Statistical significance for genomewide studies
- Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach
- Testing Statistical Hypotheses
- The control of the false discovery rate in multiple testing under dependency.
Cited in
(21)- The control of the false discovery rate in fixed sequence multiple testing
- Sequential tests controlling generalized familywise error rates
- Online rules for control of false discovery rate and false discovery exceedance
- On the power of some sequential multiple testing procedures
- Asymptotically optimal sequential FDR and pFDR control with (or without) prior information on the number of signals
- Sequential tests of multiple hypotheses controlling type I and II familywise error rates
- Group sequential BH and its adaptive versions controlling the FDR
- Testing over a continuum of null hypotheses with false discovery rate control
- A rejection principle for sequential tests of multiple hypotheses controlling familywise error rates
- Multiple Comparisons Controlling Expected Number of False Discoveries
- Sequential Multiple Comparisons With the Best
- α-Investing: a Procedure for Sequential Control of Expected False Discoveries
- Multiple hypothesis tests controlling generalized error rates for sequential data
- Asynchronous online testing of multiple hypotheses
- Asymptotically optimal, sequential, multiple testing procedures with prior information on the number of signals
- Optimal rates and trade-offs in multiple testing
- Risk inflation of sequential tests controlled by alpha investing
- Control of Directional Errors in Fixed Sequence Multiple Testing
- Sequential selection procedures and false discovery rate control
- Structure–Adaptive Sequential Testing for Online False Discovery Rate Control
- On-line control of false discovery rates for multiple datastreams
This page was built for publication: Sequential tests of multiple hypotheses controlling false discovery and nondiscovery rates
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5113795)
