Sequential tests of multiple hypotheses controlling false discovery and nondiscovery rates

DOI10.1080/07474946.2020.1726686zbMATH Open1442.62041arXiv1311.3350OpenAlexW3024926731MaRDI QIDQ5113795FDOQ5113795

Authors: Jay Bartroff, Jinlin Song 

Publication date: 17 June 2020

Published in: Sequential Analysis (Search for Journal in Brave)

Abstract: We propose a general and flexible procedure for testing multiple hypotheses about sequential (or streaming) data that simultaneously controls both the false discovery rate (FDR) and false nondiscovery rate (FNR) under minimal assumptions about the data streams which may differ in distribution, dimension, and be dependent. All that is needed is a test statistic for each data stream that controls the conventional type I and II error probabilities, and no information or assumptions are required about the joint distribution of the statistics or data streams. The procedure can be used with sequential, group sequential, truncated, or other sampling schemes. The procedure is a natural extension of Benjamini and Hochberg's (1995) widely-used fixed sample size procedure to the domain of sequential data, with the added benefit of simultaneous FDR and FNR control that sequential sampling affords. We prove the procedure's error control and give some tips for implementation in commonly encountered testing situations.

Full work available at URL: https://arxiv.org/abs/1311.3350

Recommendations

• Multiple hypothesis tests controlling generalized error rates for sequential data
• Sequential tests of multiple hypotheses controlling type I and II familywise error rates
• On-line control of false discovery rates for multiple datastreams
• Sequential multiple testing with generalized error control: an asymptotic optimality theory
• Online rules for control of false discovery rate and false discovery exceedance

zbMATH Keywords

multiple comparisonsmultiple testingsequential analysisgeneralized likelihood ratiosequential hypothesis testingWald approximationsmultiple endpoint clinical trials

Mathematics Subject Classification ID

Parametric hypothesis testing (62F03) Applications of statistics to biology and medical sciences; meta analysis (62P10) Sequential statistical analysis (62L10) Paired and multiple comparisons; multiple testing (62J15) Sequential estimation (62L12)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• An improved Bonferroni procedure for multiple tests of significance
• Testing Statistical Hypotheses
• Sequential analysis. Tests and confidence intervals
• The control of the false discovery rate in multiple testing under dependency.
• A Direct Approach to False Discovery Rates
• Statistical significance for genomewide studies
• Strong Control, Conservative Point Estimation and Simultaneous Conservative Consistency of False Discovery Rates: A Unified Approach
• Sequential Methods and Their Applications
• Empirical Bayes Analysis of a Microarray Experiment
• Title not available (Why is that?)
• Detecting the emergence of a signal in a noisy image
• Accounting for Multiplicities in Assessing Drug Safety: A Three-Level Hierarchical Mixture Model
• A Two-Sample Test for a Linear Hypothesis Whose Power is Independent of the Variance
• Sequential experimentation in clinical trials. Design and analysis
• Detecting differential gene expression with a semiparametric hierarchical mixture method
• On the Non-Existence of Tests of "Student's" Hypothesis Having Power Functions Independent of $\sigma$
• Title not available (Why is that?)
• Title not available (Why is that?)
• Operating Characteristics and Extensions of the False Discovery Rate Procedure
• Group-Sequential Analysis Incorporating Covariate Information
• Some probability inequalities for ordered MTP\(_2\) random variables: a proof of the Simes conjecture
• Decision theory results for one-sided multiple comparison procedures
• Multistage tests of multiple hypotheses
• Title not available (Why is that?)
• Title not available (Why is that?)
• Sequential tests of multiple hypotheses controlling type I and II familywise error rates
• A rejection principle for sequential tests of multiple hypotheses controlling familywise error rates
• Multiple Hypothesis Tests Controlling Generalized Error Rates for Sequential Data
• Online rules for control of false discovery rate and false discovery exceedance

Cited In (10)

• Sequential tests controlling generalized familywise error rates
• Testing over a continuum of null hypotheses with false discovery rate control
• A rejection principle for sequential tests of multiple hypotheses controlling familywise error rates
• On the power of some sequential multiple testing procedures
• α-Investing: a Procedure for Sequential Control of Expected False Discoveries
• Sequential Multiple Comparisons With the Best
• Multiple Comparisons Controlling Expected Number of False Discoveries
• Control of Directional Errors in Fixed Sequence Multiple Testing
• Structure–Adaptive Sequential Testing for Online False Discovery Rate Control
• Asymptotically optimal sequential FDR and pFDR control with (or without) prior information on the number of signals

This page was built for publication: Sequential tests of multiple hypotheses controlling false discovery and nondiscovery rates

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5113795)