Assessing replicability of findings across two studies of multiple features

DOI10.1093/BIOMET/ASY029MaRDI QIDQ4561007zbMATHOpenAlexWikidataFDO

Authors Marina Bogomolov, R. Heller

Publication date 10 December 2018

Published in Biometrika (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1504.00534

zbMATH Keywords

false discovery ratemeta-analysismultiple testingadaptive procedurefamilywise error ratereplicability analysis

Mathematics Subject Classification ID

Nonparametric hypothesis testing (62G10) Paired and multiple comparisons; multiple testing (62J15)

Abstract: Replicability analysis aims to identify the findings that replicated across independent studies that examine the same features. We provide powerful novel replicability analysis procedures for two studies for FWER and for FDR control on the replicability claims. The suggested procedures first select the promising features from each study solely based on that study, and then test for replicability only the features that were selected in both studies. We incorporate the plug-in estimates of the fraction of null hypotheses in one study among the selected hypotheses by the other study. Since the fraction of nulls in one study among the selected features from the other study is typically small, the power gain can be remarkable. We provide theoretical guarantees for the control of the appropriate error rates, as well as simulations that demonstrate the excellent power properties of the suggested procedures. We demonstrate the usefulness of our procedures on real data examples from two application fields: behavioural genetics and microarray studies.

Recommendations

• Discovering findings that replicate from a primary study of high dimension to a follow-up study
• Replicability analysis for genome-wide association studies
• Statistical methods for replicability assessment
• Measuring reproducibility of high-throughput experiments
• An evaluation of statistical methods for aggregate patterns of replication failure

Cited in

(12)

• False discovery rate-controlled multiple testing for union null hypotheses: a knockoff-based approach
• Training replicable predictors in multiple studies
• Replicability across multiple studies
• Randomized ‐values for multiple testing and their application in replicability analysis
• Replicability analysis for genome-wide association studies
• Detecting multiple replicating signals using adaptive filtering procedures
• On optimal two‐stage testing of multiple mediators
• Maximum rank reproducibility: a nonparametric approach to assessing reproducibility in replicate experiments
• Discovering findings that replicate from a primary study of high dimension to a follow-up study
• Nonparametric false discovery rate control for identifying simultaneous signals
• Detection of sparse positive dependence
• Replication in genome-wide association studies

This page was built for publication: Assessing replicability of findings across two studies of multiple features

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4561007)