Assessing replicability of findings across two studies of multiple features

DOI10.1093/BIOMET/ASY029zbMATH Open1499.62260arXiv1504.00534OpenAlexW2220135973WikidataQ129884915 ScholiaQ129884915MaRDI QIDQ4561007FDOQ4561007

R. Heller, Marina Bogomolov

Publication date: 10 December 2018

Published in: Biometrika (Search for Journal in Brave)

Abstract: Replicability analysis aims to identify the findings that replicated across independent studies that examine the same features. We provide powerful novel replicability analysis procedures for two studies for FWER and for FDR control on the replicability claims. The suggested procedures first select the promising features from each study solely based on that study, and then test for replicability only the features that were selected in both studies. We incorporate the plug-in estimates of the fraction of null hypotheses in one study among the selected hypotheses by the other study. Since the fraction of nulls in one study among the selected features from the other study is typically small, the power gain can be remarkable. We provide theoretical guarantees for the control of the appropriate error rates, as well as simulations that demonstrate the excellent power properties of the suggested procedures. We demonstrate the usefulness of our procedures on real data examples from two application fields: behavioural genetics and microarray studies.

Full work available at URL: https://arxiv.org/abs/1504.00534

zbMATH Keywords

false discovery ratemeta-analysismultiple testingadaptive procedurefamilywise error ratereplicability analysis

Mathematics Subject Classification ID

Nonparametric hypothesis testing (62G10) Paired and multiple comparisons; multiple testing (62J15)

Cited In (7)

• Nonparametric false discovery rate control for identifying simultaneous signals
• Replicability across multiple studies
• False discovery rate-controlled multiple testing for union null hypotheses: a knockoff-based approach
• Detecting multiple replicating signals using adaptive filtering procedures
• Randomized ‐values for multiple testing and their application in replicability analysis
• On optimal two‐stage testing of multiple mediators
• Detection of sparse positive dependence

This page was built for publication: Assessing replicability of findings across two studies of multiple features

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4561007)