Admissibility in partial conjunction testing

DOI10.1080/01621459.2017.1385465zbMATH Open1478.62211arXiv1508.00934OpenAlexW2962809812WikidataQ59755356 ScholiaQ59755356MaRDI QIDQ5229901FDOQ5229901

Jingshu Wang, Art B. Owen

Publication date: 19 August 2019

Published in: Journal of the American Statistical Association (Search for Journal in Brave)

Abstract: Meta-analysis combines results from multiple studies aiming to increase power in finding their common effect. It would typically reject the null hypothesis of no effect if any one of the studies shows strong significance. The partial conjunction null hypothesis is rejected only when at least $r$ of $n$ component hypotheses are non-null with $r=1$ corresponding to a usual meta-analysis. Compared with meta-analysis, it can encourage replicable findings across studies. A by-product of it when applied to different $r$ values is a confidence interval of $r$ quantifying the proportion of non-null studies. Benjamini and Heller (2008) provided a valid test for the partial conjunction null by ignoring the $r-1$ smallest p-values and applying a valid meta-analysis p-value to the remaining $n-r+1$ p-values. We provide sufficient and necessary conditions of admissible combined p-value for the partial conjunction hypothesis among monotone tests. Non-monotone tests always dominate monotone tests but are usually too unreasonable to be used in practice. Based on these findings, we propose a generalized form of Benjamini and Heller's test which allows usage of various types of meta-analysis p-values, and apply our method to an example in assessing replicable benefit of new anticoagulants across subgroups of patients for stroke prevention.

Full work available at URL: https://arxiv.org/abs/1508.00934

Recommendations

• Screening for Partial Conjunction Hypotheses
• A Consensus Combined P-Value Test and the Family-Wide Significance of Component Tests
• scientific article; zbMATH DE number 897204
• Meta-Analysis of Mid-p-Values: Some New Results based on the Convex Order
• A systematic comparison of methods for combining \(p\)-values from independent tests

zbMATH Keywords

meta-analysispowersubgroup analysiscombined \(p\)-valuesreplicable findings

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10) Paired and multiple comparisons; multiple testing (62J15) Admissibility in statistical decision theory (62C15)

Cites Work

• Replicability analysis for genome-wide association studies
• Testing Statistical Hypotheses
• The control of the false discovery rate in multiple testing under dependency.
• Conditional association and unidimensionality in monotone latent variable models
• The emperor's new tests. (With comments and a rejoinder).
• Association of Random Variables, with Applications
• Testing Multiparameter Hypotheses
• Combining Independent Tests of Significance
• Karl Pearson's meta-analysis revisited
• Screening for Partial Conjunction Hypotheses
• Selective inference in complex research
• Characterizations of Complete Classes of Tests of Some Multiparametric Hypotheses, with Applications to Likelihood Ratio Tests
• Simultaneous set-wise testing under dependence, with applications to genome-wide association studies
• Combining independent chi squared or F tests
• Tests of Composite Hypotheses for the Multivariate Exponential Family
• The Admissibility of Hotelling's $T^2$-Test
• Complete class results for hypothesis testing problems with simple null hypotheses
• Admissibility of unbiased tests for a composite hypothesis with a restricted alternative

Cited In (8)

• Distributionally robust and generalizable inference
• Replicability across multiple studies
• Admissible ways of merging \(p\)-values under arbitrary dependence
• Assessment of the extent of corroboration of an elaborate theory of a causal hypothesis using partial conjunctions of evidence factors
• Detecting multiple replicating signals using adaptive filtering procedures
• Only closed testing procedures are admissible for controlling false discovery proportions
• Reinforced Designs: Multiple Instruments Plus Control Groups as Evidence Factors in an Observational Study of the Effectiveness of Catholic Schools
• Title not available (Why is that?)

This page was built for publication: Admissibility in partial conjunction testing

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5229901)