Trade-off Between Validity and Efficiency of Merging P-Values Under Arbitrary Dependence
From MaRDI portal
Abstract: Various methods of combining individual p-values into one p-value are widely used in many areas of statistical applications. We say that a combining method is valid for arbitrary dependence (VAD) if it does not require any assumption on the dependence structure of the p-values, whereas it is valid for some dependence (VSD) if it requires some specific, perhaps realistic but unjustifiable, dependence structures. The trade-off between validity and efficiency of these methods is studied via analyzing the choices of critical values under different dependence assumptions. We introduce the notions of independence-comonotonicity balance (IC-balance) and the price for validity. In particular, IC-balanced methods always produce an identical critical value for independent and perfectly positively dependent p-values, a specific type of insensitivity to a family of dependence assumptions. We show that, among two very general classes of merging methods commonly used in practice, the Cauchy combination method and the Simes method are the only IC-balanced ones. Simulation studies and a real data analysis are conducted to analyze the sizes and powers of various combining methods in the presence of weak and strong dependence.
Cites work
- A unified treatment of multiple testing with prior knowledge using the p-filter
- Admissible ways of merging \(p\)-values under arbitrary dependence
- Aggregation-robustness and model uncertainty of regulatory risk measures
- An improved Bonferroni procedure for multiple tests of significance
- Bounds for the sum of dependent risks and worst value-at-risk with monotone marginal densities
- Cauchy Combination Test: A Powerful Test With Analytic p-Value Calculation Under Arbitrary Dependency Structures
- Chance and Stability
- Combining p-values via averaging
- Das maximale Signifikanzniveau des Tests: Lehne \(H_0\) ab, wenn \(k\) unter \(n\) gegebenen Tests zur Ablehnung führen
- E-values: calibration, combination and applications
- Higher criticism for detecting sparse heterogeneous mixtures.
- scientific article; zbMATH DE number 3831073 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- Joint Mixability
- Large-scale inference. Empirical Bayes methods for estimation, testing, and prediction
- Multiple testing for exploratory research
- Risk aggregation with dependence uncertainty
- Simes' procedure is ‘valid on average’
- Simultaneous control of all false discovery proportions in large-scale multiple hypothesis testing
- Some probability inequalities for ordered MTP₂ random variables: a proof of the Simes conjecture
- The control of the false discovery rate in multiple testing under dependency.
- The harmonic mean p-value for combining dependent tests
- Time-uniform, nonparametric, nonasymptotic confidence sequences
Cited in
(8)- An adaptive truncated product method for combining dependent \(p\)-values
- Heavy-Tailed Distribution for Combining Dependent P-Values With Asymptotic Robustness
- Testing with \(\mathrm{p}^*\)-values: between p-values, mid p-values, and e-values
- Aggregating dependent signals with heavy-tailed combination tests
- Combining p-values using heavy tailed distributions and their asymptotic results with applications to genomic data
- Multiple testing under negative dependence
- Subuniformity of harmonic mean p-values
- Ensemble testing for high-dimensional multiple response models
This page was built for publication: Trade-off Between Validity and Efficiency of Merging P-Values Under Arbitrary Dependence
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6086167)
