An evaluation of statistical methods for aggregate patterns of replication failure

DOI10.1214/20-AOAS1387MaRDI QIDQ2233158zbMATH OpenOpenAlexFDO

Authors Jacob M. Schauer, Kaitlyn G. Fitzgerald, Sarah Peko-Spicer, Mena C. R. Whalen, Rrita Zejnullahi, Larry V. Hedges

Publication date 14 October 2021

Published in The Annals of Applied Statistics (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1214/20-aoas1387

zbMATH Keywords

bias powermeta-analysisreplication

Mathematics Subject Classification ID

Foundations and philosophical topics in statistics (62A01) Applications of statistics to biology and medical sciences; meta analysis (62P10)

Recommendations

• Statistical methods for replicability assessment
• Replication, statistical consistency, and publication bias
• Variation and Covariation in Large-Scale Replication Projects: An Evaluation of Replicability
• On biases in assessing replicability, statistical consistency and publication bias
• Thinking about data, research methods, and statistical analyses. Comment on ``Playing with data -- or how to discourage questionable research practices and stimulate researchers to do things right

Cites work

• A Direct Approach to False Discovery Rates
• A Note on the Ratio of Two Normally Distributed Variables
• Asymptotic lognormality of P-values
• Comparison of Methods for Estimating the Number of True Null Hypotheses in Multiplicity Testing
• scientific article; zbMATH DE number 3153624 (Why is no real title available?)
• scientific article; zbMATH DE number 4090552 (Why is no real title available?)
• Introduction to Meta‐Analysis
• Maximum likelihood estimation of the correlation coefficient in a bivariate normal model with missing data
• On the existence of a normal approximation to the distribution of the ratio of two independent normal random variables
• Parametric mixture models for estimating the proportion of true null hypotheses and adaptive control of FDR
• Stochastic Comparison of Tests
• The ASA Statement on p-Values: Context, Process, and Purpose
• The Behavior of the P-Value When the Alternative Hypothesis is True
• THE DISTRIBUTION OF THE INDEX IN A NORMAL BIVARIATE POPULATION

Cited in

(5)

• Statistical methods for replicability assessment
• Assessing replicability of findings across two studies of multiple features
• Statistical proof? The problem of irreproducibility
• The assessment of replication success based on relative effect size
• Thinking about data, research methods, and statistical analyses. Comment on ``Playing with data -- or how to discourage questionable research practices and stimulate researchers to do things right

Describes a project that uses

Uses Software

• zoverw

This page was built for publication: An evaluation of statistical methods for aggregate patterns of replication failure

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2233158)