Modelling publication bias and p-hacking

DOI10.48550/ARXIV.1911.12445MaRDI QIDQ65262zbMATH OpenOpenAlexFDO

Authors Jonas Moss, Riccardo De Bin, Jonas Moss, Riccardo De Bin

Publication date 27 November 2019

Published in Biometrics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1911.12445

zbMATH Keywords

file drawer problemfishing for significancemeta-analysisquestionable research practicesselection bias

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10)

Abstract: Publication bias and p-hacking are two well-known phenomena that strongly affect the scientific literature and cause severe problems in meta-analyses. Due to these phenomena, the assumptions of meta-analyses are seriously violated and the results of the studies cannot be trusted. While publication bias is almost perfectly captured by the weighting function selection model, p-hacking is much harder to model and no definitive solution has been found yet. In this paper we propose to model both publication bias and p-hacking with selection models. We derive some properties for these models, and we compare them formally and through simulations. Finally, two real data examples are used to show how the models work in practice.

Recommendations

• Detecting \(p\)-hacking
• A Bound for Publication Bias Based on the Fraction of Unpublished Studies
• Confidence Intervals and P‐Values for Meta‐Analysis with Publication Bias
• Statistical exploration of publication bias
• scientific article; zbMATH DE number 6739249

Cites work

• scientific article; zbMATH DE number 3974042 (Why is no real title available?)
• scientific article; zbMATH DE number 48701 (Why is no real title available?)
• A general linear model for estimating effect size in the presence of publication bias
• Infinite diameter confidence sets in Hedges' publication bias model
• Meta-analysis, funnel plots and sensitivity analysis
• Playing with data -- or how to discourage questionable research practices and stimulate researchers to do things right
• Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC
• Publication Bias in Meta‐Analysis
• Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis

Cited in

(7)

• Infinite diameter confidence sets in Hedges' publication bias model
• Detecting \(p\)-hacking
• publipha
• A Bound for Publication Bias Based on the Fraction of Unpublished Studies
• Using Journal Impact Factors to Correct for the Publication Bias of Medical Studies
• Publication Policies for Replicable Research and the Community-Wide False Discovery Rate
• P-hacking in clinical trials and how incentives shape the distribution of results across phases

This page was built for publication: Modelling publication bias and p-hacking

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q65262)