Modelling publication bias and p-hacking

DOI10.48550/ARXIV.1911.12445zbMATH Open1522.62208arXiv1911.12445OpenAlexW3199754708MaRDI QIDQ65262FDOQ65262

Jonas Moss, Riccardo De Bin, Jonas Moss, Riccardo De Bin

Publication date: 27 November 2019

Published in: Biometrics (Search for Journal in Brave)

Abstract: Publication bias and p-hacking are two well-known phenomena that strongly affect the scientific literature and cause severe problems in meta-analyses. Due to these phenomena, the assumptions of meta-analyses are seriously violated and the results of the studies cannot be trusted. While publication bias is almost perfectly captured by the weighting function selection model, p-hacking is much harder to model and no definitive solution has been found yet. In this paper we propose to model both publication bias and p-hacking with selection models. We derive some properties for these models, and we compare them formally and through simulations. Finally, two real data examples are used to show how the models work in practice.

Full work available at URL: https://arxiv.org/abs/1911.12445

Recommendations

• Detecting \(p\)-hacking
• A Bound for Publication Bias Based on the Fraction of Unpublished Studies
• Confidence Intervals and P‐Values for Meta‐Analysis with Publication Bias
• Statistical exploration of publication bias
• scientific article; zbMATH DE number 6739249

zbMATH Keywords

file drawer problemfishing for significancemeta-analysisquestionable research practicesselection bias

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10)

Cites Work

• Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC
• Infinite diameter confidence sets in Hedges' publication bias model
• Publication Bias in Meta‐Analysis
• Title not available (Why is that?)
• Title not available (Why is that?)
• Meta-analysis, funnel plots and sensitivity analysis
• Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis
• A general linear model for estimating effect size in the presence of publication bias
• Playing with data -- or how to discourage questionable research practices and stimulate researchers to do things right

Cited In (5)

• Infinite diameter confidence sets in Hedges' publication bias model
• A Bound for Publication Bias Based on the Fraction of Unpublished Studies
• Using Journal Impact Factors to Correct for the Publication Bias of Medical Studies
• publipha
• Publication Policies for Replicable Research and the Community-Wide False Discovery Rate

This page was built for publication: Modelling publication bias and p-hacking

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q65262)