Randomization bias in field trials to evaluate targeting methods

DOI10.1016/J.ECONLET.2018.03.012zbMATH Open1397.62570arXiv1711.07949OpenAlexW2770031122WikidataQ130048722 ScholiaQ130048722MaRDI QIDQ1787591FDOQ1787591

Authors: Eric Potash 

Publication date: 5 October 2018

Published in: Economics Letters (Search for Journal in Brave)

Abstract: This paper studies the evaluation of methods for targeting the allocation of limited resources to a high-risk subpopulation. We consider a randomized controlled trial to measure the difference in efficiency between two targeting methods and show that it is biased. An alternative, survey-based design is shown to be unbiased. Both designs are simulated for the evaluation of a policy to target lead hazard investigations using a predictive model. Based on our findings, we advised the Chicago Department of Public Health to use the survey design for their field trial. Our work anticipates further developments in economics that will be important as predictive modeling becomes an increasingly common policy tool.

Full work available at URL: https://arxiv.org/abs/1711.07949

Recommendations

• Evidence of randomisation bias in a large-scale social experiment: the case of ERA
• A new perspective on the issue of selection bias in randomized controlled field experiments
• Tools for re-randomization
• A simple approximation for evaluating external validity bias
• Bias of the regression estimator for experiments using clustered random assignment

zbMATH Keywords

survey methodstargetingfield experimentsrandomized controlled trials

Mathematics Subject Classification ID

Applications of statistics to economics (62P20) Sampling theory, sample surveys (62D05) Resource and cost allocation (including fair division, apportionment, etc.) (91B32)

Cites Work

• Evidence of randomisation bias in a large-scale social experiment: the case of ERA

Cited In (2)

• Designing field experiments which are subject to representation bias
• A new perspective on the issue of selection bias in randomized controlled field experiments

This page was built for publication: Randomization bias in field trials to evaluate targeting methods

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1787591)