Rejective Sampling, Rerandomization, and Regression Adjustment in Survey Experiments
From MaRDI portal
(Redirected from Publication:6165310)
Abstract: Classical randomized experiments, equipped with randomization-based inference, provide assumption-free inference for treatment effects. They have been the gold standard for drawing causal inference and provide excellent internal validity. However, they have also been criticized for questionable external validity, in the sense that the conclusion may not generalize well to a larger population. The randomized survey experiment is a design tool that can help mitigate this concern, by randomly selecting the experimental units from the target population of interest. However, as pointed out by Morgan and Rubin (2012), chance imbalances often exist in covariate distributions between different treatment groups even under completely randomized experiments. Not surprisingly, such covariate imbalances also occur in randomized survey experiments. Furthermore, the covariate imbalances happen not only between different treatment groups, but also between the sampled experimental units and the overall population of interest. In this paper, we propose a two-stage rerandomization design that can actively avoid undesirable covariate imbalances at both the sampling and treatment assignment stages. We further develop asymptotic theory for rerandomized survey experiments, demonstrating that rerandomization provides better covariate balance, more precise treatment effect estimators, and shorter large-sample confidence intervals. We also propose covariate adjustment to deal with remaining covariate imbalances after rerandomization, showing that it can further improve both the sampling and estimated precision. Our work allows general relationship among covariates at the sampling, treatment assignment and analysis stages, and generalizes both rerandomization in classical randomized experiments (Morgan and Rubin 2012) and rejective sampling in survey sampling (Fuller 2009).
Cites work
- Adjusting Treatment Effect Estimates by Post-Stratification in Randomized Experiments
- Agnostic notes on regression adjustments to experimental data: reexamining Freedman's critique
- Applied statistics: a review
- Asymptotic theory of rerandomization in treatment-control experiments
- Causal inference for statistics, social, and biomedical sciences. An introduction
- Covariate-adjusted Fisher randomization tests for the average treatment effect
- Design of observational studies
- Gaussian Prepivoting for Finite Population Causal Inference
- Harmonizing Optimized Designs With Classic Randomization in Experiments
- scientific article; zbMATH DE number 1817583 (Why is no real title available?)
- scientific article; zbMATH DE number 3166683 (Why is no real title available?)
- scientific article; zbMATH DE number 2172949 (Why is no real title available?)
- scientific article; zbMATH DE number 837310 (Why is no real title available?)
- Nearly random designs with greatly improved balance
- On Optimal Rerandomization Designs
- On the application of probability theory to agricultural experiments. Essay on principles. Section 9. Translated from the Polish and edited by D. M. Dąbrowska and T. P. Speed
- Optimal rerandomization designs via a criterion that provides insurance against failed experiments
- OptimalA PrioriBalance in the Design of Controlled Experiments
- Randomization Tests for Weak Null Hypotheses in Randomized Experiments
- Rerandomization and regression adjustment
- Rerandomization to improve covariate balance in experiments
- Sampling‐based Randomised Designs for Causal Inference under the Potential Outcomes Framework
- Some design properties of a rejective sampling procedure
Cited in
(7)- Rerandomization with diminishing covariate imbalance and diverging number of covariates
- Some design properties of a rejective sampling procedure
- PCA rerandomization
- A Bayesian Criterion for Rerandomization
- Two-phase rejective sampling and its asymptotic properties
- Asymptotic theory of the best-choice rerandomization using the Mahalanobis distance
- Tyranny-of-the-Minority Regression Adjustment in Randomized Experiments
This page was built for publication: Rejective Sampling, Rerandomization, and Regression Adjustment in Survey Experiments
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6165310)
