Randomization inference for treatment effect variation
From MaRDI portal
Abstract: Applied researchers are increasingly interested in whether and how treatment effects vary in randomized evaluations, especially variation not explained by observed covariates. We propose a model-free approach for testing for the presence of such unexplained variation. To use this randomization-based approach, we must address the fact that the average treatment effect, generally the object of interest in randomized experiments, actually acts as a nuisance parameter in this setting. We explore potential solutions and advocate for a method that guarantees valid tests in finite samples despite this nuisance. We also show how this method readily extends to testing for heterogeneity beyond a given model, which can be useful for assessing the sufficiency of a given scientific theory. We finally apply our method to the National Head Start Impact Study, a large-scale randomized evaluation of a Federal preschool program, finding that there is indeed significant unexplained treatment effect variation.
Recommendations
- Decomposing Treatment Effect Variation
- Testing treatment effect heterogeneity in regression discontinuity designs
- Estimating treatment effect heterogeneity in randomized program evaluation
- Randomization tests of causal effects under interference
- Randomization-based inference and the choice of randomization procedures
Cited in
(29)- VALID RANDOMISATION FOR THE FIRST‐DIFFERENCE ANALYSIS
- Multiple Testing and the Distributional Effects of Accountability Incentives in Education
- Randomization Tests for Weak Null Hypotheses in Randomized Experiments
- Randomization Tests in Observational Studies With Staggered Adoption of Treatment
- Causal mediation analysis with latent subgroups
- The Landscape of Causal Inference: Perspective From Citation Network Analysis
- Permutation test for heterogeneous treatment effects with a nuisance parameter
- Modern approaches for evaluating treatment effect heterogeneity from clinical trials and observational data
- A paradox from randomization-based causal inference
- scientific article; zbMATH DE number 6290119 (Why is no real title available?)
- Valid Randomization for Models with Neighbour Effects From Treatments
- Variance in randomized play-the-winner clinical trials
- Sampling‐based Randomised Designs for Causal Inference under the Potential Outcomes Framework
- Statistical matching and subclassification with a continuous dose: characterization, algorithm, and application to a health outcomes study
- A U-statistic-based test of treatment effect heterogeneity
- Nonparametric tests for treatment effect heterogeneity in observational studies
- Rank tests in unmatched clustered randomized trials applied to a study of teacher training
- Ridge rerandomization: an experimental design strategy in the presence of covariate collinearity
- Nonparametric Tests for Treatment Effect Heterogeneity With Duration Outcomes
- Robust causal inference for incremental return on ad spend with randomized paired geo experiments
- Adjusting Treatment Effect Estimates by Post-Stratification in Randomized Experiments
- Randomization inference for cluster-randomized test-negative designs with application to dengue studies: unbiased estimation, partial compliance, and stepped-wedge design
- Social distancing and COVID-19: randomization inference for a structured dose-response relationship
- Tools for re-randomization
- Randomization inference for difference-in-differences with few treated clusters
- hettx
- Causal inference: a missing data perspective
- Decomposing Treatment Effect Variation
- Effects attributable to treatment: Inference in experiments and observational studies with a discrete pivot
This page was built for publication: Randomization inference for treatment effect variation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q75397)
