Dynamic Causal Effects Evaluation in A/B Testing with a Reinforcement Learning Framework
From MaRDI portal
Publication:6077592
Abstract: A/B testing, or online experiment is a standard business strategy to compare a new product with an old one in pharmaceutical, technological, and traditional industries. Major challenges arise in online experiments of two-sided marketplace platforms (e.g., Uber) where there is only one unit that receives a sequence of treatments over time. In those experiments, the treatment at a given time impacts current outcome as well as future outcomes. The aim of this paper is to introduce a reinforcement learning framework for carrying A/B testing in these experiments, while characterizing the long-term treatment effects. Our proposed testing procedure allows for sequential monitoring and online updating. It is generally applicable to a variety of treatment designs in different industries. In addition, we systematically investigate the theoretical properties (e.g., size and power) of our testing procedure. Finally, we apply our framework to both simulated data and a real-world data example obtained from a technological company to illustrate its advantage over the current practice. A Python implementation of our test is available at https://github.com/callmespring/CausalRL.
Cites work
- A new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effect
- A unified family of covariate-adjusted response-adaptive designs based on efficiency and ethics
- Asymptotic properties of covariate-adjusted response-adaptive designs
- Bayesian method for causal inference in spatially-correlated multivariate time series
- Causal inference for statistics, social, and biomedical sciences. An introduction
- Discrete Sequential Boundaries for Clinical Trials
- Estimating dynamic treatment regimes in mobile health using V-learning
- Estimating individualized treatment rules using outcome weighted learning
- Estimation and Inference of Heterogeneous Treatment Effects using Random Forests
- Greedy outcome weighted tree learning of optimal personalized treatment rules
- High-dimensional \(A\)-learning for optimal dynamic treatment regimes
- scientific article; zbMATH DE number 45784 (Why is no real title available?)
- scientific article; zbMATH DE number 700091 (Why is no real title available?)
- scientific article; zbMATH DE number 7306879 (Why is no real title available?)
- Inference for non-regular parameters in optimal dynamic treatment regimes
- Information-regret compromise in covariate-adaptive treatment allocation
- Interpretable dynamic treatment regimes
- Jackknife, bootstrap and other resampling methods in regression analysis
- Learning optimal distributionally robust individualized treatment rules
- Maximin projection learning for optimal treatment decision with heterogeneous individualized treatment effects
- New statistical learning methods for estimating optimal dynamic treatment regimes
- Optimal Dynamic Treatment Regimes
- Optimal Structural Nested Models for Optimal Sequential Decisions
- Penalized Q-learning for dynamic treatment regimens
- Performance guarantees for individualized treatment rules
- Personalized Policy Learning Using Longitudinal Mobile Health Data
- Quantile-optimal treatment regimes
- Randomization inference for peer effects
- Reinforcement learning. An introduction
- Robust estimation of optimal dynamic treatment regimes for sequential treatment decisions
- Synthetic learner: model-free inference on treatments over time
- Testing for arbitrary interference on experimentation platforms
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
- Time series experiments and causal estimands: exact randomization tests and trading
- Toward Causal Inference With Interference
Cited in
(8)- Robust causal inference for incremental return on ad spend with randomized paired geo experiments
- Hypothesis testing in adaptively sampled data: ART to maximize power beyond \textit{iid }sampling
- Online Bootstrap Inference For Policy Evaluation In Reinforcement Learning
- Generalized fitted Q-iteration with clustered data
- Online statistical inference in decision-making with matrix context
- A Review of Design of Experiments Courses Offered to Undergraduate Students at American Universities
- A review of causal decision making
- A review of off-policy evaluation in reinforcement learning
This page was built for publication: Dynamic Causal Effects Evaluation in A/B Testing with a Reinforcement Learning Framework
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6077592)
