Off-Policy Estimation of Long-Term Average Outcomes With Applications to Mobile Health

DOI10.1080/01621459.2020.1807993zbMath1457.62055arXiv1912.13088OpenAlexW3081008408MaRDI QIDQ5857153

Predrag Klasnja, Peng Liao, Susan A. Murphy

Publication date: 30 March 2021

Published in: Journal of the American Statistical Association (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1912.13088

zbMATH Keywords

Markov decision processreinforcement learningsequential decision makingpolicy evaluation

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10) Learning and adaptive systems in artificial intelligence (68T05) Sequential statistical analysis (62L10) Causal inference from observational studies (62D20)

Related Items

A multiagent reinforcement learning framework for off-policy evaluation in two-sided markets, Off-Policy Confidence Interval Estimation with Confounded Markov Decision Process, Estimating Optimal Infinite Horizon Dynamic Treatment Regimes via pT-Learning, Statistical Learning for Individualized Asset Allocation, Off-policy evaluation in partially observed Markov decision processes under sequential ignorability, Projected state-action balancing weights for offline reinforcement learning, Batch policy learning in average reward Markov decision processes

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• A partially linear framework for massive heterogeneous data
• Statistical methods for dynamic treatment regimes. Reinforcement learning, causal inference, and personalized medicine
• Model selection in reinforcement learning
• Learning near-optimal policies with Bellman-residual minimization based fitted policy iteration and a single sample path
• Series estimation of semilinear models
• Linear least-squares algorithms for temporal difference learning
• The stratified micro-randomized trial design: sample size considerations for testing nested causal effects of time-varying treatments
• Support Vector Machines
• Marginal Mean Models for Dynamic Regimes
• Estimating Dynamic Treatment Regimes in Mobile Health Using V-Learning