Doubly robust policy evaluation and optimization

DOI10.1214/14-STS500zbMath1331.62059arXiv1503.02834OpenAlexW3098679278WikidataQ62763562 ScholiaQ62763562MaRDI QIDQ252797

Dumitru Erhan, Lihong Li, Miroslav Dudík, John Langford

Publication date: 4 March 2016

Published in: Statistical Science (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1503.02834

zbMATH Keywords

causal inferencecontextual banditsdoubly robust estimators

Mathematics Subject Classification ID

Sequential estimation (62L12) General considerations in statistical decision theory (62C05)

Related Items (19)

PAC-Bayesian lifelong learning for multi-armed bandits ⋮ Efficiently Breaking the Curse of Horizon in Off-Policy Evaluation with Double Reinforcement Learning ⋮ Unnamed Item ⋮ Augmented direct learning for conditional average treatment effect estimation with double robustness ⋮ A Single-Index Model With a Surface-Link for Optimizing Individualized Dose Rules ⋮ Constructing effective personalized policies using counterfactual inference from biased data sets with many features ⋮ A multiagent reinforcement learning framework for off-policy evaluation in two-sided markets ⋮ Constrained Bayesian optimization with noisy experiments ⋮ Importance sampling in reinforcement learning with an estimated behavior policy ⋮ Nonparametric Causal Effects Based on Incremental Propensity Score Interventions ⋮ Unnamed Item ⋮ Learning When-to-Treat Policies ⋮ Selecting and Ranking Individualized Treatment Rules With Unmeasured Confounding ⋮ Unnamed Item ⋮ Optimal policy trees ⋮ Toward theoretical understandings of robust Markov decision processes: sample complexity and asymptotics ⋮ Batch policy learning in average reward Markov decision processes ⋮ Doubly Robust Crowdsourcing ⋮ Doubly robust policy evaluation and optimization

Uses Software

• UCI-ml
• WEKA
• RCV1

Cites Work

• Unnamed Item
• Unnamed Item
• Doubly robust policy evaluation and optimization
• Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data
• On tail probabilities for martingales
• Improving predictive inference under covariate shift by weighting the log-likelihood function
• Semiparametric regression estimation in the presence of dependent censoring
• Some results on generalized difference estimation and generalized regression estimation for finite populations
• Estimation of Regression Coefficients When Some Regressors Are Not Always Observed
• Marginal Mean Models for Dynamic Regimes
• Optimal Dynamic Treatment Regimes
• A new approach to causal inference in mortality studies with a sustained exposure period—application to control of the healthy worker survivor effect
• The Nonstochastic Multiarmed Bandit Problem
• Semiparametric Efficiency in Multivariate Regression Models with Missing Data
• A Robust Method for Estimating Optimal Treatment Regimes
• Pattern-recognizing stochastic learning automata
• On model selection and model misspecification in causal inference
• A Generalization of Sampling Without Replacement From a Finite Universe
• Some aspects of the sequential design of experiments

This page was built for publication: Doubly robust policy evaluation and optimization