Interpretable dynamic treatment regimes
From MaRDI portal
Abstract: Precision medicine is currently a topic of great interest in clinical and intervention science. One way to formalize precision medicine is through a treatment regime, which is a sequence of decision rules, one per stage of clinical intervention, that map up-to-date patient information to a recommended treatment. An optimal treatment regime is defined as maximizing the mean of some cumulative clinical outcome if applied to a population of interest. It is well-known that even under simple generative models an optimal treatment regime can be a highly nonlinear function of patient information. Consequently, a focal point of recent methodological research has been the development of flexible models for estimating optimal treatment regimes. However, in many settings, estimation of an optimal treatment regime is an exploratory analysis intended to generate new hypotheses for subsequent research and not to directly dictate treatment to new patients. In such settings, an estimated treatment regime that is interpretable in a domain context may be of greater value than an unintelligible treatment regime built using "black-box" estimation methods. We propose an estimator of an optimal treatment regime composed of a sequence of decision rules, each expressible as a list of "if-then" statements that can be presented as either a paragraph or as a simple flowchart that is immediately interpretable to domain experts. The discreteness of these lists precludes smooth, i.e., gradient-based, methods of estimation and leads to non-standard asymptotics. Nevertheless, we provide a computationally efficient estimation algorithm, prove consistency of the proposed estimator, and derive rates of convergence. We illustrate the proposed methods using a series of simulation examples and application to data from a sequential clinical trial on bipolar disorder.
Recommendations
Cites work
- Q- and A-learning methods for estimating optimal dynamic treatment regimes
- Combining biomarkers to optimize patient treatment recommendations
- Cube root asymptotics
- Doubly robust learning for estimating individualized treatment with censored data
- Estimating individualized treatment rules using outcome weighted learning
- scientific article; zbMATH DE number 3860199 (Why is no real title available?)
- Interactive model building for Q-learning
- Introduction to algorithms.
- Learning with decision lists of data-dependent features
- New statistical learning methods for estimating optimal dynamic treatment regimes
- Optimal Dynamic Treatment Regimes
- Optimal global rates of convergence for nonparametric regression
- Optimal regression rates for SVMs using Gaussian kernels
- Optimal Structural Nested Models for Optimal Sequential Decisions
- Performance guarantees for individualized treatment rules
- Reader reaction to ``A robust method for estimating optimal treatment regimes by Zhang et al. (2012)
- Regularized outcome weighted subgroup identification for differential treatment effects
- Reinforcement learning strategies for clinical trials in nonsmall cell lung cancer
- Robust estimation of optimal dynamic treatment regimes for sequential treatment decisions
- Some results on Tchebycheffian spline functions and stochastic processes
- Tackling box-constrained optimization via a new projected quasi-Newton approach
- Tree-based methods for individualized treatment regimes
- Using decision lists to construct interpretable and parsimonious treatment regimes
Cited in
(43)- Generalization error bounds of dynamic treatment regimes in penalized regression-based learning
- Learning and predicting from dynamic models for COVID-19 patient monitoring
- On testing conditional qualitative treatment effects
- Predictive Bayesian inference and dynamic treatment regimes
- Using decision lists to construct interpretable and parsimonious treatment regimes
- Tree-based methods for individualized treatment regimes
- Rejoinder of ``Dynamic treatment regimes: technical challenges and applications
- Functional feature construction for individualized treatment regimes
- Quantile-optimal treatment regimes
- Reward ignorant modeling of dynamic treatment regimes
- Breaking the curse of nonregularity with subagging -- inference of the mean outcome under optimal treatment regimes
- Estimation and optimization of composite outcomes
- Dynamic treatment regimes. Statistical methods for precision medicine
- Learning when-to-treat policies
- Stochastic tree search for estimating optimal dynamic treatment regimes
- Selecting and ranking individualized treatment rules with unmeasured confounding
- Estimation of optimal individualized treatment rules using a covariate-specific treatment effect curve with high-dimensional covariates
- Resampling‐based confidence intervals for model‐free robust inference on optimal treatment regimes
- Dynamic Causal Effects Evaluation in A/B Testing with a Reinforcement Learning Framework
- Optimal Treatment Regimes: A Review and Empirical Comparison
- A multiagent reinforcement learning framework for off-policy evaluation in two-sided markets
- Transformation-Invariant Learning of Optimal Individualized Decision Rules with Time-to-Event Outcomes
- Statistically Efficient Advantage Learning for Offline Reinforcement Learning in Infinite Horizons
- Flexible inference of optimal individualized treatment strategy in covariate adjusted randomization with multiple covariates
- Treatment recommendation with distributional targets
- Deep spectral Q-learning with application to mobile health
- Monte Carlo sensitivity analysis for unmeasured confounding in dynamic treatment regimes
- On ``Reflections on the concept of optimality of single decision point treatment regimes
- Bayesian decision-theoretic methods for survival data using stochastic optimization
- A novel approach to assess dynamic treatment regimes embedded in a SMART with an ordinal outcome
- Personalized treatment selection using data from crossover designs with carry-over effects
- Robust method for optimal treatment decision making based on survival data
- Restricted sub-tree learning to estimate an optimal dynamic treatment regime using observational data
- Deep reinforcement learning for personalized treatment recommendation
- Ascertaining properties of weighting in the estimation of optimal treatment regimes under monotone missingness
- Testing stationarity and change point detection in reinforcement learning
- Efficient and robust transfer learning of optimal individualized treatment regimes with right-censored survival data
- Stage-aware learning for dynamic treatments
- Smoothed estimation on optimal treatment regime under semisupervised setting in randomized trials
- A review of causal decision making
- Impact of treatment effect heterogeneity on the estimation of individualized treatment rules for count outcomes
- A review of off-policy evaluation in reinforcement learning
- Dynamic Decision Making With Individualized Variable Selection
This page was built for publication: Interpretable dynamic treatment regimes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3121178)
