Q-learning with censored data
From MaRDI portal
Abstract: We develop methodology for a multistage decision problem with flexible number of stages in which the rewards are survival times that are subject to censoring. We present a novel Q-learning algorithm that is adjusted for censored data and allows a flexible number of stages. We provide finite sample bounds on the generalization error of the policy learned by the algorithm, and show that when the optimal Q-function belongs to the approximation space, the expected survival time for policies obtained by the algorithm converges to that of the optimal policy. We simulate a multistage clinical trial with flexible number of stages and apply the proposed censored-Q-learning algorithm to find individualized treatment regimens. The methodology presented in this paper has implications in the design of personalized medicine trials in cancer and in other life-threatening diseases.
Recommendations
Cites work
- scientific article; zbMATH DE number 3126094 (Why is no real title available?)
- scientific article; zbMATH DE number 1304261 (Why is no real title available?)
- A Dvoretzky-Kiefer-Wolfowitz type inequality for the Kaplan-Meier estimator.
- A generalization error for Q-learning
- An exponential bound for Cox regression
- Association, causation, and marginal structural models.
- Causal effect models for realistic individualized treatment and intention to treat rules
- Causal inference on the difference of the restricted mean lifetime between two groups
- Demystifying Optimal Dynamic Treatment Regimes
- Estimation of Regression Coefficients When Some Regressors Are Not Always Observed
- Estimation of survival distributions of treatment policies in two-stage randomization designs in clinical trials
- Estimation of survival quantiles in two-stage randomization designs
- Feature-based methods for large scale dynamic programming
- Introduction to empirical processes and semiparametric inference
- Neural Network Learning
- On an exponential bound for the Kaplan-Meier estimator
- Optimal Dynamic Treatment Regimes
- Optimal Structural Nested Models for Optimal Sequential Decisions
- Q-learning with censored data
- Reinforcement learning strategies for clinical trials in nonsmall cell lung cancer
- Restricted Mean Life with Covariates: Modification and Extension of a Useful Survival Analysis Method
- Semiparametric efficient estimation of survival distributions in two-stage randomisation designs in clinical trials with censored data
- Support Vector Machines
- Support vector censored quantile regression under random censoring
- The Kaplan–Meier Estimator as an Inverse-Probability-of-Censoring Weighted Average
- Weak convergence and empirical processes. With applications to statistics
- \({\mathcal Q}\)-learning
Cited in
(35)- Reinforcement learning strategies for clinical trials in nonsmall cell lung cancer
- Estimation for optimal treatment regimes with survival data under semiparametric model
- Constructing dynamic treatment regimes with shared parameters for censored data
- Functional feature construction for individualized treatment regimes
- Quantifying treatment effects using the personalized chance of longer survival
- Nearly Dimension-Independent Sparse Linear Bandit over Small Action Spaces via Best Subset Selection
- Robust method for optimal treatment decision making based on survival data
- Ascertaining properties of weighting in the estimation of optimal treatment regimes under monotone missingness
- Learning Non-monotone Optimal Individualized Treatment Regimes
- Privacy-preserving estimation of an optimal individualized treatment rule: a case study in maximizing time to severe depression-related outcomes
- A cure-rate model for Q-learning: estimating an adaptive immunosuppressant treatment strategy for allogeneic hematopoietic cell transplant patients
- Incorporating patient preferences into estimation of optimal individualized treatment rules
- Multicategory Angle-Based Learning for Estimating Optimal Dynamic Treatment Regimes With Censored Data
- Dynamic treatment regimes using Bayesian additive regression trees for censored outcomes
- Assessing quantile prediction with censored quantile regression models
- Threshold Estimation in Proportional Mean Residual Life Model
- Transformation-Invariant Learning of Optimal Individualized Decision Rules with Time-to-Event Outcomes
- Adaptive contrast weighted learning for multi-stage multi-treatment decision-making
- Finite sample variance estimation for optimal dynamic treatment regimes of survival outcomes
- Optimal dynamic treatment regimes with survival endpoints: introducing DWSurv in the R package DTRreg
- Semiparametric single-index models for optimal treatment regimens with censored outcomes
- Quantile-optimal treatment regimes
- Multi-threshold proportional hazards model and subgroup identification
- \(i\)Fusion: individualized fusion learning
- Reflections on the concept of optimality of single decision point treatment regimes
- Flexible inference of optimal individualized treatment strategy in covariate adjusted randomization with multiple covariates
- A General Framework for Subgroup Detection via One-Step Value Difference Estimation
- Estimating optimal dynamic treatment regimes with survival outcomes
- Adaptive Algorithm for Multi-Armed Bandit Problem with High-Dimensional Covariates
- Optimal Treatment Regimes: A Review and Empirical Comparison
- Q-learning with censored data
- Doubly robust estimation of optimal dynamic treatment regimes with multicategory treatments and survival outcomes
- Multithreshold change plane model: estimation theory and applications in subgroup identification
- Multi-Armed Angle-Based Direct Learning for Estimating Optimal Individualized Treatment Rules With Various Outcomes
- Fairness-Oriented Learning for Optimal Individualized Treatment Rules
This page was built for publication: Q-learning with censored data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q450048)
