Multi-armed bandit models for the optimal design of clinical trials: benefits and challenges

DOI10.1214/14-STS504zbMath1332.62267arXiv1507.08025OpenAlexW3125733173WikidataQ38829437 ScholiaQ38829437MaRDI QIDQ254442

Jack Bowden, Sofía S. Villar, James M. S. Wason

Publication date: 8 March 2016

Published in: Statistical Science (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/1507.08025

zbMATH Keywords

Gittins indexmulti-armed banditpatient allocationresponse adaptive proceduresWhittle index

Mathematics Subject Classification ID

Applications of statistics to biology and medical sciences; meta analysis (62P10) Optimal statistical designs (62K05) Medical applications (general) (92C50)

Related Items (28)

A simple solution to the inadequacy of asymptotic likelihood-based inference for response-adaptive clinical trials: likelihood-based inference for RAR trials ⋮ Bayesian adaptive bandit-based designs using the Gittins index for multi-armed trials with normally distributed endpoints ⋮ Response adaptive designs for phase II trials with binary endpoint based on context-dependent information measures ⋮ Generalisations of a Bayesian decision-theoretic randomisation procedure and the impact of delayed responses ⋮ Bandit Theory: Applications to Learning Healthcare Systems and Clinical Trials ⋮ A Bayesian adaptive design for clinical trials in rare diseases ⋮ Dynamic Programming for Response-Adaptive Dose-Finding Clinical Trials ⋮ Optimal activation of halting multi‐armed bandit models ⋮ A novel statistical test for treatment differences in clinical trials using a response‐adaptive forward‐looking Gittins Index Rule ⋮ Index policy for multiarmed bandit problem with dynamic risk measures ⋮ Testing indexability and computing Whittle and Gittins index in subcubic time ⋮ Rejoinder: response-adaptive randomization in clinical trials ⋮ Unnamed Item ⋮ Online Debiasing for Adaptively Collected High-Dimensional Data With Applications to Time Series Analysis ⋮ Response-adaptive randomization in clinical trials: from myths to practical considerations ⋮ Empirical Gittins index strategies with \(\varepsilon\)-explorations for multi-armed bandit problems ⋮ Multi-armed linear bandits with latent biases ⋮ Using biomarkers to allocate patients in a response-adaptive clinical trial ⋮ BANDIT STRATEGIES EVALUATED IN THE CONTEXT OF CLINICAL TRIALS IN RARE LIFE-THREATENING DISEASES ⋮ Simple Bayesian Algorithms for Best-Arm Identification ⋮ An Approximation Approach for Response-Adaptive Clinical Trial Design ⋮ Ballooning multi-armed bandits ⋮ Mathematical models for immunology: current state of the art and future research directions ⋮ A revised approach for risk-averse multi-armed bandits under CVaR criterion ⋮ Covariate-adjusted response-adaptive randomization for multi-arm clinical trials using a modified forward looking Gittins index rule ⋮ A Markov decision process for response-adaptive randomization in clinical trials ⋮ On the Bias, Risk, and Consistency of Sample Means in Multi-armed Bandits ⋮ Whittle index based Q-learning for restless bandits with average reward

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Asymptotically efficient adaptive allocation rules
• Arm-acquiring bandits
• Algorithms for evaluating the dynamic allocation index
• On the Gittins index for multiarmed bandits
• The learning component of dynamic allocation indices
• Celebrating 70: an interview with Don Berry
• Restless bandits, partial conservation laws and indexability
• A generalized Dunnett test for multi-arm multi-stage clinical studies with treatment selection
• A (2/3)n³ Fast-Pivoting Algorithm for the Gittins Index and Optimal Stopping of a Markov Chain
• Computing a Classic Index for Finite-Horizon Bandits
• Multi‐Armed Bandit Allocation Indices
• INDEXABILITY OF BANDIT PROBLEMS WITH RESPONSE DELAYS
• Extensions of the multiarmed bandit problem: The discounted case
• The Search for Optimality in Clinical Trials
• Linear Programming for Finite State Multi-Armed Bandit Problems
• On an index policy for restless bandits
• On the optimal allocation of two or more treatments in a controlled clinical trial
• Conservation Laws, Extended Polymatroids and Multiarmed Bandit Problems; A Polyhedral Approach to Indexable Systems
• Ethics, data-dependent designs, and the strategy of clinical trials: time to start learning-as-we-go?
• On the Theory of Dynamic Programming
• Some aspects of the sequential design of experiments
• Finite-time analysis of the multiarmed bandit problem

This page was built for publication: Multi-armed bandit models for the optimal design of clinical trials: benefits and challenges