Optimistic Gittins Indices

DOI10.1287/opre.2021.2207OpenAlexW4214544489MaRDI QIDQ5060515

Vivek Francis Farias, Eli Gutin

Publication date: 10 January 2023

Published in: Operations Research (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1287/opre.2021.2207

zbMATH Keywords

online learningGittins indexmultiarmed bandits

Mathematics Subject Classification ID

Statistics (62-XX) Probability theory and stochastic processes (60-XX)

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Asymptotically efficient adaptive allocation rules
• Adaptive treatment allocation and the multi-armed bandit problem
• On the Gittins index for multiarmed bandits
• A short proof of the Gittins index theorem
• Optimal learning and experimentation in bandit problems.
• On Bayesian index policies for sequential resource allocation
• Finite state multi-armed bandit problems: Sensitive-discount, average-reward and average-overtaking optimality
• A (2/3)n³ Fast-Pivoting Algorithm for the Gittins Index and Optimal Stopping of a Markov Chain
• Thompson Sampling: An Asymptotically Optimal Finite-Time Analysis
• On Sequential Designs for Maximizing the Sum of $n$ Observations
• Extensions of the multiarmed bandit problem: The discounted case
• The Multi-Armed Bandit Problem: Decomposition and Computation
• Sample mean based index policies by O(log n) regret for the multi-armed bandit problem
• Conservation Laws, Extended Polymatroids and Multiarmed Bandit Problems; A Polyhedral Approach to Indexable Systems
• Learning to Optimize via Information-Directed Sampling
• Technical Note—A Note on the Equivalence of Upper Confidence Bounds and Gittins Indices for Patient Agents
• Monotone Convergence of Binomial Probabilities and a Generalization of Ramanujan's Equation
• Some aspects of the sequential design of experiments
• Finite-time analysis of the multiarmed bandit problem

This page was built for publication: Optimistic Gittins Indices