Multi-armed bandits with simple arms (Q1095862): Difference between revisions

An exact solution to certain multi-armed bandit problems with independent and simple arms is presented. An arm is simple if the observations associated with the arm have one of two distributions conditional on the value of an unknown dichotonomous parameter. The solution is obtained relating Gittins indices for the arms to ladder variables for associated random walks.