Martingale properties of an information-feedback loop (Q1104651)

This paper extends some of the previous authors' results to the case in which the data generated by the information feedback loop is numerical rather than categorical. Estimated average utility scores associated with each possible course of action are shown to be uniformly integrable martingale sequences. Strong convergence properties of these sequences are demonstrated.