Randomized allocation with nonparametric estimation for contextual multi-armed bandits with delayed rewards

DOI10.1016/J.SPL.2020.108818MaRDI QIDQ2006767zbMATH OpenOpenAlexFDO

Authors Sakshi Arya, Yuhong Yang

Publication date 12 October 2020

Published in Statistics \& Probability Letters (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1902.00819

zbMATH Keywords

delayed rewardshistogram methodmulti-armed bandit with covariatesstrong consistency

Mathematics Subject Classification ID

Nonparametric regression and quantile regression (62G08) Sequential statistical design (62L05) Sequential estimation (62L12)

Abstract: We study a multi-armed bandit problem with covariates in a setting where there is a possible delay in observing the rewards. Under some mild assumptions on the probability distributions for the delays and using an appropriate randomization to select the arms, the proposed strategy is shown to be strongly consistent.

Recommendations

• Randomized allocation with nonparametric estimation for a multi-armed bandit problem with covariates
• Randomized allocation with arm elimination in a bandit problem with covariates
• Kernel estimation and model combination in a bandit problem with covariates
• The multi-armed bandit problem with covariates
• A non-parametric solution to the multi-armed bandit problem with covariates

Cites work

• A One-Armed Bandit Problem with a Concomitant Variable
• A Tutorial on Thompson Sampling
• Asymptotically efficient adaptive allocation rules
• Bandit algorithms
• Contextual bandits with similarity information
• Finite-time analysis of the multiarmed bandit problem
• scientific article; zbMATH DE number 4078557 (Why is no real title available?)
• scientific article; zbMATH DE number 3638998 (Why is no real title available?)
• On sequential decision problems with delayed observations
• One-armed bandit problems with covariates
• Prediction, Learning, and Games
• Randomized allocation with arm elimination in a bandit problem with covariates
• Randomized allocation with nonparametric estimation for a multi-armed bandit problem with covariates
• Regret analysis of stochastic and nonstochastic multi-armed bandit problems
• Reinforcement learning. An introduction
• Sequential Analysis with Delayed Observations
• Some aspects of the sequential design of experiments
• The multi-armed bandit problem with covariates

Cited in

(11)

• A bandit process with delayed responses
• Randomized allocation with nonparametric estimation for a multi-armed bandit problem with covariates
• Kernel estimation and model combination in a bandit problem with covariates
• Nonstochastic Multi-Armed Bandits with Graph-Structured Feedback
• Bernoulli multi-armed bandit problem under delayed feedback
• Randomized allocation with arm elimination in a bandit problem with covariates
• Delay-Adaptive Learning in Generalized Linear Contextual Bandits
• Adaptive Algorithm for Multi-Armed Bandit Problem with High-Dimensional Covariates
• Integrating multi-armed bandit with local search for MaxSAT
• Improving local search algorithm for pseudo Boolean optimization
• Adaptive smooth nonstationary bandits

This page was built for publication: Randomized allocation with nonparametric estimation for contextual multi-armed bandits with delayed rewards

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2006767)