scientific article; zbMATH DE number 4001250
Suppose that a sequence of N independent trials is performed in one of two experiments \(e_ 0\) and \(e_ 1\). The outcome by performing \(e_ i\) is a value \(z_ i\) of a nonnegative random variable \(Z_ i\) with probability density function \(f(\cdot;u_ i)\) depending on the parameter \(u_ i\), \(i=0,1\). It is assumed that one of these parameters, \(u_ 1\), is known and \(u_ 0\) has a prior density function g(\(\cdot;x,y)\) with parameters x and y. If \(z_ i\) occurs, then the reward r is \(az_ i\) with \(a=(EZ_ 1)^{-1}\); at the next step r is discounted by a factor \(\beta\), \(0<\beta \leq 1\), \(i=0,1\). If the same experiment is performed on the next trial, no cost is incurred. By switching from \(e_ i\) to \(e_{1-i}\) on the next trial a cost \(c_{i,1-i}\), \(i=0,1\), is incured. If \(e_ i\) is performed on the last trial, the final reward obtained is \(b_ i\), \(i=0,1\). The goal is to maximize the total expected discounted reward. In this paper several properties of the critical value function which specifies the optimal strategy are derived. Maximum expected rewards under special conditions are also given, by using the critical value function where values can be numerically computed.
- Two armed bandits with change point in one arm
- scientific article; zbMATH DE number 3942837 (Why is no real title available?)
- scientific article; zbMATH DE number 4033530 (Why is no real title available?)
- scientific article; zbMATH DE number 4084786 (Why is no real title available?)
- On a sequential two-action decision model1with unbounded reward functions
- A Two-Armed Bandit Problem with possibility of no Information
- A TWO-ARMED BANDIT PROBLEM WITH ONE ARM KNOWN UNDER SOME CONSTRAINTS
- AN EXPONENTIAL TWO-ARMED BANDIT PROBLEM WITH ONE ARM KNOWN UNDER BATCH SAMPLING
- scientific article; zbMATH DE number 2098676 (Why is no real title available?)
- Optimal choice from known rewards with uncertain response
This page was built for publication:
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4727232)