scientific article; zbMATH DE number 4001250

From MaRDI portal
Publication:4727232





Suppose that a sequence of N independent trials is performed in one of two experiments \(e_ 0\) and \(e_ 1\). The outcome by performing \(e_ i\) is a value \(z_ i\) of a nonnegative random variable \(Z_ i\) with probability density function \(f(\cdot;u_ i)\) depending on the parameter \(u_ i\), \(i=0,1\). It is assumed that one of these parameters, \(u_ 1\), is known and \(u_ 0\) has a prior density function g(\(\cdot;x,y)\) with parameters x and y. If \(z_ i\) occurs, then the reward r is \(az_ i\) with \(a=(EZ_ 1)^{-1}\); at the next step r is discounted by a factor \(\beta\), \(0<\beta \leq 1\), \(i=0,1\). If the same experiment is performed on the next trial, no cost is incurred. By switching from \(e_ i\) to \(e_{1-i}\) on the next trial a cost \(c_{i,1-i}\), \(i=0,1\), is incured. If \(e_ i\) is performed on the last trial, the final reward obtained is \(b_ i\), \(i=0,1\). The goal is to maximize the total expected discounted reward. In this paper several properties of the critical value function which specifies the optimal strategy are derived. Maximum expected rewards under special conditions are also given, by using the critical value function where values can be numerically computed.











This page was built for publication:

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4727232)