Gittins indices in the dynamic allocation problem for diffusion processes (Q792001): Difference between revisions
From MaRDI portal
Added link to MaRDI item. |
Removed claim: reviewed by (P1447): Item:Q392776 |
||
Property / reviewed by | |||
Property / reviewed by: Vigirdas Mackevičius / rank | |||
Revision as of 05:01, 14 February 2024
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Gittins indices in the dynamic allocation problem for diffusion processes |
scientific article |
Statements
Gittins indices in the dynamic allocation problem for diffusion processes (English)
0 references
1984
0 references
At each instant t one is allowed to choose a single project \(j=i(t)\in \{1,2,...,d\}\), which then evolves as a diffusion with local drift \(\mu_ j(x)\) and variance \(\sigma^ 2_ j(x)\). The stochastic control problem considered by the author is to maximize the expected discounted reward \(E\int^{\infty}_{0}e^{-at}h(i(t),x_{i(t)}(t))dt\). He presents a rigorous discussion of this problem and derives the optimal ''allocation policy'' \(\{i(t),t\geq 0\}\) in terms of so-called Gittins indices. Very explicit computations of the index are offered.
0 references
stochastic control problem
0 references
allocation policy
0 references
Gittins indices
0 references