Gittins indices in the dynamic allocation problem for diffusion processes
At each instant t one is allowed to choose a single project \(j=i(t)\in \{1,2,...,d\}\), which then evolves as a diffusion with local drift \(\mu_ j(x)\) and variance \(\sigma^ 2_ j(x)\). The stochastic control problem considered by the author is to maximize the expected discounted reward \(E\int^{\infty}_{0}e^{-at}h(i(t),x_{i(t)}(t))dt\). He presents a rigorous discussion of this problem and derives the optimal allocation policy \(\{i(t),t\geq 0\}\) in terms of so-called Gittins indices. Very explicit computations of the index are offered.
- General Gittins index processes in discrete time.
- Explicit Gittins Indices for a Class of Superdiffusive Processes
- Continuous-time allocation indices and their discrete-time approximation
- Dynamics of G-processes
- scientific article; zbMATH DE number 6193745
- Optimal stopping and Gittins' indices for piecewise deterministic evolution processes
- A generalized Gittins index for a Markov chain and its recursive calculation
- Diffusion approximation for \(GI/G/1\) controlled queues
- A Diffusion Approximation for the G/GI/n/m Queue
- On Gittins' index theorem in continuous time
- A martingale approach to minimal surfaces
- On variant reflected backward SDEs, with applications
- An optimal stopping time problem with time average cost in a bounded interval
- Discrete multiarmed bandits and multiparameter processes
- Applicable stochastic control: From theory to practice
- A dynamic allocation rule for the funding of projects and its long-run properties
- A common value experimentation with multiarmed bandits
- Optimal learning before choice
- Firm-specific training
- A stochastic representation theorem with applications to optimization and obstacle problems.
- Bandit and covariate processes, with finite or non-denumerable set of arms
- Optimal contract for outsourcing information acquisition
- Sensitivity of the gittins index in the contiuous time two-armed bandit problem
- On an Optimal Stopping Problem for Multi-Parameter Diffusion Processes
- Equivalent models for finite-fuel stochastic control
- Stochastic control of two-parameter processes application:the two-armed bandit problem
- Expected supremum representation of the value of a singular stochastic control problem
- Dynamic project selection
- General Gittins index processes in discrete time.
- The system of quasi-variational inequalities attached to the two-armed bandit problem
- A general theory of multiarmed bandit processes with constrained arm switches
- Optimality of threshold stopping times for diffusion processes
- Parameter dependent optimal thresholds, indifference levels and inverse optimal stopping problems
- Two-armed restless bandits with imperfect information: stochastic control and indexability
- scientific article; zbMATH DE number 6193745 (Why is no real title available?)
- Optimal dynamic risk taking
- Explicit Gittins Indices for a Class of Superdiffusive Processes
- Empirical Gittins index strategies with -explorations for multi-armed bandit problems
- Consumer strategy, vendor strategy and equilibrium in duopoly markets with production costs
- A stochastic differential equation driven by Poisson random measure and its application in a duopoly market
- An exact bandit model for the risk-volatility tradeoff
- Forward-looking experimentation of correlated alternatives
- On average cost stopping time problems
- Common value experimentation
This page was built for publication: Gittins indices in the dynamic allocation problem for diffusion processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q792001)
