Optimal stopping and free boundary characterizations for some Brownian control problems (Q2378635)
From MaRDI portal
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Optimal stopping and free boundary characterizations for some Brownian control problems |
scientific article |
Statements
Optimal stopping and free boundary characterizations for some Brownian control problems (English)
0 references
13 January 2009
0 references
A singular stochastic control problem with state constraints in \(\mathbb R_{+}^2\) is studied for the state process \( X(t)=x+B(t)+Y(t)\) where \(x \in \mathbb R_{+}^2, t \geq 0 \), \(B\) is a two dimensional Brownian motion with a nondegenerate covariance matrix and the control \(Y\) is a nondecreasing, right continuous with left limits adapted process. The value function \(V(x)\) is the infimum of \(J(x,Y)= E \int_0^{\infty}e^{- \gamma t} l(X(t)) \,dt\) over all admissible controls, where \( l(z_1,z_2)\) equals \(\langle(\alpha_1,\alpha_2), (z_1,z_2)\rangle\) (respectively \(\langle(\beta_1, \beta_2),(z_1,z_2)\rangle\)) if \(z_2 \geq c z_1\) (respectively \(z_2 < c z_1\)), \((\alpha_1, \alpha_2) \in \mathbb R^2\), \((\beta_1, \beta_2) \in \mathbb R^2\) and \(c>0\). The \(C^1 \)-property of \( V(x)\) is proved in Section 3. In Section 4, the authors introduce an optimal stopping problem whose the value function equals a directional derivative of \(V(x)\). The associated free boundary is introduced in Section 5 to show that an optimally controlled process with \(\alpha_1 < 0\), \(\alpha_2 > 0\), \(\beta_1 > 0\), \(\beta_2 \geq 0\) is a Brownian motion in a no-action region with reflection at the free boundary.
0 references
singular control with state constrains
0 references
Brownian control problem
0 references
optimal stopping
0 references
\(\epsilon\)-optimal stopping time
0 references
free boundary
0 references
viscosity solutions
0 references
Hamilton-Jacobi-Bellman equations
0 references
0 references
0 references
0 references
0 references