Weak closed-loop solvability of stochastic linear quadratic optimal control problems of Markovian regime switching system (Q2045127)

From MaRDI portal





scientific article
Language Label Description Also known as
default for all languages
No label defined
    English
    Weak closed-loop solvability of stochastic linear quadratic optimal control problems of Markovian regime switching system
    scientific article

      Statements

      Weak closed-loop solvability of stochastic linear quadratic optimal control problems of Markovian regime switching system (English)
      0 references
      0 references
      0 references
      0 references
      11 August 2021
      0 references
      Assuming a quite general quadratic cost functional, the authors investigate the open-loop and weak closed-loop solvabilities of the optimal control problem for the \(n\)-dimensional process \(\{X_s; t\le s\le T\}\) solving \[ dX_s= [A(s,\alpha_s)X_s+ B(s,\alpha_s)u_s+ b_s]\,d_s+ [C(s,\alpha_s)\,X_s+ D(s,\alpha_s)u_s+ \sigma_s]\,dW_s, \] \(t\le s\le T\), \(X_t= x\), \(\alpha_t= I\), where \(\alpha\) is a Markov chain with a finite number of states, \(u\) the control process, \(A\) and \(C\) are \(n\times n\)-matrices, \(B\) and \(D\) are \(n\times m\)-matrices, \(b\) and \(a\) are \(n\)-dimensional vectors, and \(W\) is standard one-dimensional Brownian motion. Using the perturbation approach by \textit{J. Sun} et al. [SIAM J. Control Optim. 54, No. 5, 2274--2308 (2016; Zbl 1347.49033)], an alternative characterization of the open-loop solvability is given. Then, extending the result by \textit{H. Wang} et al. [Discrete Contin. Dyn. Syst. 39, No. 5, 2785--2805 (2019; Zbl 1410.93149)], it is shown how to obtain a weak closed-loop optimal strategy. Finally, the equivalence of open-loop solvability and weak closed-loop solvability is established, thus completing research by \textit{X. Zhang}, \textit{X. Li} and \textit{J. Xiong} [``Open-loop and closed-loop solvabilities for stochastic linear quadratic optimal control problems of Markov regime-switching system'', ESAIM: COCV 27, Article No. 69, 35 p. (2021; \url{doi:10.1051/cocv/2021066})]. A non-trivial example illustrating the results is provided.
      0 references
      stochastic linear quadratic optimal control
      0 references
      Markovian regime switching
      0 references
      Riccati equation
      0 references
      open-loop solvability
      0 references
      weak closed-loop solvability
      0 references
      0 references
      0 references
      0 references
      0 references

      Identifiers

      0 references
      0 references
      0 references
      0 references
      0 references
      0 references