Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

arXiv1803.05121MaRDI QIDQ6299031FDOQ6299031

Huanshui Zhang, Wei Wang, Chunyan Han, Hongdan Li

Publication date: 13 March 2018

Abstract: This paper mainly investigates the optimal control and stabilization problems for linear discrete-time Markov jump systems. The general case for the finite-horizon optimal controller is considered, where the input weighting matrix in the performance index is just required to be positive semi-definite. The necessary and sufficient condition for the existence of the optimal controller in finite-horizon is given explicitly from a set of coupled difference Riccati equations (CDRE). One of the key techniques is to solve the forward and backward stochastic difference equation (FDSDE) which is obtained by the maximum principle. As to the infinite-horizon case, we establish the necessary and sufficient condition to stabilize the Markov jump linear system in the mean square sense. It is shown that the Markov jump linear system is stabilizable under the optimal controller if and only if the associated couple algebraic Riccati equation (CARE) has a unique positive solution. Meanwhile, the optimal controller and optimal cost function in infinite-horizon case are expressed explicitly.

This page was built for publication: Linear Quadratic Optimal Control and Stabilization for Discrete-time Markov Jump Linear Systems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6299031)