Adaptive control of linear stochastic evolution systems

From MaRDI portal





The adaptive control of linear stochastic evolution systems is subdivided into the two problems of identification and control. A family of least squares estimates for the unknown parameters is constructed and it is shown to be strongly consistent. The family of averages of the quadratic cost functional at each positive time using the optimal stationary control based on the estimates of the unknown parameters is shown to converge almost surely to the optimal average cost that is obtained from the optimal stationary control using the true parameter values. The solution of the stationary Riccati equation for the control problem is shown to be a continuous function of the unknown parameters in the uniform operator topology. This continuity shows that the control based on the solution of the stationary Riccati equation with the true parameter values replaced by their least squares estimates, the certainty equivalence control policy, has the self tuning property. Furthermore, this continuity property of the solution of the stationary Riccati equation provides a suitable stability property for the solution of the controlled linear stochastic evolution system that is used crucially in the verification of the self optimizing property.











This page was built for publication: Adaptive control of linear stochastic evolution systems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3978286)