On-line sensitivity analysis of Markov chains

From MaRDI portal





The authors combine nominal and perturbed Markov chains in order to construct an augmented one. After eliminating the transient states, they transform this new chain into a reduced augmented chain with two properties: 1) Given the parameter change, the state probability perturbations may be expressed as simple linear combinations of the reduced augmented chain state probabilities. 2) The observability, i.e. the reduced augmented chain under certain conditions, can be efficiently estimated from the observations of the nominal Markov chain alone and this could be done on-line, i.e. while the nominal system is in operation. Applications to some queueing systems are included. The work is very interesting and useful.











This page was built for publication: On-line sensitivity analysis of Markov chains

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3820510)