Average cost Markov control processes: Stability with respect to the Kantorovich metric (Q836860): Difference between revisions

Perturbations of a discrete-time Markov control process are studied on a general state space. The amount of perturbation is measured by means of the Kantorovich distance. It is assumed that an average (per unit of time on the infinite horizon) optimal control policy can be found for the perturbed (supposedly known) process, and that it is used to control the original (unperturbed) process. The one-stage cost is not assumed to be bounded. Under Lyapunov-like conditions, the authors find upper bounds for the average cost excess when such an approximation is used in place of the optimal (unknown) control policy. As an application of the inequalities found, the approximation by relevant empirical distributions are considered. The results are illustrated by estimating the stability of a simple autoregressive control process. Some examples of unstable processes are also provided.