Infinite Horizon Optimization for Finite State Markov Chain
This work is concerned with infinite horizon control of a finite state Markov chain from the point of view of i) the long run average and ii) the overtaking optimality criterion. In the framework of the author, the sets of strategies and admissible controls are larger than in previous work. Moreover, two hypothesis are introduced and summarized here: (A) For every initial state i at time \(k=0\) and a distribution \(p=(p_ 1,...,p_ m)\) with \(p_ i>0\), \(1\leq i\leq n\), there is a control u for which the distribution of the process at time \(k=1\) is p. (B) Any two states i, j communicate after a finite number of steps under the action of a stationary admissible strategy and the set of admissible control values is convex and compact. The main results of the paper are: i) the existence and computation of a stationary optimal strategy with a minimal long run average cost is proved under A or B. ii) Unter B there is a stationary strategy which is overtaking optimal in the class of all stationary strategies. iii) Under A every stationary strategy with a minimal long-run average cost is in fact overtaking optimal for every initial state.
- scientific article; zbMATH DE number 4085565
- scientific article; zbMATH DE number 4122710
- Control of Markov Chains with Long-Run Average Cost Criterion: The Dynamic Programming Equations
- Overtaking and Almost-Sure Optimality for Infinite Horizon Markov Decision Processes
- scientific article; zbMATH DE number 1424150
- On finite long run costs and rewards in infinite Markov chains
- Infinite horizon optimality criteria for equipment replacement under technological change
- Approximate Fixed Point Iteration with an Application to Infinite Horizon Markov Decision Processes
- scientific article; zbMATH DE number 3962918 (Why is no real title available?)
- scientific article; zbMATH DE number 3965147 (Why is no real title available?)
- Overtaking Optimal Regulation and Tracking of Piecewise Diffusion Linear Systems
- Controlled Markov processes on the infinite planning horizon: Weighted and overtaking cost criteria
- scientific article; zbMATH DE number 4122710 (Why is no real title available?)
This page was built for publication: Infinite Horizon Optimization for Finite State Markov Chain
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3773809)