Diffusion approximations and nearly optimal maintenance policies for system breakdown and repair problems (Q1824952)

Statistically weakly distinguishable, but economically pretty different, states of deterioration of service systems are considered. Conditional probabilities of noised system states, given observed data, are weakly (by Skorokhod) approximated by those of a diffusion process in an appropriate filtration model of Markov chains. Under general setting, the problem of analysis of the service systems becomes a nonclassical one from the theory of queues in heavy traffic state. Using a classical model it is shown that the costs of \(\epsilon\)-optimal limit policies converge to the optimal one.