scientific article; zbMATH DE number 3924660
Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Diffusion processes (60J60) Markov renewal processes, semi-Markov processes (60K15) Applications of Markov renewal processes (reliability, queueing networks, etc.) (60K20) Reliability, availability, maintenance, inspection in operations research (90B25) Markov and semi-Markov decision processes (90C40) Adaptive control/observation systems (93C40) Optimal stochastic control (93E20)
[For the entire collection see Zbl 0568.00025.] The paper surveys the recent investigations of the following procedure to control Markov processes with unknown parameters: the parameters are continuously estimated from the observed trajectory, the optimal stationary policy corresponding to the estimates is found, and the control parameter is adjusted to the value prescribed by that policy. The basic ideas are explained by the problem of preventive renewals. Then finite state Markov processes, Markov chains and diffusion processes are considered.
- Ergodic and adaptive control of nearest-neighbor motions
- Sample complexity for Markov chain self-tuner
- Recursive self-tuning control of finite Markov chains
- scientific article; zbMATH DE number 5004261 (Why is no real title available?)
- An optimal sequential policy for controlling a Markov renewal process
- scientific article; zbMATH DE number 3901772 (Why is no real title available?)
- scientific article; zbMATH DE number 4003941 (Why is no real title available?)
- scientific article; zbMATH DE number 4042964 (Why is no real title available?)
- Adaptive service rate control of an M/M/1 queue with server breakdowns
This page was built for publication:
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3699592)