Adaptive control of a partially observed controlled Markov chain
Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Observability (93B07) Adaptive control/observation systems (93C40) Stochastic systems in control theory (general) (93E03) Identification in stochastic control theory (93E12) Stochastic learning and adaptive control (93E35)
The paper deals with the control of a partially observable Markov chain arising in a binary replacement problem with long-run average cost. The transition probabilities of the Markov chain depend on the unknown failure rate of the system. It is shown that the certainty equivalent stochastic policy is self optimizing for any consistent estimator of the unknown parameter. A suitable estimator of this type is also provided. For the entire collection see [Zbl 0778.00021].
- On adaptive control of a partially observed Markov chain
- Adaptive control of a partially observed discrete time Markov process
- Analysis of an adaptive control scheme for a partially observed controlled Markov chain
- scientific article; zbMATH DE number 4172885
- On the adaptive control of a class of partially observed Markov decision processes
- On the Milito-Cruz adaptive control scheme for Markov chains
- Adaptive control of a partially observed discrete time Markov process
- Observer and control design in partially observable finite Markov chains
- Analysis of an adaptive control scheme for a partially observed controlled Markov chain
- scientific article; zbMATH DE number 4172885 (Why is no real title available?)
- scientific article; zbMATH DE number 3849083 (Why is no real title available?)
- Adaptive control of a partially observable stochastic system
- Adaptive control in the presence of markovian parameter jumps
- Adaptive Strategies for Certain Classes of Controlled Markov Processes
- scientific article; zbMATH DE number 9756 (Why is no real title available?)
- On adaptive control of a partially observed Markov chain
- Asymptotically Efficient Adaptive Choice of Control Laws inControlled Markov Chains
- On the adaptive control of a class of partially observed Markov decision processes
This page was built for publication: Adaptive control of a partially observed controlled Markov chain
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3140689)