On the adaptive control of a class of partially observed Markov decision processes

DOI10.1016/J.JMAA.2011.03.004zbMATH Open1215.93151OpenAlexW2098802268WikidataQ60167494 ScholiaQ60167494MaRDI QIDQ534716FDOQ534716

Authors: Shun-Pin Hsu, Ari Arapostathis 

Publication date: 10 May 2011

Published in: Journal of Mathematical Analysis and Applications (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/j.jmaa.2011.03.004

Recommendations

• scientific article; zbMATH DE number 9756
• Adaptive control of Markov processes with incomplete state information and unknown parameters
• scientific article; zbMATH DE number 440539
• Adaptive control of a partially observable stochastic system
• On adaptive control of a partially observed Markov chain

zbMATH Keywords

adaptive controlMarkov decision processesaverage-cost optimality

Mathematics Subject Classification ID

Markov and semi-Markov decision processes (90C40) Adaptive control/observation systems (93C40) Optimal stochastic control (93E20)

Cites Work

• Title not available (Why is that?)
• Stochastic optimal control. The discrete time case
• Non-negative matrices and Markov chains. 2nd ed
• Title not available (Why is that?)
• Discrete-Time Controlled Markov Processes with Average Cost Criterion: A Survey
• Bayesian adaptive control of discrete-time Markov processes with long-run average cost
• A limit theorem for partially observed Markov chains
• Analysis of an identification algorithm arising in the adaptive estimation of Markov chains
• Adaptive control of a partially observed discrete time Markov process
• On the existence of stationary optimal policies for partially observed MDPs under the long-run average cost criterion
• Analysis of an adaptive control scheme for a partially observed controlled Markov chain

Cited In (17)

• Ergodic and adaptive control of hidden Markov models
• Suboptimal Policies, with Bounds, for Parameter Adaptive Decision Processes
• Adaptive control of partially observable homogeneous processes with independent values
• Title not available (Why is that?)
• Adaptive control of a partially observable stochastic system
• Title not available (Why is that?)
• Title not available (Why is that?)
• Cross-entropic learning of a machine for the decision in a partially observable universe
• Nonparametric estimation and adaptive control in a class of finite Markov decision chains
• Analysis of an adaptive control scheme for a partially observed controlled Markov chain
• Title not available (Why is that?)
• Optimal control of infinite horizon partially observable decision processes modelled as generators of probabilistic regular languages
• Adaptive control of Markov processes with incomplete state information and unknown parameters
• Title not available (Why is that?)
• On adaptive control of a partially observed Markov chain
• Partially observable Markov decision process approximations for adaptive sensing
• Title not available (Why is that?)

This page was built for publication: On the adaptive control of a class of partially observed Markov decision processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q534716)