A problem of control of Markovian processes on a graph

DOI10.1023/A:1016707305032MaRDI QIDQ1407122zbMATH OpenFDO

Authors D. Massart

Publication date 9 September 2003

Published in Cybernetics and Systems Analysis (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1023/A:1016707305032

zbMATH Keywords

control of Markovian processesexistence of optimal strategiesMarkovian processes on a graphoptimal stationary nonrandomized strategies

Mathematics Subject Classification ID

Markov processes (60J99) Markov and semi-Markov decision processes (90C40)

Review text

The author is concerned with the control of Markovian processes on a graph under the assumption that the control can be transferred from one node to another neighboring node at any time. Sufficient conditions are given for the existence of optimal stationary nonrandomized Markovian strategies. For related work see the author [ibid. 35, No. 2, 307-313 (1999) resp. ibid. 1999, No. 2, 147-154 (1999; Zbl 0963.93075)].

Recommendations

• Control of a Markov process in a problem with constraints
• A partially observed control problem for Markov chains
• Controlled Markov Fields with Finite State Space on Graphs
• Local control of Markovian processes of interaction on a graph with a compact set of states
• Optimal control for diffusions on graphs
• Controlled semi-Markovian fields on a graph
• A graph-theoretic optimal control problem for terminating discrete event processes
• scientific article; zbMATH DE number 3926784
• Controlled Markov Chains, Graphs, and Hamiltonicity

Cited in

(13)

• Control problems for Markov processes with memory
• Local control of Markovian processes of interaction on a graph with a compact set of states
• Controlled semi-Markovian fields on a graph
• Linear control of live marked graphs
• Problems of control of Markovian processes with aftereffect (compact set of solutions)
• scientific article; zbMATH DE number 4174815 (Why is no real title available?)
• scientific article; zbMATH DE number 4042964 (Why is no real title available?)
• scientific article; zbMATH DE number 4070787 (Why is no real title available?)
• scientific article; zbMATH DE number 1944078 (Why is no real title available?)
• Optimal control for diffusions on graphs
• Optimal control on graphs: existence, uniqueness, and long-term behavior
• Controlled Markov Chains, Graphs, and Hamiltonicity
• Controlled Markov Fields with Finite State Space on Graphs

This page was built for publication: A problem of control of Markovian processes on a graph

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1407122)