Controlled Markov Chains, Graphs, and Hamiltonicity

DOI10.1561/0900000003MaRDI QIDQ5459900zbMATH OpenOpenAlexFDO

Authors Jerzy Filar

Publication date 30 April 2008

Published in Foundations and Trends® in Stochastic Systems (Search for Journal in Brave)

Full work available at URL https://doi.org/10.1561/0900000003

Mathematics Subject Classification ID

Paths and cycles (05C38) Combinatorial optimization (90C27) Markov and semi-Markov decision processes (90C40)

Recommendations

• Markov chains and optimality of the Hamiltonian cycle
• Hamiltonian Cycles and Markov Chains
• A problem of control of Markovian processes on a graph
• Phase transitions for controlled Markov chains on infinite graphs
• Controlled Markov Fields with Finite State Space on Graphs
• scientific article; zbMATH DE number 49674
• Markov chains, Hamiltonian cycles and volumes of convex bodies
• On transition matrices of Markov chains corresponding to Hamiltonian cycles
• Controlled semi-Markovian fields on a graph
• Hamiltonian Cycles and Singularly Perturbed Markov Chains

Cited in

(10)

• A problem of control of Markovian processes on a graph
• Markov chains, Hamiltonian cycles and volumes of convex bodies
• Hamiltonian cycle curves in the space of discounted occupational measures
• On the fastest finite Markov processes
• Constrained discounted Markov decision processes and Hamiltonian cycles.
• On transition matrices of Markov chains corresponding to Hamiltonian cycles
• Hamiltonian Cycles and Markov Chains
• The buck-passing game
• Hamiltonian cycle problem and Markov chains.
• A hybrid simulation-optimization algorithm for the Hamiltonian cycle problem

This page was built for publication: Controlled Markov Chains, Graphs, and Hamiltonicity

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5459900)