scientific article; zbMATH DE number 5567885

MaRDI QIDQ3632091zbMATH OpenFDO

Authors Yoshinori Uchimura, Yuko Hara-Mimachi

Publication date 23 June 2009

zbMATH Keywords

Markov chaindynamic programmingoptimal policy\(z\)-transformergodic Markov chain

Mathematics Subject Classification ID

Computational methods in Markov chains (60J22) Numerical analysis or methods applied to Markov chains (65C40) Numerical mathematical programming methods (65K05)

Recommendations

• The transformation method for continuous-time Markov decision processes
• An analysis of transient Markov decision processes
• scientific article; zbMATH DE number 2189772
• A convex analytic approach to Markov decision processes
• Continuous time markov decision processes with nonuniformly bounded transition rate: expected total rewards
• Analysis for some properties of discrete time Markov decision processes
• A fast algorithm for the transient reward distribution in continuous-time Markov chains

Cited in

(2)

• Improvement of Howard's policy iteration method for application to policies modeled by periodic Markov chains
• scientific article; zbMATH DE number 4112415 (Why is no real title available?)

Describes a project that uses

Uses Software

• Scilab

This page was built for publication:

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3632091)