scientific article; zbMATH DE number 5567885

zbMATH Open1170.60328MaRDI QIDQ3632091FDOQ3632091

Authors: Yoshinori Uchimura, Yuko Hara-Mimachi 

Publication date: 23 June 2009

Title of this publication is not available (Why is that?)

Recommendations

• The transformation method for continuous-time Markov decision processes
• An analysis of transient Markov decision processes
• scientific article; zbMATH DE number 2189772
• A convex analytic approach to Markov decision processes
• Continuous time markov decision processes with nonuniformly bounded transition rate: expected total rewards
• Analysis for some properties of discrete time Markov decision processes
• A fast algorithm for the transient reward distribution in continuous-time Markov chains

zbMATH Keywords

Markov chaindynamic programmingoptimal policy\(z\)-transformergodic Markov chain

Mathematics Subject Classification ID

Computational methods in Markov chains (60J22) Numerical analysis or methods applied to Markov chains (65C40) Numerical mathematical programming methods (65K05)

Cited In (2)

• Title not available (Why is that?)
• Improvement of Howard's policy iteration method for application to policies modeled by periodic Markov chains

Uses Software

• Scilab

This page was built for publication:

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3632091)