Optimal control of Markov processes with age-dependent transition rates

DOI10.1007/S00245-012-9171-3zbMATH Open1269.93132OpenAlexW2006214844MaRDI QIDQ2391935FDOQ2391935

Authors: Subhamay Saha, Mrinal K. Ghosh 

Publication date: 5 August 2013

Published in: Applied Mathematics and Optimization (Search for Journal in Brave)

Abstract: We study optimal control of Markov processes with age-dependent transition rates. The control policy is chosen continuously over time based on the state of the process and its age. We study infinite horizon discounted cost and infinite horizon average cost problems. Our approach is via the construction of an equivalent semi-Markov decision process. We characterize the value function and optimal controls for both discounted and average cost cases.

Full work available at URL: https://arxiv.org/abs/1409.4028

Recommendations

• scientific article; zbMATH DE number 3941292
• Publication:4945343
• scientific article; zbMATH DE number 4128758
• Nonstationary continuous-time Markov control processes with discounted costs on infinite horizon
• scientific article; zbMATH DE number 3926784

zbMATH Keywords

value functionsemi-Markov decision processcontrol policyage-dependent transition ratesinfinite horizon discounted costaverage cost casesinfinite horizon average cost

Mathematics Subject Classification ID

Optimal stochastic control (93E20)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Continuous-time Markov decision processes. Theory and applications
• Title not available (Why is that?)
• A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
• Arbitrary state semi-Markov decision processes
• Average optimal policies in Markov decision drift processes with applications to a queueing and a replacement model
• Markov Decision Drift Processes; Conditions for Optimality Obtained by Discretization
• Title not available (Why is that?)
• Denumerable state semi-Markov decision processes with unbounded costs, average cost criterion
• Denumerable Undiscounted Semi-Markov Decision Processes with Unbounded Rewards
• Risk Minimizing Option Pricing in a Semi-Markov Modulated Market
• Discretization and Weak Convergence in Markov Decision Drift Processes
• Controlled jump processes
• Continuous-time controlled Markov chains.
• Title not available (Why is that?)

Cited In (4)

• Infinite horizon optimal control of mean-field delay system with semi-Markov modulated jump-diffusion processes
• An optimal threshold policy in applications of a two-state Markov process
• Title not available (Why is that?)
• Using age structure for a multi-stage optimal control model with random switching time

This page was built for publication: Optimal control of Markov processes with age-dependent transition rates

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2391935)