Controlled semi-Markov models - the discounted case

DOI10.1016/0378-3758(89)90053-0zbMath0673.93089MaRDI QIDQ1121237

Rabi N. Bhattacharya, Mukul K. Majumdar

Publication date: 1989

Published in: Journal of Statistical Planning and Inference (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/0378-3758(89)90053-0

zbMATH Keywords

semi-Markov models; dynamic programming equations; stationary optimal policies

Mathematics Subject Classification ID

93E20: Optimal stochastic control

60K20: Applications of Markov renewal processes (reliability, queueing networks, etc.)

49J55: Existence of optimal solutions to problems involving randomness

Related Items

Recursive utility and the Ramsey problem, Two person zero-sum semi-Markov games with unknown holding times distribution on one side: A discounted payoff criterion, Duality and liquidity constraints under uncertainty, Controlled semi-Markov models under long-run average rewards, Average cost optimal policies for Markov control processes with Borel state space and unbounded costs, Stochastic optimal growth with bounded or unbounded utility and with bounded or unbounded shocks, Dynamic programming for non-additive stochastic objectives, A note on the economic management of inventory or resource under stochastic prices, Partially Observable Semi-Markov Games with Discounted Payoff, Unnamed Item

Cites Work

• Unnamed Item
• Unnamed Item
• Asymptotics of a class of Markov processes which are not in general irreducible
• Stochastic optimal control. The discrete time case
• Controlled jump processes
• Controlled semi-Markov models under long-run average rewards
• Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher
• Maximum Likelihood Estimation of Discrete Control Processes
• On Dynamic Programming with Unbounded Rewards
• Markovian Decision Processes with Compact Action Spaces
• Optimal Growth in a Stochastic Environment
• The Accumulation of Risky Capital: A Sequential Utility Analysis
• Discounted Dynamic Programming
• Optimal Growth in a Linear-Logarithmic Economy
• Contraction Mappings in the Theory Underlying Dynamic Programming
• Average cost semi-markov decision processes
• Uncertainty and Optimal Consumption Decisions