Controlled semi-Markov models - the discounted case
DOI10.1016/0378-3758(89)90053-0zbMATH Open0673.93089OpenAlexW2043883663MaRDI QIDQ1121237FDOQ1121237
Authors: Rabi Bhattacharya, Mukul Majumdar 
Publication date: 1989
Published in: Journal of Statistical Planning and Inference (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1016/0378-3758(89)90053-0
Recommendations
- Controlled semi-Markov models under long-run average rewards
- Semi-Markov control models with average costs
- scientific article; zbMATH DE number 825218
- Semi-Markov control processes with non-compact action spaces and discontinuous costs
- Solutions of semi-Markov control models with recursive discount rates and approximation by \(\epsilon\)-optimal policies.
Existence of optimal solutions to problems involving randomness (49J55) Applications of Markov renewal processes (reliability, queueing networks, etc.) (60K20) Optimal stochastic control (93E20)
Cites Work
- Stochastic optimal control. The discrete time case
- Title not available (Why is that?)
- Asymptotics of a class of Markov processes which are not in general irreducible
- Optimal Replacement of GMC Bus Engines: An Empirical Model of Harold Zurcher
- Discounted Dynamic Programming
- Maximum Likelihood Estimation of Discrete Control Processes
- Contraction Mappings in the Theory Underlying Dynamic Programming
- Average cost semi-markov decision processes
- Controlled jump processes
- Controlled semi-Markov models under long-run average rewards
- On Dynamic Programming with Unbounded Rewards
- The Accumulation of Risky Capital: A Sequential Utility Analysis
- Markovian Decision Processes with Compact Action Spaces
- Uncertainty and Optimal Consumption Decisions
- Title not available (Why is that?)
- Optimal Growth in a Stochastic Environment
- Optimal Growth in a Linear-Logarithmic Economy
Cited In (21)
- Dynamic programming for non-additive stochastic objectives
- A note on the economic management of inventory or resource under stochastic prices
- Partially Observable Semi-Markov Games with Discounted Payoff
- Solutions of semi-Markov control models with recursive discount rates and approximation by \(\epsilon\)-optimal policies.
- Title not available (Why is that?)
- Title not available (Why is that?)
- Semiparametric Bayesian estimation of dynamic discrete choice models
- Intergenerational long-term effects of preschool-structural estimates from a discrete dynamic programming model
- Recursive utility and the Ramsey problem
- Semi-Markov control processes with unknown holding times distribution under a discounted criterion
- Performance analysis for controlled semi-Markov systems with application to maintenance
- Stochastic optimal growth with bounded or unbounded utility and with bounded or unbounded shocks
- Controlled semi-Markov fields with graph-structured compact state space
- Optimal threshold probability and expectation in semi-Markov decision processes
- Duality and liquidity constraints under uncertainty
- Average cost optimal policies for Markov control processes with Borel state space and unbounded costs
- Two person zero-sum semi-Markov games with unknown holding times distribution on one side: A discounted payoff criterion
- Controlled semi-Markov models under long-run average rewards
- Arbitrary state semi-Markov decision processes
- Semi-additive functionals of semi-Markov processes and measure-valued Poisson equation
- On the Second Optimality Equation for Semi-Markov Decision Models
This page was built for publication: Controlled semi-Markov models - the discounted case
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1121237)
