Continuously Discounted Markov Decision Model with Countable State and Action Space
From MaRDI portal
Publication:5643861
DOI10.1214/aoms/1177693321zbMath0234.93027OpenAlexW2079291782MaRDI QIDQ5643861
Publication date: 1971
Published in: The Annals of Mathematical Statistics (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1214/aoms/1177693321
Optimal stochastic control (93E20) Markov and semi-Markov decision processes (90C40) Applications of Markov renewal processes (reliability, queueing networks, etc.) (60K20)
Related Items
Continuous-time controlled Markov chains. ⋮ Kolmogorov's Equations for Jump Markov Processes and Their Applications to Control Problems ⋮ Continuous time markov decision processes with interventions ⋮ Optimality for controlled jump processes: A simple approach ⋮ Effects of regulatory delays and uncertainty on pricing decisions ⋮ Sufficiency of Markov Policies for Continuous-Time Jump Markov Decision Processes ⋮ On a Continuously Discounted Vector Valued Markov Decision Process ⋮ A two-person zero-sum Markov game with a stopped set ⋮ Discounted continuous-time Markov decision processes with unbounded rates and randomized history-dependent policies: the dynamic programming approach ⋮ Discounted continuous-time constrained Markov decision processes in Polish spaces ⋮ Optimal control of semi-Markov processes with a backward stochastic differential equations approach ⋮ Discrete type shock semi-markov decision processes with borel state space ⋮ Continuous-time Markov decision processes with state-dependent discount factors ⋮ The first arrival model of continuous time Markovian decision programming -- the discounted rate is 0 ⋮ Continuous-time stochastic games ⋮ Continuous-time markov decision processes with nonzero terminal reward ⋮ Controlled jump processes ⋮ Continuous time Markovian decision processes average return criterion ⋮ Finite-horizon optimality for continuous-time Markov decision processes with unbounded transition rates ⋮ A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder) ⋮ Continuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward Rates ⋮ On the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision Processes ⋮ On continuous-time discounted stochastic dynamic programming ⋮ Essential stationary equilibria of mean field games with finite state and action space
