Finite state continuous time Markov decision processes with an infinite planning horizon

From MaRDI portal
Publication:2527603

DOI10.1016/0022-247X(68)90194-7zbMath0157.50301OpenAlexW2133991852MaRDI QIDQ2527603

Bruce L. Miller

Publication date: 1968

Published in: Journal of Mathematical Analysis and Applications (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1016/0022-247x(68)90194-7




Related Items

Continuous-time controlled Markov chains.Kolmogorov's Equations for Jump Markov Processes and Their Applications to Control ProblemsContinuous time markov decision processes with interventionsOptimality for controlled jump processes: A simple approachOptimization problems in chemical reactions using continuous-time Markov chainsSensitivitätsanalysen in entscheidungsmodellenSufficiency of Markov Policies for Continuous-Time Jump Markov Decision ProcessesOn a Continuously Discounted Vector Valued Markov Decision ProcessExplicit solution of the average-cost optimality equation for a pest-control problemDenumerable semi-Markov decision chains with small interest ratesAverage optimality for continuous-time Markov decision processes with a policy iteration approachAverage optimality inequality for continuous-time Markov decision processes in Polish spacesA Markov decision algorithm for optimal pest control through uniform catastrophesContinuous-time Markov decision processes with \(n\)th-bias optimality criteriaContinuous-time stochastic gamesOn the control of a truncated general immigration process through the introduction of a predatorControlled jump processesContinuous time control of Markov processes on an arbitrary state space: average return criterionVariance minimization for continuous-time Markov decision processes: two approachesNote on discounted continuous-time Markov decision processes with a lower bounding functionA survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)Average optimality for continuous-time Markov decision processes in Polish spacesContinuous-Time Markov Decision Processes with Unbounded Transition and Discounted-Reward RatesOn a set of optimal policies in continuous time Markovian decision problemOn the optimal control of a class of continuous time non-Markov decision processesBias optimality for multichain continuous-time Markov decision processesOptimal control of stationary Markov processesScheduling projects with stochastic activity duration to maximize expected net present valueComputation of optimal policies in discounted semi-Markov decision chainsOn the First Passage $g$-Mean-Variance Optimality for Discounted Continuous-Time Markov Decision ProcessesAn ergodic theorem for convex operatorsOn continuous-time discounted stochastic dynamic programmingEfficient approximation of optimal control for continuous-time Markov games



Cites Work