Kolmogorov forward equation and explosiveness in countable state Markov processes
From MaRDI portal
Publication:333068
DOI10.1007/S10479-012-1262-7zbMATH Open1348.90621OpenAlexW2098494535MaRDI QIDQ333068FDOQ333068
Authors: F. M. Spieksma
Publication date: 9 November 2016
Published in: Annals of Operations Research (Search for Journal in Brave)
Full work available at URL: https://doi.org/10.1007/s10479-012-1262-7
Recommendations
- Countable state Markov processes: non-explosiveness and moment function
- Kolmogorov's equations for jump Markov processes with unbounded jump rates
- On solutions of Kolmogorov's equations for nonhomogeneous jump Markov processes
- Kolmogorov's equations for jump Markov processes and their applications to control problems
- A note on the convergence of probability functions of Markov chains
Cites Work
- Markov chains and stochastic stability
- Title not available (Why is that?)
- Title not available (Why is that?)
- Continuous-time Markov decision processes. Theory and applications
- Stability of Markovian processes III: Foster–Lyapunov criteria for continuous-time processes
- Title not available (Why is that?)
- Continuous-time Markov chains. An applications-oriented approach
- Title not available (Why is that?)
- The transformation method for continuous-time Markov decision processes
- On Transient Markov Processes with a Countable Number of States and Stationary Transition Probabilities
- Average, Sensitive and Blackwell Optimal Policies in Denumerable Markov Decision Chains with Unbounded Rewards
- Recurrence Conditions for Average and Blackwell Optimality in Denumerable State Markov Decision Chains
- On the Relation Between Recurrence and Ergodicity Properties in Denumerable Markov Decision Chains
Cited In (10)
- Kolmogorov's equations for jump Markov processes and their applications to control problems
- On Forward and Backward Kolmogorov Equations for Pure Jump Markov Processes and Their Generalizations
- On structural properties of the value function for an unbounded jump Markov process with an application to a processor sharing retrial queue
- Computing continuous-time Markov chains as transformers of unbounded observables
- Note on discounted continuous-time Markov decision processes with a lower bounding function
- Subgeometric ergodicity analysis of continuous-time Markov chains under random-time state-dependent Lyapunov drift conditions
- On the nonexplosion and explosion for nonhomogeneous Markov pure jump processes
- Countable state Markov processes: non-explosiveness and moment function
- Countable state Markov decision processes with unbounded jump rates and discounted cost: optimality equation and approximations
- Kolmogorov's equations for jump Markov processes with unbounded jump rates
This page was built for publication: Kolmogorov forward equation and explosiveness in countable state Markov processes
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q333068)