Practical criterion for uniqueness of Q-processes

DOI10.3969/J.ISSN.1001-4268.2015.02.010zbMATH Open1340.60122arXiv1503.02119MaRDI QIDQ3462865FDOQ3462865

Authors: Mu-Fa Chen 

Publication date: 15 January 2016

Abstract: The note begins with a short story on seeking for a practical sufficiency theorem for the uniqueness of time-continuous Markov jump processes, starting around 1977. The general result was obtained in 1985 for the processes with general state spaces. To see the sufficient conditions are sharp, a dual criterion for non-uniqueness was obtained in 1991. This note is restricted however to the discrete state space (then the processes are called $Q$-processes or Markov chains), for which the sufficient conditions just mentioned are showing at the end of the note to be necessary. Some examples are included to illustrate that the sufficient conditions either for uniqueness or for non-uniqueness are not only powerful but also sharp.

Full work available at URL: https://arxiv.org/abs/1503.02119

Recommendations

• scientific article; zbMATH DE number 810397
• scientific article; zbMATH DE number 1522462
• scientific article; zbMATH DE number 3919490
• The criterion for uniqueness of \(Q\)-processes and related problems
• A dual approach and its applications in related problems with uniqueness of \(Q\)-processes

zbMATH Keywords

Markov chainMarkov jump processuniquenesscriterion

Mathematics Subject Classification ID

Continuous-time Markov processes on discrete state spaces (60J27)

Cited In (10)

• Criterion for a chain of \(\sigma\)-processes to be the composition of triangular chains
• Title not available (Why is that?)
• A dual approach and its applications in related problems with uniqueness of \(Q\)-processes
• Title not available (Why is that?)
• Optimality of mixed policies for average continuous-time Markov decision processes with constraints
• Note on discounted continuous-time Markov decision processes with a lower bounding function
• On the extinction-extinguishing dichotomy for a stochastic Lotka-Volterra type population dynamical system
• On the nonexplosion and explosion for nonhomogeneous Markov pure jump processes
• Perturbations of continuous-time Markov chains
• Existence and Uniqueness of Q-Processes with a Given Finite mu-Invariant Measure

This page was built for publication: Practical criterion for uniqueness of \(Q\)-processes

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3462865)