Some reward paths in semi-Markov models with stochastic selection of the transition probabilities

DOI10.1007/s11009-007-9027-5zbMath1128.60075MaRDI QIDQ2462654

Aleka A. Papadopoulou, George Tsaklidis

Publication date: 3 December 2007

Published in: Methodology and Computing in Applied Probability (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1007/s11009-007-9027-5

zbMATH Keywords

stochastic selection; semi-Markov process; rewards

Mathematics Subject Classification ID

60K15: Markov renewal processes, semi-Markov processes

Related Items

The multivariate non-homogeneous Markov manpower system in a departmental mobility framework, Performance analysis of second order semi-Markov chains: an application to wind energy production, The quality of life via semi Markov reward modelling, On the moments and the distribution of the cost of a semi Markov model for healthcare systems, Optimizing cost-effectiveness in a stochastic Markov manpower planning system under control by recruitment, Fuzzy semi-Markov migration process in credit risk, Some Results on Modeling Biological Sequences and Web Navigation with a Semi Markov Chain, The augmented semi-Markov system and its asymptotic behaviour, The Augmented Semi-Markov System in Continuous Time

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Unnamed Item
• Finite non-homogeneous semi-Markov processes: Theoretical and computational aspects
• A bibliography on semi-Markov processes
• Asymptotic behavior of nonhomogeneous semi-Markov systems
• A semi-Markov model for a multigrade population with Poisson recruitment
• A multivariate reward process defined on a semi-Markov process and its first-passage-time distributions
• Non-homogeneous semi-Markov systems and maintainability of the state sizes
• Exceptional Paper—Markov Renewal Theory: A Survey
• Reward processes for semi-Markov processes: asymptotic behaviour
• Partially observable semi-Markov reward processes
• Limit Theorems for Markov Renewal Processes
• The Integral of a Step Function Defined on a Semi-Markov Process
• On the Matrix Renewal Function for Markov Renewal Processes
• Markov renewal theory
• A process by chain dependent growth rate. part II: The ruin and ergodic problems
• On Average Reward Semi-Markov Decision Processes with a General Multichain Structure
• Control of asymptotic variability in non-homogeneous Markov systems