Semi-markov decision problems and performance sensitivity analysis

DOI10.1109/TAC.2003.811252zbMath1364.90344OpenAlexW2123334156MaRDI QIDQ5266848

Xi-Ren Cao

Publication date: 20 June 2017

Published in: IEEE Transactions on Automatic Control (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1109/tac.2003.811252

Mathematics Subject Classification ID

Discrete event control/observation systems (93C65) Markov renewal processes, semi-Markov processes (60K15) Markov and semi-Markov decision processes (90C40)

Related Items

Modeling and optimization control of a demand-driven, conveyor-serviced production station ⋮ A policy gradient method for semi-Markov decision processes with application to call admission control ⋮ Optimization of a special case of continuous-time Markov decision processes with compact action set ⋮ Finite horizon semi-Markov decision processes with application to maintenance systems ⋮ Performance analysis for controlled semi-Markov systems with application to maintenance ⋮ Unnamed Item ⋮ Semi-additive functionals of semi-Markov processes and measure-valued Poisson equation ⋮ A quality of service negotiation-based vertical handoff decision scheme in heterogeneous wireless systems ⋮ First Passage Exponential Optimality Problem for Semi-Markov Decision Processes ⋮ Performance optimization of semi-Markov decision processes with discounted-cost criteria ⋮ Error bounds of optimization algorithms for semi-Markov decision processes ⋮ Threshold dynamics and sensitivity analysis of a stochastic semi-Markov switched SIRS epidemic model with nonlinear incidence and vaccination ⋮ Nonzero-sum stochastic games with probability criteria ⋮ Quantised output-feedback design for networked control systems using semi-Markov model approach ⋮ A unified approach to time-aggregated Markov decision processes