Semi-markov decision problems and performance sensitivity analysis

DOI10.1109/TAC.2003.811252zbMATH Open1364.90344OpenAlexW2123334156MaRDI QIDQ5266848FDOQ5266848

Publication date: 20 June 2017

Published in: IEEE Transactions on Automatic Control (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.1109/tac.2003.811252

Markov renewal processes, semi-Markov processes (60K15) Markov and semi-Markov decision processes (90C40) Discrete event control/observation systems (93C65)

Cited In (18)

Error bounds of optimization algorithms for semi-Markov decision processes
A unified approach to time-aggregated Markov decision processes
Sensitivity analysis of a sequential decision problem with learning
Finite horizon semi-Markov decision processes with application to maintenance systems
Observable augmented systems for sensitivity analysis of Markov and semi-Markov processes
A policy gradient method for semi-Markov decision processes with application to call admission control
Modeling and optimization control of a demand-driven, conveyor-serviced production station
First Passage Exponential Optimality Problem for Semi-Markov Decision Processes
A basic formula for performance gradient estimation of semi-Markov decision processes
A quality of service negotiation-based vertical handoff decision scheme in heterogeneous wireless systems
Threshold dynamics and sensitivity analysis of a stochastic semi-Markov switched SIRS epidemic model with nonlinear incidence and vaccination
Optimization of a special case of continuous-time Markov decision processes with compact action set
Performance analysis for controlled semi-Markov systems with application to maintenance
Nonzero-sum stochastic games with probability criteria
Quantised output-feedback design for networked control systems using semi-Markov model approach
Title not available (Why is that?)
Semi-additive functionals of semi-Markov processes and measure-valued Poisson equation
Performance optimization of semi-Markov decision processes with discounted-cost criteria

This page was built for publication: Semi-markov decision problems and performance sensitivity analysis

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5266848)