Continuous-time Markov decision processes with exponential utility
From MaRDI portal
Abstract: In this paper, we consider a continuous-time Markov decision process (CTMDP) in Borel spaces, where the certainty equivalent with respect to the exponential utility of the total undiscounted cost is to be minimized. The cost rate is nonnegative. We establish the optimality equation. Under the compactness-continuity condition, we show the existence of a deterministic stationary optimal policy. We reduce the risk-sensitive CTMDP problem to an equivalent risk-sensitive discrete-time Markov decision process, which is with the same state and action spaces as the original CTMDP. In particular, the value iteration algorithm for the CTMDP problem follows from this reduction. We do not need impose any condition on the growth of the transition and cost rate in the state, and the controlled process could be explosive.
Recommendations
- On risk-sensitive piecewise deterministic Markov decision processes
- The risk probability criterion for discounted continuous-time Markov decision processes
- Risk-sensitive average continuous-time Markov decision processes with unbounded transition and cost rates
- On gradual-impulse control of continuous-time Markov decision processes with exponential utility
- Continuous-time Markov decision processes with risk-sensitive finite-horizon cost criterion
Cites work
- scientific article; zbMATH DE number 425394 (Why is no real title available?)
- scientific article; zbMATH DE number 3122709 (Why is no real title available?)
- scientific article; zbMATH DE number 3950347 (Why is no real title available?)
- scientific article; zbMATH DE number 1324455 (Why is no real title available?)
- scientific article; zbMATH DE number 977051 (Why is no real title available?)
- scientific article; zbMATH DE number 1119444 (Why is no real title available?)
- scientific article; zbMATH DE number 1166155 (Why is no real title available?)
- A Utility Criterion for Markov Decision Processes
- A convex analytic approach to risk-aware Markov decision processes
- A note on negative dynamic programming for risk-sensitive control
- Average Optimality in Markov Control Processes via Discounted-Cost Problems and Linear Programming
- Average optimality for risk-sensitive control with general state space
- Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach
- Continuous average control of piecewise deterministic Markov processes
- Continuous-time Markov decision processes with risk-sensitive finite-horizon cost criterion
- Controlled Markov Processes with Arbitrary Numerical Criteria
- Discounted MDP’s: Distribution Functions and Exponential Utility Maximization
- Explosion phenomena in stochastic coagulation-fragmentation models
- Markov decision processes with applications to finance.
- More risk-sensitive Markov decision processes
- Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
- On Reducing a Jump Controllable Markov Model to a Model with Discrete Time
- On essential information in sequential decision processes
- On piecewise deterministic Markov control processes: Control of jumps and of risk processes in insurance
- On solutions of Kolmogorov's equations for nonhomogeneous jump Markov processes
- Optimal stationary policies inrisk-sensitive dynamic programs with finite state spaceand nonnegative rewards
- Piecewise deterministic Markov control processes with feedback controls and unbounded costs
- Risk-Sensitive Markov Decision Processes
- Risk-sensitive control of continuous time Markov chains
- Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
- Stochastic optimal control. The discrete time case
- Zero-sum ergodic semi-Markov games with weakly continuous transition probabilities
Cited in
(24)- Zero-sum games for piecewise deterministic Markov decision processes with risk-sensitive finite-horizon cost criterion
- Risk-sensitive average continuous-time Markov decision processes with unbounded transition and cost rates
- Viscosity solutions approach to finite-horizon continuous-time Markov decision process
- Maximizing the probability of visiting a set infinitely often for a countable state space Markov decision process
- Risk-sensitive zero-sum games for continuous-time jump processes with unbounded rates and Borel spaces
- Continuous-time zero-sum games for Markov chains with risk-sensitive finite-horizon cost criterion
- The exponential utility optimality for infinite horizon semi-Markov decision processes
- Nonzero-sum risk-sensitive continuous-time stochastic games with ergodic costs
- Risk-sensitive discounted cost criterion for continuous-time Markov decision processes on a general state space
- Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces
- Continuous-time zero-sum games for markov decision processes with discounted risk-sensitive cost criterion on a general state space
- A consumption and investment problem via a Markov decision processes approach with random horizon
- On gradual-impulse control of continuous-time Markov decision processes with exponential utility
- Integro-differential optimality equations for the risk-sensitive control of piecewise deterministic Markov processes
- Continuous-time zero-sum games for Markov decision processes with discounted risk-sensitive cost criterion
- A useful technique for piecewise deterministic Markov decision processes
- Continuous-time Markov decision processes under the risk-sensitive first passage discounted cost criterion
- Finite horizon risk-sensitive continuous-time Markov decision processes with unbounded transition and cost rates
- Maximizing the probability of visiting a set infinitely often for a Markov decision process with Borel state and action spaces
- Risk-sensitive discounted continuous-time Markov decision processes with unbounded rates
- Zero-sum games for pure jump processes with risk-sensitive discounted cost criteria
- On risk-sensitive piecewise deterministic Markov decision processes
- Risk-sensitive finite-horizon piecewise deterministic Markov decision processes
- Risk-sensitive discounted Markov decision processes with unbounded reward functions and Borel spaces
This page was built for publication: Continuous-time Markov decision processes with exponential utility
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5355194)
