Continuous-time Markov decision processes with exponential utility
From MaRDI portal
Abstract: In this paper, we consider a continuous-time Markov decision process (CTMDP) in Borel spaces, where the certainty equivalent with respect to the exponential utility of the total undiscounted cost is to be minimized. The cost rate is nonnegative. We establish the optimality equation. Under the compactness-continuity condition, we show the existence of a deterministic stationary optimal policy. We reduce the risk-sensitive CTMDP problem to an equivalent risk-sensitive discrete-time Markov decision process, which is with the same state and action spaces as the original CTMDP. In particular, the value iteration algorithm for the CTMDP problem follows from this reduction. We do not need impose any condition on the growth of the transition and cost rate in the state, and the controlled process could be explosive.
Recommendations
- On risk-sensitive piecewise deterministic Markov decision processes
- The risk probability criterion for discounted continuous-time Markov decision processes
- Risk-sensitive average continuous-time Markov decision processes with unbounded transition and cost rates
- On gradual-impulse control of continuous-time Markov decision processes with exponential utility
- Continuous-time Markov decision processes with risk-sensitive finite-horizon cost criterion
Cites work
- A convex analytic approach to risk-aware Markov decision processes
- A note on negative dynamic programming for risk-sensitive control
- A Utility Criterion for Markov Decision Processes
- Average optimality for risk-sensitive control with general state space
- Average Optimality in Markov Control Processes via Discounted-Cost Problems and Linear Programming
- Continuous average control of piecewise deterministic Markov processes
- Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach
- Continuous-time Markov decision processes with risk-sensitive finite-horizon cost criterion
- Controlled Markov Processes with Arbitrary Numerical Criteria
- Discounted MDP’s: Distribution Functions and Exponential Utility Maximization
- Explosion phenomena in stochastic coagulation-fragmentation models
- scientific article; zbMATH DE number 425394 (Why is no real title available?)
- scientific article; zbMATH DE number 3122709 (Why is no real title available?)
- scientific article; zbMATH DE number 3950347 (Why is no real title available?)
- scientific article; zbMATH DE number 1324455 (Why is no real title available?)
- scientific article; zbMATH DE number 977051 (Why is no real title available?)
- scientific article; zbMATH DE number 1119444 (Why is no real title available?)
- scientific article; zbMATH DE number 1166155 (Why is no real title available?)
- Markov decision processes with applications to finance.
- More risk-sensitive Markov decision processes
- Multivariate point processes: predictable projection, Radon-Nikodym derivatives, representation of martingales
- On essential information in sequential decision processes
- On piecewise deterministic Markov control processes: Control of jumps and of risk processes in insurance
- On Reducing a Jump Controllable Markov Model to a Model with Discrete Time
- On solutions of Kolmogorov's equations for nonhomogeneous jump Markov processes
- Optimal stationary policies inrisk-sensitive dynamic programs with finite state spaceand nonnegative rewards
- Piecewise deterministic Markov control processes with feedback controls and unbounded costs
- Risk-sensitive control of continuous time Markov chains
- Risk-Sensitive Markov Decision Processes
- Semi-Markov and Jump Markov Controlled Models: Average Cost Criterion
- Stochastic optimal control. The discrete time case
- Zero-sum ergodic semi-Markov games with weakly continuous transition probabilities
Cited in
(26)- Integro-differential optimality equations for the risk-sensitive control of piecewise deterministic Markov processes
- Zero-sum games for pure jump processes with risk-sensitive discounted cost criteria
- Risk-sensitive discounted cost criterion for continuous-time Markov decision processes on a general state space
- Continuous-time zero-sum games for Markov decision processes with discounted risk-sensitive cost criterion
- A consumption and investment problem via a Markov decision processes approach with random horizon
- Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces
- On risk-sensitive piecewise deterministic Markov decision processes
- Maximizing the probability of visiting a set infinitely often for a countable state space Markov decision process
- Finite horizon risk-sensitive continuous-time Markov decision processes with unbounded transition and cost rates
- Risk-sensitive finite-horizon piecewise deterministic Markov decision processes
- A useful technique for piecewise deterministic Markov decision processes
- Nonzero-sum risk-sensitive continuous-time stochastic games with ergodic costs
- Continuous-time Markov decision processes under the risk-sensitive first passage discounted cost criterion
- Risk-sensitive discounted continuous-time Markov decision processes with unbounded rates
- Risk-sensitive average continuous-time Markov decision processes with unbounded transition and cost rates
- On gradual-impulse control of continuous-time Markov decision processes with exponential utility
- Continuous-time zero-sum games for Markov chains with risk-sensitive finite-horizon cost criterion
- Continuous-time zero-sum games for markov decision processes with discounted risk-sensitive cost criterion on a general state space
- The exponential utility optimality for infinite horizon semi-Markov decision processes
- Risk-sensitive discounted Markov decision processes with unbounded reward functions and Borel spaces
- Maximizing the probability of visiting a set infinitely often for a Markov decision process with Borel state and action spaces
- Zero-sum games for piecewise deterministic Markov decision processes with risk-sensitive finite-horizon cost criterion
- Risk-sensitive zero-sum games for continuous-time jump processes with unbounded rates and Borel spaces
- Viscosity solutions approach to finite-horizon continuous-time Markov decision process
- Multi-objective discounted continuous-time Markov decision processes
- Discrete-time singularly perturbed Markov decision processes with a general state space
This page was built for publication: Continuous-time Markov decision processes with exponential utility
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5355194)
