Risk-sensitive control of continuous time Markov chains
From MaRDI portal
Abstract: We study risk-sensitive control of continuous time Markov chains taking values in discrete state space. We study both finite and infinite horizon problems. In the finite horizon problem we characterise the value function via HJB equation and obtain an optimal Markov control. We do the same for infinite horizon discounted cost case. In the infinite horizon average cost case we establish the existence of an optimal stationary control under certain Lyapunov condition. We also develop a policy iteration algorithm for finding an optimal control.
Recommendations
- Controlled Markov chains with risk-sensitive criteria: Average cost, optimality equations, and optimal solutions
- Risk-sensitive ergodic control of continuous time Markov processes with denumerable state space
- A characterization of the optimal risk-sensitive average cost in finite controlled Markov chains
- Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon
- Risk-sensitive discounted cost criterion for continuous-time Markov decision processes on a general state space
Cites work
- A survey of recent results on continuous-time Markov decision processes (with comments and rejoinder)
- Adaptive Markov control processes
- Average optimality for risk-sensitive control with general state space
- Bellman Equations of Risk-Sensitive Control
- Discounted MDP’s: Distribution Functions and Exponential Utility Maximization
- Existence of Optimal Strategies Based on Specified Information, for a Class of Stochastic Decision Problems
- scientific article; zbMATH DE number 48691 (Why is no real title available?)
- Large deviations asymptotics and the spectral theory of multiplicatively regular Markov proces\-ses
- Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games
- Portfolio optimization in a semi-Markov modulated market
- Remarks on risk-sensitive control problems
- Risk sensitive control of Markov processes in countable state space
- Risk Sensitive Portfolio Management with Cox--Ingersoll--Ross Interest Rates: The HJB Equation
- Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon
- Risk-Sensitive Control on an Infinite Time Horizon
- Risk-sensitive control with near monotone cost
- Risk-sensitive dynamic asset management
- Risk-sensitive dynamic market share attraction games
- Risk-Sensitive Markov Decision Processes
- Risk-Sensitive Optimal Control for Markov Decision Processes with Monotone Cost
- Spectral theory and limit theorems for geometrically ergodic Markov processes
- Variance minimization and the overtaking optimality approach to continuous-time controlled Markov chains
Cited in
(63)- Average cost criterion induced by the regular utility function for continuous-time Markov decision processes
- Continuous-time Markov decision processes under the risk-sensitive average cost criterion
- Risk sensitive control of finite state Markov chains in discrete time, with applications to portfolio management
- Risk-sensitive and risk-neutral control for continuous-time hidden Markov models
- Controlled Markov chains with risk-sensitive criteria: Average cost, optimality equations, and optimal solutions
- Risk-sensitive zero-sum stochastic differential game for jump-diffusions
- Zero-sum games for pure jump processes with risk-sensitive discounted cost criteria
- Risk-sensitive control for a class of diffusions with jumps
- Risk-sensitive discounted cost criterion for continuous-time Markov decision processes on a general state space
- Continuous-time zero-sum games for Markov decision processes with discounted risk-sensitive cost criterion
- Risk-sensitive continuous-time Markov decision processes with unbounded rates and Borel spaces
- On risk-sensitive piecewise deterministic Markov decision processes
- Time-inconsistent risk-sensitive equilibrium for countable-stated Markov decision processes
- Exit time risk-sensitive control for systems of cooperative agents
- Finite horizon risk-sensitive continuous-time Markov decision processes with unbounded transition and cost rates
- Risk-sensitive finite-horizon piecewise deterministic Markov decision processes
- Mean-field risk sensitive control and zero-sum games for Markov chains
- Zero-sum games for continuous-time Markov jump processes with risk-sensitive finite-horizon cost criterion
- Risk-sensitive probability for Markov chains
- Risk-sensitive semi-Markov decision problems with discounted cost and general utilities
- Nonzero-sum risk-sensitive continuous-time stochastic games with ergodic costs
- Discrete-time zero-sum games for Markov chains with risk-sensitive average cost criterion
- Continuous-time Markov decision processes under the risk-sensitive first passage discounted cost criterion
- Control of continuous-time Markov chains with safety constraints
- Risk-sensitive Markov control processes
- Controlled semi-Markov chains with risk-sensitive average cost criterion
- Risk-sensitive ergodic control of continuous time Markov processes with denumerable state space
- Markov Chain Approximations for Deterministic Control Problems with Affine Dynamics and Quadratic Cost in the Control
- Risk-sensitive optimal control of hidden Markov models: structural results
- scientific article; zbMATH DE number 1775015 (Why is no real title available?)
- On risk sensitive control of regular step Markov processes
- Risk-sensitive average continuous-time Markov decision processes with unbounded rates
- Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon
- Risk-sensitive discounted continuous-time Markov decision processes with unbounded rates
- Risk-sensitive average continuous-time Markov decision processes with unbounded transition and cost rates
- On gradual-impulse control of continuous-time Markov decision processes with exponential utility
- Continuous-time zero-sum games for Markov chains with risk-sensitive finite-horizon cost criterion
- Risk-sensitive stopping problems for continuous-time Markov chains
- Risk sensitive control of pure jump processes on a general state space
- Zero-sum semi-Markov games with a probability criterion
- Continuous-time Markov decision processes with risk-sensitive finite-horizon cost criterion
- First Passage Exponential Optimality Problem for Semi-Markov Decision Processes
- Risk-sensitive semi-Markov decision processes with general utilities and multiple criteria
- Risk-averse control of undiscounted transient Markov models
- Continuous-time Markov decision processes with exponential utility
- scientific article; zbMATH DE number 6936840 (Why is no real title available?)
- Infinite Horizon Risk Sensitive Control of Discrete Time Markov Processes under Minorization Property
- Risk-Sensitive Optimal Control for Markov Decision Processes with Monotone Cost
- Ergodic risk-sensitive control of Markov processes on countable state space revisited
- Continuous-time zero-sum games for markov decision processes with discounted risk-sensitive cost criterion on a general state space
- A sensitivity formula for risk-sensitive cost and the actor-critic algorithm
- Certainty equivalent control of discrete time Markov processes with the average reward functional
- Average criteria in denumerable semi-Markov decision chains under risk-aversion
- Risk-Sensitive LQG Discounted Control Problems and Their Asymptotic Behavior
- Duality between large deviation control and risk-sensitive control for Markov decision processes
- Risk-sensitive discounted Markov decision processes with unbounded reward functions and Borel spaces
- Risk-averse control of continuous-time Markov chains
- Optimal control of a dynamic production-inventory system with various cost criteria
- Zero-sum games for piecewise deterministic Markov decision processes with risk-sensitive finite-horizon cost criterion
- Partially observable discrete-time discounted Markov games with general utility
- Risk-sensitive zero-sum games for continuous-time jump processes with unbounded rates and Borel spaces
- Discrete-time hybrid control with risk-sensitive discounted costs
- Dynamic risk control in multidimensional Markov models
This page was built for publication: Risk-sensitive control of continuous time Markov chains
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2811098)
