Infinite horizon risk-sensitive control of diffusions without any blanket stability assumptions
From MaRDI portal
(Redirected from Publication:1747784)
Abstract: We consider the infinite horizon risk-sensitive problem for nondegenerate diffusions with a compact action space, and controlled through the drift. We only impose a structural assumption on the running cost function, namely near-monotonicity, and show that there always exists a solution to the risk-sensitive Hamilton-Jacobi-Bellman (HJB) equation, and that any minimizer in the Hamiltonian is optimal in the class of stationary Markov controls. Under the additional hypothesis that the coefficients of the diffusion are bounded, and satisfy a condition that limits (even though it still allows) transient behavior, we show that any minimizer in the Hamiltonian is optimal in the class of all admissible controls. In addition, we present a sufficient condition, under which the solution of the HJB is unique (up to a multiplicative constant), and establish the usual verification result. We also present some new results concerning the multiplicative Poisson equation for elliptic operators in .
Recommendations
- Risk sensitive control of diffusions with small running cost
- Risk-sensitive control for a class of diffusions with jumps
- Infinite horizon risk sensitive control of discrete time Markov processes with small risk
- Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon
- Infinite Horizon Risk Sensitive Control of Discrete Time Markov Processes under Minorization Property
Cites work
- scientific article; zbMATH DE number 6520436 (Why is no real title available?)
- scientific article; zbMATH DE number 3720745 (Why is no real title available?)
- scientific article; zbMATH DE number 48691 (Why is no real title available?)
- scientific article; zbMATH DE number 3567644 (Why is no real title available?)
- scientific article; zbMATH DE number 707209 (Why is no real title available?)
- scientific article; zbMATH DE number 1161554 (Why is no real title available?)
- scientific article; zbMATH DE number 3895476 (Why is no real title available?)
- A Finite-Dimensional Risk-Sensitive Control Problem
- A characterization of the optimal risk-sensitive average cost in finite controlled Markov chains
- An adaptive terminal guidance scheme based on an exponential cost criterion with application to homing missile guidance
- An eigenvalue approach to the risk sensitive control problem in near monotone case
- Average optimality for risk-sensitive control with general state space
- Bellman Equations of Risk-Sensitive Control
- Conditions for no breakdown and Bellman equations of risk-sensitive control
- Downside risk minimization via a large deviations approach
- Existence of strong solutions for Itô's stochastic equations via approximations
- Exponential and uniform ergodicity of Markov processes
- Feynman-Kac semigroups, ground state diffusions, and large deviations
- Generalizations and properties of the principal eigenvalue of elliptic operators in unbounded domains
- Harnack's inequality for cooperative weakly coupled elliptic systems
- Infinite Horizon Risk Sensitive Control of Discrete Time Markov Processes under Minorization Property
- Large deviations asymptotics and the spectral theory of multiplicatively regular Markov proces\-ses
- Large time asymptotic problems for optimal stochastic control with superlinear cost
- Multiplicative ergodicity and large deviations for an irreducible Markov chain.
- Necessary and sufficient conditions for a solution to the risk-sensitive Poisson equation on a finite state space
- ON REGULARITY OF TRANSITION PROBABILITIES AND INVARIANT MEASURES OF SINGULAR DIFFUSIONS UNDER MINIMAL CONDITIONS
- On the structure of solutions of ergodic type Bellman equation related to risk-sensitive control
- Optimality equations and inequalities in a class of risk-sensitive average cost Markov decision chains
- Principal eigenvalues and the Dirichlet problem for fully nonlinear elliptic operators
- Remarks on risk-sensitive control problems
- Risk sensitive control of diffusions with small running cost
- Risk sensitive stochastic control and differential games
- Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon
- Risk-Sensitive Control on an Infinite Time Horizon
- Risk-Sensitive Markov Decision Processes
- Risk-Sensitive Optimal Control for Markov Decision Processes with Monotone Cost
- Risk-sensitive control and an optimal investment model. II.
- Risk-sensitive control of an ergodic diffusion over an infinite horizon
- Risk-sensitive control with near monotone cost
- Risk-sensitive dynamic asset management
- Risk-sensitive ergodic control of continuous time Markov processes with denumerable state space
- Risk-sensitive linear/quadratic/gaussian control
- Some results and problems in risk sensitive stochastic control
- Some results on risk-sensitive control with full observation
- Spectral theory and limit theorems for geometrically ergodic Markov processes
- Strong solutions of stochastic equations with singular time dependent drift
- Subgeometric ergodicity of strong Markov processes
- The principal eigenvalue and maximum principle for second‐order elliptic operators in general domains
Cited in
(30)- A variational formula for risk-sensitive control of diffusions in \(\mathbb{R}^d\)
- Risk-sensitive ergodic control of reflected diffusion processes in orthant
- Nonzero-sum risk-sensitive stochastic differential games: a multi-parameter eigenvalue problem approach
- Ergodic risk-sensitive control for regime-switching diffusions
- Risk-sensitive control for a class of diffusions with jumps
- On the relative value iteration with a risk-sensitive criterion
- On the policy improvement algorithm for ergodic risk-sensitive control
- Existence of bounded solutions to multiplicative Poisson equations under mixing property
- Nonzero-sum risk-sensitive stochastic differential games with discounted costs
- Strict monotonicity of principal eigenvalues of elliptic operators in \(\mathbb R^d\) and risk-sensitive control
- A risk-averse analog of the Hamilton-Jacobi-Bellman equation
- A nonzero-sum risk-sensitive stochastic differential game in the orthant
- Ergodic risk-sensitive control of Markov processes on countable state space revisited
- Robust optimal control using conditional risk mappings in infinite horizon
- A variational characterization of the optimal exit rate for controlled diffusions
- Asymptotics of impulse control problem with multiplicative reward
- Discrete-time zero-sum games for Markov chains with risk-sensitive average cost criterion
- Infinite horizon controlled diffusions with randomly varying and state-dependent discount cost rates
- Risk sensitive optimal stopping
- Zero-sum risk-sensitive stochastic differential games with reflecting diffusions in the orthant
- Ergodic risk-sensitive stochastic differential games with reflecting diffusions in a bounded domain
- Zero-sum stochastic differential games with risk-sensitive cost
- Risk-sensitive semi-Markov decision problems with discounted cost and general utilities
- Risk-sensitive zero-sum stochastic differential game for jump-diffusions
- On the global convergence of relative value iteration for infinite-horizon risk-sensitive control of diffusions
- On the monotonicity property of the generalized eigenvalue for weakly-coupled cooperative elliptic systems
- Zero-sum semi-Markov games with a probability criterion
- A variational characterization of the risk-sensitive average reward for controlled diffusions on \(\mathbb{R}^d\)
- Certain Liouville properties of eigenfunctions of elliptic operators
- Bounds for a risk-sensitive homing problem
This page was built for publication: Infinite horizon risk-sensitive control of diffusions without any blanket stability assumptions
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1747784)
