Infinite horizon stopping problems with (nearly) total reward criteria

DOI10.1016/J.SPA.2014.07.009zbMATH Open1390.60156arXiv1401.6905OpenAlexW2165546891WikidataQ59898433 ScholiaQ59898433MaRDI QIDQ744226FDOQ744226

Authors: Jan Palczewski, Łukasz Stettner 

Publication date: 6 October 2014

Published in: Stochastic Processes and their Applications (Search for Journal in Brave)

Abstract: We study an infinite horizon optimal stopping problem which arises naturally in the optimal timing of a firm/project sale or in the valuation of natural resources: the functional to be maximised is a sum of a discounted running reward and a discounted final reward. The running and final rewards as well as the instantaneous interest rate (used for calculating discount factors) depend on a Feller-Markov process modelling the underlying randomness in the world, such as prices of stocks, prices of natural resources (gas, oil, etc.), or factors influencing the interest rate. For years, it had seemed sensible to assume that interest rates were uniformly separated from 0, which is needed for the existing theory to work. However, recent developments in Japan and in Europe showed that interest rates can get arbitrarily close to 0. In this paper we establish the feasibility of the stopping problem, prove the existence of optimal stopping times and a variational characterisation (in the viscosity sense) of the value function when interest rates are NOT uniformly separated from 0. Our results rely on certain ergodic properties of the underlying (non-uniformly) ergodic Markov process. We provide several criteria for diffusions and jump-diffusions.

Full work available at URL: https://arxiv.org/abs/1401.6905

Recommendations

• An optimal stopping problem with a reward constraint
• Optimal stopping problem with a vector-valued reward function
• Optimal stopping with irregular reward functions
• The optimal stopping problem revisited
• Optimal stopping in infinite horizon: an eigenfunction expansion approach
• Finite-horizon optimal stopping, obstacle problems and the shape of the continuation region
• Optimal stopping problem in a model with compensated refusal of reward
• Optimal Stopping in Sequential Games With or Without a Constraint of Always Terminating
• Multiple-stopping problems with random horizon
• scientific article; zbMATH DE number 4020871

zbMATH Keywords

optimal stoppinginfinite horizontotal rewardgeneral Markovian discountingnon-uniformly ergodic Markov processes

Mathematics Subject Classification ID

Stopping times; optimal stopping problems; gambling theory (60G40)

Cites Work

• Markov Chains and Stochastic Stability
• Asymptotic evaluation of certain markov process expectations for large time, I
• Foundations of Modern Probability
• Continuous-time stochastic control and optimization with financial applications
• Title not available (Why is that?)
• OPTIMAL MULTIPLE STOPPING AND VALUATION OF SWING OPTIONS
• Exponential ergodicity of the solutions to SDE's with a jump noise
• On polynomial mixing bounds for stochastic differential equations
• Title not available (Why is that?)
• Lévy Processes and Stochastic Calculus
• Title not available (Why is that?)
• Title not available (Why is that?)
• Ergodicity and exponential \(\beta\)-mixing bounds for multidimensional diffusions with jumps
• Asymptotic evaluation of certain Markov process expectations for large time—III
• Title not available (Why is that?)
• Spectral theory and limit theorems for geometrically ergodic Markov processes
• Title not available (Why is that?)
• Title not available (Why is that?)
• Applied stochastic control of jump diffusions.
• On multidimensional Ornstein-Uhlenbeck processes driven by a general Lévy process
• Strong feller property and irreducibility of diffusions with jumps
• Regularity of semigroups generated by Lévy type operators via coupling
• Title not available (Why is that?)
• On Subexponential Mixing Rate for Markov Processes
• On Some Impulse Control Problems with Long Run Average Cost
• Title not available (Why is that?)
• Finite horizon optimal stopping of time-discontinuous functionals with applications to impulse control with delay
• On ergodic stopping and impulsive control problem for nonuniformly ergodic Markov processes
• On the poisson equation and optimal stopping of ergodic markov processes
• Title not available (Why is that?)
• Large Deviations for Occupation Measures of Markov Processes: Discrete Time, Noncompact Case
• Adaptive control of discrete time Markov processes by the large deviations method
• Title not available (Why is that?)

Cited In (12)

• A verification theorem for optimal stopping problems with expectation constraints
• Title not available (Why is that?)
• Ergodic impulse control with constraint: locally compact case
• Impulse control maximizing average cost per unit time: a nonuniformly ergodic case
• Title not available (Why is that?)
• Title not available (Why is that?)
• On the existence of solutions of unbounded optimal stopping problems
• Risk-sensitive optimal stopping with unbounded terminal cost function
• Penalty method for finite horizon stopping problems
• Optimal stopping in infinite horizon: an eigenfunction expansion approach
• An algorithm based on an iterative optimal stopping method for Feller processes with applications to impulse control, perturbation, and possibly zero random discount problems
• An Optimal Stopping Problem Arising from a Decision Model with Many Agents

This page was built for publication: Infinite horizon stopping problems with (nearly) total reward criteria

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q744226)