Markov selection for constrained martingale problems

DOI10.1214/19-EJP393zbMATH Open1428.60108arXiv1901.10770OpenAlexW2979408162MaRDI QIDQ2279331FDOQ2279331

C. Costantini, Thomas G. Kurtz

Publication date: 12 December 2019

Published in: Electronic Journal of Probability (Search for Journal in Brave)

Abstract: Constrained Markov processes, such as reflecting diffusions, behave as an unconstrained process in the interior of a domain but upon reaching the boundary are controlled in some way so that they do not leave the closure of the domain. In this paper, the behavior in the interior is specified by a generator of a Markov process, and the constraints are specified by a controlled generator. Together, the generators define a "constrained martingale problem". The desired constrained processes are constructed by first solving a simpler "controlled martingale problem" and then obtaining the desired process as a time-change of the controlled process. As for ordinary martingale problems, it is rarely obvious that the process constructed in this manner is unique. The primary goal of the paper is to show that from among the processes constructed in this way one can "select", in the sense of Krylov, a strong Markov process. Corollaries to these constructions include the observation that uniqueness among strong Markov solutions implies uniqueness among all solutions. These results provide useful tools for proving uniqueness for constrained processes including reflecting diffusions. The constructions also yield viscosity semisolutions of the resolvent equation and, if uniqueness holds, a viscosity solution, without proving a comparison principle. We illustrate our results by applying them to reflecting diffusions in piecewise smooth domains. We prove existence of a strong Markov solution to the SDE with reflection, under conditions more general than in Dupuis and Ishii (1993): In fact our conditions are known to be optimal in the case of simple, convex polyhedrons with constant direction of reflection on each face (Dai and Williams (1995)). We also indicate how the results can be applied to processes with Wentzell boundary conditions and nonlocal boundary conditions.

Full work available at URL: https://arxiv.org/abs/1901.10770

zbMATH Keywords

boundary controlviscosity solutionnonlocal boundary conditionsWentzell boundary conditionsconstrained martingale problemsreflecting diffusionMarkov selection

Mathematics Subject Classification ID

Diffusion processes (60J60) Continuous-time Markov processes on general state spaces (60J25) Applications of stochastic analysis (to PDEs, etc.) (60H30) Boundary theory for Markov processes (60J50)

Cites Work

• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Title not available (Why is that?)
• Generalized inverses. Theory and applications.
• Stochastic differential equations with reflecting boundary condition in convex regions
• SDEs with oblique reflection on nonsmooth domains
• Stochastic differential equations with reflecting boundary conditions
• User’s guide to viscosity solutions of second order partial differential equations
• Diffusion processes with boundary conditions
• Portfolio Selection with Transaction Costs
• Optimal investment and consumption with transaction costs
• Diffusion with nonlocal boundary conditions
• The martingale problem with sticky reflection conditions, and a system of particles interacting at the boundary
• DIFFUSION APPROXIMATION FOR TRANSPORT PROCESSES WITH GENERAL REFLECTION BOUNDARY CONDITIONS
• Reflected Brownian Motion in a Cone with Radially Homogeneous Reflection Field
• State space collapse and diffusion approximation for a network operating under a fair bandwidth sharing policy
• Existence and uniqueness of semimartingale reflecting Brownian motions in an orthant
• Reflected diffusion processes with jumps
• Stationary solutions and forward equations for controlled and singular martingale problems
• Singular risk-neutral valuation equations
• The Skorohod oblique reflection problem in domains with corners and application to stochastic differential equations
• A Dirichlet process characterization of a class of reflected diffusions
• Characterization of stationary distributions of reflected diffusions
• On the submartingale problem for reflected diffusions in domains with piecewise smooth boundaries
• On stochastic differential equations for multi-dimensional diffusion processes with boundary conditions
• ON THE SELECTION OF A MARKOV PROCESS FROM A SYSTEM OF PROCESSES AND THE CONSTRUCTION OF QUASI-DIFFUSION PROCESSES
• On stochastic differential equations for multi-dimensional diffusion processes with boundary conditions. II
• Diffusion approximation for an input-queued switch operating under a maximum weight matching policy
• Viscosity methods giving uniqueness for martingale problems
• Existence and uniqueness of reflecting diffusions in cusps
• On the roughness of the paths of RBM in a wedge

Cited In (7)

• A reverse ergodic theorem for inhomogeneous killed Markov chains and application to a new uniqueness result for reflecting diffusions
• On Singular Control Problems, the Time-Stretching Method, and the Weak-M1 Topology
• Optimal Dividend Problem: Asymptotic Analysis
• Deterministic and stochastic differential inclusions with multiple surfaces of discontinuity
• INFLATION, CENTRAL BANK AND SHORT-TERM INTEREST RATES: A NEW MODEL WITH CALIBRATION TO MARKET DATA
• Title not available (Why is that?)
• Localization for constrained martingale problems and optimal conditions for uniqueness of reflecting diffusions in 2-dimensional domains

This page was built for publication: Markov selection for constrained martingale problems

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2279331)