The non-locality of Markov chain approximations to two-dimensional diffusions

DOI10.1016/J.MATCOM.2016.06.001zbMATH Open1484.60087arXiv1605.06348OpenAlexW2963740785MaRDI QIDQ1996948FDOQ1996948

Authors: C. Reisinger 

Publication date: 1 March 2021

Published in: Mathematics and Computers in Simulation (Search for Journal in Brave)

Abstract: In this short paper, we consider discrete-time Markov chains on lattices as approximations to continuous-time diffusion processes. The approximations can be interpreted as finite difference schemes for the generator of the process. We derive conditions on the diffusion coefficients which permit transition probabilities to match locally first and second moments. We derive a novel formula which expresses how the matching becomes more difficult for larger (absolute) correlations and strongly anisotropic processes, such that instantaneous moves to more distant neighbours on the lattice have to be allowed. Roughly speaking, for non-zero correlations, the distance covered in one timestep is proportional to the ratio of volatilities in the two directions. We discuss the implications to Markov decision processes and the convergence analysis of approximations to Hamilton-Jacobi-Bellman equations in the Barles-Souganidis framework.

Full work available at URL: https://arxiv.org/abs/1605.06348

Recommendations

• Markov chain approximations to symmetric diffusions
• Approximating Markov chains.
• Markov chain approximations for one dimensional diffusions
• Markov chain approximations to nonsymmetric diffusions with bounded coefficients
• Local approximations of Markov random walks by diffusions.

zbMATH Keywords

Markov chain approximationsmonotone finite difference schemestwo-dimensional diffusions

Mathematics Subject Classification ID

Numerical analysis or methods applied to Markov chains (65C40) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Diffusion processes (60J60) Applications of difference equations (39A60)

Cites Work

• Title not available (Why is that?)
• Semi-Lagrangian schemes for linear and fully non-linear diffusion equations
• Title not available (Why is that?)
• Error bounds for monotone approximation schemes for parabolic Hamilton-Jacobi-Bellman equations
• Title not available (Why is that?)
• Consistency of Generalized Finite Difference Schemes for the Stochastic HJB Equation
• On the convergence rate of approximation schemes for Hamilton-Jacobi-Bellman Equations
• An approximation scheme for the optimal control of diffusion processes
• A fast algorithm for the two dimensional HJB equation of stochastic control
• Error Bounds for Monotone Approximation Schemes for Hamilton--Jacobi--Bellman Equations
• Approximation of viscosity solutions of elliptic partial differential equations on minimal grids
• Convergent difference schemes for nonlinear parabolic equations and mean curvature motion
• Numerical Methods for Stochastic Control Problems in Continuous Time
• On the Approximation of Linear Elliptic Differential Equations by Difference Equations with Positive Coefficients
• Utility-based valuation and hedging of basis risk with partial information

Cited In (6)

• Markov chain approximations to nonsymmetric diffusions with bounded coefficients
• Analysis and computation of a discrete costly observation model for growth estimation and management of biological resources
• Executive stock option exercise with full and partial information on a drift change point
• A numerical scheme for the quantile hedging problem
• High-order filtered schemes for time-dependent second order HJB equations
• Optimal harvesting policy of an inland fishery resource under incomplete information

This page was built for publication: The non-locality of Markov chain approximations to two-dimensional diffusions

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1996948)