Ergodic backward stochastic difference equations

DOI10.1080/17442508.2016.1224881MaRDI QIDQ2833722zbMATH OpenOpenAlexFDO

Authors Andrew L. Allan, Samuel N. Cohen

Publication date 25 November 2016

Published in Stochastics (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1509.00231

zbMATH Keywords

Markov chainsergodic controluniform ergodicityNummelin splittingergodic backward stochastic difference equations

Mathematics Subject Classification ID

Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Limit theorems in probability theory (60F99) Stochastic ordinary differential equations (aspects of stochastic analysis) (60H10) Optimal stochastic control (93E20) Stochastic analysis (60H99)

Abstract: We consider ergodic backward stochastic differential equations in a discrete time setting, where noise is generated by a finite state Markov chain. We show existence and uniqueness of solutions, along with a comparison theorem. To obtain this result, we use a Nummelin splitting argument to obtain ergodicity estimates for a discrete time Markov chain which hold uniformly under suitable perturbations of its transition matrix. We conclude with an application of this theory to a treatment of an ergodic control problem.

Recommendations

• scientific article; zbMATH DE number 1032935
• Backward-forward stochastic differential equations
• Backward stochastic difference equations and nearly time-consistent nonlinear expectations
• Backward stochastic difference equations with finite states
• scientific article; zbMATH DE number 1342038
• On backward stochastic differential equations
• scientific article; zbMATH DE number 850089
• Stochastic differential equations, backward SDEs, partial differential equations
• Backward stochastic differential equation with random measures

Cited in

(5)

• Infinite horizon backward stochastic difference equations and related stochastic recursive control problems
• Solvability of forward-backward stochastic difference equations with finite states
• CONIC TRADING IN A MARKOVIAN STEADY STATE
• scientific article; zbMATH DE number 1342038 (Why is no real title available?)
• Maximum principle for stochastic optimal control problem of forward-backward stochastic difference systems

This page was built for publication: Ergodic backward stochastic difference equations

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2833722)