Filtering of continuous-time Markov chains with noise-free observation and applications

DOI10.1080/17442508.2011.651214zbMATH Open1296.60096arXiv1009.1039OpenAlexW1976184379MaRDI QIDQ5411902FDOQ5411902

Authors: F. Confortola, Marco Fuhrman 

Publication date: 25 April 2014

Published in: Stochastics (Search for Journal in Brave)

Abstract: Let X be a continuous-time Markov chain in a finite set I, let h be a mapping of I onto another set, and let Y be defined by Y_t=h(X_t), (for t nonnegative). We address the filtering problem for X in terms of the observation Y, which is not directly affected by noise. We write down explicit equations for the filtering process and show that this is a Markov process with the Feller property. We also prove that it is a piecewise-deterministic Markov process in the sense of Davis, and we identify its characteristics explicitly. We finally solve an optimal stopping problem for X with partial observation, i.e. where the moment of stopping is required to be a stopping time with respect to the natural filtration of Y.

Full work available at URL: https://arxiv.org/abs/1009.1039

Recommendations

• Filtering of continuous-time Markov chains
• Filtering of finite-state time-nonhomogeneous Markov processes, a direct approach
• Hidden Markov Chain Filtering for a Jump Diffusion Model
• scientific article; zbMATH DE number 3967577
• Finite dimensional predictors for hidden Markov chains

zbMATH Keywords

optimal stopping timenonlinear filteringpiecewise-deterministic Markov processes

Mathematics Subject Classification ID

Applications of continuous-time Markov processes on discrete state spaces (60J28) Inference from stochastic processes and prediction (62M20) Filtering in stochastic control theory (93E11) Signal detection and filtering (aspects of stochastic processes) (60G35) Stopping times; optimal stopping problems; gambling theory (60G40) Estimation and detection in stochastic control theory (93E10) Stochastic analysis (60H99)

Cites Work

• Inference in hidden Markov models.
• Some Applications of Stochastic Differential Equations to Optimal Nonlinear Filtering
• Invariance for ordinary differential equations
• Optimality conditions for impulsive control of piecewise-deterministic processes
• Asymptotic Stability of the Wonham Filter: Ergodic and Nonergodic Signals
• Martingales on Jump Processes. I: Representation Results
• Finite-dimensional models for hidden Markov chains
• Nonlinear filtering with signal dependent observation noise
• Least-squares state estimation of systems with state-dependent observation noise
• Filtering for nonlinear systems driven by nonwhite noises:an approximation scheme
• The Theorems of Bony and Brezis on Flow-Invariant Sets
• On Impulse Control with Partial Observation
• On value functions for impulsive control of piecewise-deterministic processes

Cited In (11)

• A filtering technique for Markov chains with applications to spectral embedding
• Long run control with degenerate observation
• Optimal control of continuous-time Markov chains with noise-free observation
• Filtering of continuous-time Markov chains
• Filtering of finite-state time-nonhomogeneous Markov processes, a direct approach
• Title not available (Why is that?)
• Tutorial on structured continuous-time Markov processes
• Stochastic filtering and optimal control of pure jump Markov processes with noise-free partial observation
• Analysis and filtration of special discrete-time Markov processes. I: Martingale representation
• Nonlinear filtering of partially observed systems arising in singular stochastic optimal control
• New finite-dimensional filters and smoothers for noisily observed Markov chains

This page was built for publication: Filtering of continuous-time Markov chains with noise-free observation and applications

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5411902)