Exact and approximate hidden Markov chain filters based on discrete observations
From MaRDI portal
(Redirected from Publication:293595)
continuous-time Markov chainhidden Markov modelBrownian motionWonham filterasymmetric telegraph processdiscrete Bayesian filter
Computational methods in Markov chains (60J22) Numerical analysis or methods applied to Markov chains (65C40) Inference from stochastic processes and prediction (62M20) Signal theory (characterization, reconstruction, filtering, etc.) (94A12) Signal detection and filtering (aspects of stochastic processes) (60G35) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10) Probabilistic models, generic numerical methods in probability and statistics (65C20) Brownian motion (60J65) Continuous-time Markov processes on discrete state spaces (60J27)
Abstract: We consider a Hidden Markov Model (HMM) where the integrated continuous-time Markov chain can be observed at discrete time points perturbed by a Brownian motion. The aim is to derive a filter for the underlying continuous-time Markov chain. The recursion formula for the discrete-time filter is easy to derive, however involves densities which are very hard to obtain. In this paper we derive exact formulas for the necessary densities in the case the state space of the HMM consists of two elements only. This is done by relating the underlying integrated continuous-time Markov chain to the so-called asymmetric telegraph process and by using recent results on this process. In case the state space consists of more than two elements we present three different ways to approximate the densities for the filter. The first approach is based on the continuous filter problem. The second approach is to derive a PDE for the densities and solve it numerically and the third approach is a crude discrete time approximation of the Markov chain. All three approaches are compared in a numerical study.
Recommendations
- Publication:4284865
- On filtering for a hidden Markov chain under square performance criterion
- Filtering of Hidden Weak Markov Chain -Discrete Range Observations
- Time discretization of continuous-time filters and smoothers for HMM parameter estimation
- Hidden Markov Chain Filtering for a Jump Diffusion Model
Cites work
- scientific article; zbMATH DE number 994731 (Why is no real title available?)
- scientific article; zbMATH DE number 431865 (Why is no real title available?)
- scientific article; zbMATH DE number 722978 (Why is no real title available?)
- scientific article; zbMATH DE number 796445 (Why is no real title available?)
- A Method for the Spatial Discretization of Parabolic Equations in One Space Variable
- A NONPARAMETRIC BAYESIAN APPROACH TO DETECT THE NUMBER OF REGIMES IN MARKOV SWITCHING MODELS
- A generalized multi-period mean-variance portfolio optimization with Markov switching parameters
- A second-order Markov-modulated fluid queue with linear service rate
- A stochastic model related to the telegrapher's equation
- An EM algorithm for estimation in Markov-modulated Poisson processes
- Analysis of separable Markov-modulated rate models for information-handling systems
- Estimating models based on Markov jump processes given fragmented observation series
- Estimation for the discretely observed telegraph process
- Estimation of noisy telegraph processes: Nonlinear filtering versus nonlinear smoothing (Corresp.)
- Filtering and prediction: A primer
- Fully Bayesian analysis of switching Gaussian state space models
- Markov decision processes with applications to finance.
- Markowitz's Mean-Variance Portfolio Selection With Regime Switching: From Discrete-Time Models to Their Continuous-Time Limits
- Moment based regression algorithms for drift and volatility estimation in continuous-time Markov switching models
- On the asymmetric telegraph processes
- Optimal portfolio policies under bounded expected loss and partial information
- Optimizing the terminal wealth under partial information: the drift process as a continuous time Markov chain
- Parameter estimation in continuous time Markov switching models: a semi-continuous Markov chain Monte Carlo approach
- Portfolio Optimization With Markov-Modulated Stock Prices and Interest Rates
- Portfolio optimization under partial information with expert opinions
- Portfolio optimization with unobservable Markov-modulated drift process
- Portfolio selection in the enlarged Markovian regime-switching market
- Quasi-exact approximation of hidden Markov chain filters
- Sequential tracking of a hidden Markov chain using point process observations
- Statistical analysis of the inhomogeneous telegrapher's process
- Testing for two states in a hidden Markov model
- The Relaxed Investor with Partial Information
Cited in
(4)- Filtering hidden semi-Markov chains
- Discretely observed Brownian motion governed by telegraph signal process: estimation and application to finance
- \(\mathcal{L}_1 \)-optimal filtering of Markov jump processes. I: Exact solution and numerical implementation schemes
- scientific article; zbMATH DE number 1583960 (Why is no real title available?)
This page was built for publication: Exact and approximate hidden Markov chain filters based on discrete observations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q293595)
