Estimating the transition matrix of a Markov chain observed at random times

DOI10.1016/J.SPL.2014.07.009zbMATH Open1322.60145arXiv1405.0384OpenAlexW2963009400MaRDI QIDQ467002FDOQ467002

Authors: Flavia Barsotti, Yohann De Castro, Thibault Espinasse, Paul Rochet 

Publication date: 3 November 2014

Published in: Statistics \& Probability Letters (Search for Journal in Brave)

Abstract: In this paper we develop a statistical estimation technique to recover the transition kernel $P$ of a Markov chain $X=(X_m{)}_{minmathbbN}$ in presence of censored data. We consider the situation where only a sub-sequence of $X$ is available and the time gaps between the observations are iid random variables. Under the assumption that neither the time gaps nor their distribution are known, we provide an estimation method which applies when some transitions in the initial Markov chain $X$ are known to be unfeasible. A consistent estimator of $P$ is derived in closed form as a solution of a minimization problem. The asymptotic performance of the estimator is then discussed in theory and through numerical simulations.

Full work available at URL: https://arxiv.org/abs/1405.0384

Recommendations

• scientific article; zbMATH DE number 1537559
• scientific article; zbMATH DE number 1029228
• Estimating a Markov Transition Matrix from Observational Data
• scientific article; zbMATH DE number 4043104
• Estimating Markov transition matrices using uncertain observed states

zbMATH Keywords

asymptotic normalityMarkov chainidentifiabilityparametric estimationnumerical simulationsLie bracketsparse transition matrix

Mathematics Subject Classification ID

Markov processes: estimation; hidden Markov models (62M05) Numerical analysis or methods applied to Markov chains (65C40) Markov chains (discrete-time Markov processes on discrete state spaces) (60J10)

Cites Work

• Finding generators for Markov chains via empirical transition matrices, with applications to credit ratings
• Asymptotic efficiency in estimation with conditional moment restrictions
• Statistical Inference about Markov Chains
• Imbedded Markov Chain Analysis of a Waiting-Line Process in Continuous Time
• Stochastic Modeling of Scientific Data
• Title not available (Why is that?)
• Statistical Inference for Probabilistic Functions of Finite State Markov Chains
• Title not available (Why is that?)
• Title not available (Why is that?)
• Probability, Markov chains, queues, and simulation. The mathematical basis of performance modeling.
• Time changes of Markov chains
• Estimation of Time-Varying Markov Processes with Aggregate Data

Cited In (7)

• Hypothesis testing for Markovian models with random time observations
• Testing Simultaneous Diagonalizability
• Unbiased estimation of the matrix of transition probabilities of a homogeneous Markov chain by a sufficient estimator
• Analysis of a stochastic susceptible-infective epidemic model in a polluted atmospheric environment
• Title not available (Why is that?)
• Relations between connected and self-avoiding hikes in labelled complete digraphs
• Title not available (Why is that?)

This page was built for publication: Estimating the transition matrix of a Markov chain observed at random times

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q467002)