Markov property for a function of a Markov chain: A linear algebra approach (Q2484388): Difference between revisions
From MaRDI portal
Set OpenAlex properties. |
Created claim: Wikidata QID (P12): Q105583718, #quickstatements; #temporary_batch_1712443714953 |
||
Property / Wikidata QID | |||
Property / Wikidata QID: Q105583718 / rank | |||
Normal rank |
Revision as of 00:53, 7 April 2024
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Markov property for a function of a Markov chain: A linear algebra approach |
scientific article |
Statements
Markov property for a function of a Markov chain: A linear algebra approach (English)
0 references
1 August 2005
0 references
The article addresses whether a probabilistic function of a finite homogeneous Markov chain still enjoys a Markov-type property, and gives a complete answer to this question using a linear algebra approach. The core of the approach is the concept of invariance of a set under a matrix, and the framework of this article is related to the so-called ``geometric approach'' in the control theory of linear dynamic systems. This allows the authors to derive a collection of new results under generic assumptions on the original Markov chain. In particular, they obtain a new criterion for a function of a Markov chain to be homogeneous. The authors also provide a deterministic polynomial-time algorithm for checking this criterion. Moreover, a non-standard notion of observability for a linear system will be used. This allows one to show that the set of all stochastic matrices for which the criterion holds is nowhere dense in the set of stochastic matrices.
0 references
hidden Markov chain
0 references
homogeneous Markov chain
0 references
\(k\)th-order Markov chain
0 references
lumping map
0 references
Rogers-Pitman matrix
0 references
stochastic matrices
0 references
polynomial-time algorithm
0 references
observability
0 references