No label defined (Q3733879)
From MaRDI portal
!
This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:
scientific article; zbMATH DE number 3967562
| Language | Label | Description | Also known as |
|---|---|---|---|
| default for all languages | No label defined |
||
| English | No label defined |
scientific article; zbMATH DE number 3967562 |
Statements
1984
0 references
stationary homogeneous Markov chain
0 references
statistical estimator
0 references
asymptotically normal
0 references
limit distributions for an estimator
0 references
entropy
0 references
0.8136070370674133
0 references
0.8010362982749939
0 references
Suppose that we have a simple stationary homogeneous Markov chain with s states \(E_ i\) \((i=1,...,s)\), transition probability matrix \(\| p_{ij}\|_{i,j=1,...,s}\), and vector of initial probabilities \((p_ i)_{i=1,...,s}\). According to \textit{A. Ya. Khinchin} [Usp. Mat. Nauk 8, No.3(55), 3-20 (1953; Zbl 0050.354); English translation in Transl., II. Ser., Am. Math. Soc. 12, 181-197 (1959)], the entropy of such a chain is defined by the formula \[ H=\sum^{s}_{i=1}p_ i\ln p_ i-\sum^{s}_{i,j=1}p(ij)\ln p(ij), \] where \(p(ij)=p_ ip_{ij}\) is the probability that the chain \((E_ i,E_ j)\) occurs. Further, let \(\hat p_ i\) be the frequency with which the state \(E_ i\) is hit and \(\hat p(ij)\) the frequency with which the chain \((E_ i,E_ j)\) occurs in N trials. It was established by \textit{E. V. Misevichyus} [Litov. Mat. Sb. 6, 394-495 (1966; Zbl 0142.159)] that the statistical estimator \[ \hat H=\sum^{s}_{i=1}\hat p_ i\ln \hat p_ i-\sum^{s}_{i,j=1}\hat p(ij)\ln \hat p(ij) \] of H constructed from a sample of size N is asymptotically normal as \(N\to \infty\). We establish the class of limit distributions for an estimator of the entropy of the Markov chain indicated above with two states when the \(p_{ij}\) (and hence also the \(p_ i)\) depend on N.
0 references