Über die Struktur der mittleren Entropie (Q775393)

From MaRDI portal

!

This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:

scientific article; zbMATH DE number 3172223
Language Label Description Also known as
default for all languages
No label defined
    English
    Über die Struktur der mittleren Entropie
    scientific article; zbMATH DE number 3172223

      Statements

      Über die Struktur der mittleren Entropie (English)
      0 references
      0 references
      1962
      0 references
      probability theory
      0 references
      integral representation of entropy
      0 references
      transmission (information) rates
      0 references
      finite alphabet stationary information sources
      0 references
      channels
      0 references
      As in the paper of \textit{K. R. Parthasarathy} [Ill. J. Math. 5, 299--305 (1961; Zbl 0100.33903)], but independently, the problem solved is that of the integral representation of the entropy and transmission (information) rates in the case of finite alphabet stationary information sources and channels. Also the method used in both papers is based on the theory of \textit{N. Krylov} and \textit{N. Bogolyubov} [Ann. Math. (2) 38, 65--113 (1937; Zbl 0016.08604)]. Let \( A= \{1, \ldots, a\} \) be an alphabet, let \(\Omega = \left\{\omega=\left(\cdots, \omega_{-1}, \omega_{0}, \omega_{1}, \ldots\right): \omega_{t} \in A\right\}\), and let \(T\) be the shift transformation of \(\Omega\) onto \( \Omega\): \((T \omega)_{t}=\omega_{t+1} \). Let \[ _s(\omega)_t = \{\eta: \eta \in \Omega, \eta_s = \omega_s, \ldots, \eta_t = \omega_t\} \quad (s \leq t \text{ integers}). \] For given \(s, t\) there are \(a^{t-s+1}\) different \({}_s(\omega)_t\) constituting the set \(Z(s, t)\) of atoms of a finite \(\sigma\)-algebra \( B(s, t)\). Let \(B\) the \(\sigma\)-algebra generated by \(\cup_{s \leq t} B(s, t)\). In the sequel we are concerned with the measurable space \( (\Omega, B) \). Let \( V_0\) be the class of all stationary probability measures on \((\Omega, B)\). If \(p \in V_0\), then the entropy rate is defined by \(H(p) = \lim _t t^{-1} H(1, t ; p) \), where \(\displaystyle H(s, t ; p) = -\sum_{E \in Z(s, t)} p(E) \log p(E) \) is the entropy corresponding to \(p\) and \(B(s, t)\). According to the McMillan's limit theorem, the function \[ h_t(\omega ; p) \{=-t^{-1} \log p ({}_1(\omega)_t) \text{ for }p({}_1(\omega)_t)>0, \, =0 \text{ otherwise } \} \] converges in \( L^1(p) \) to a function \(h(\omega ; p) \) defined almost everywhere \( [p] \). The author proves (Theorem 1) that there exists such a set \(E \in B\) that \( p(E)=1 \) for every \(p \in V_0\) and that to every point \(\omega \in E\) there corresponds an ergodic \(m_{\omega} \in V_0\) such that \(m_{\omega}=m_{T \omega} \) and such that the invariant (with respect to \(T\) ) function \(h(\omega)\) \(\{= H(m_{\omega})\) if \( (\omega \in E) \), \( =0 \) otherwise \( \} \) is \( B_0\)-measurable, where \(B_0\) is the \( \sigma \)-algebra of the invariant sets of \(B\). Further, the following assertions are valid: 1. \( H(p)=\int h d p \) for every \(p \in V_0\); 2. \(\lim_t h_t(\omega ; p)=h(\omega)\) in \( L^1(p) \) for every \(p \in V_0\). A similar assertion as assertion 1 is proved for the transmission rate (Theorem 2 ).
      0 references

      Identifiers