Gradient flows of the entropy for finite Markov chains (Q719491)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Gradient flows of the entropy for finite Markov chains
scientific article

    Statements

    Gradient flows of the entropy for finite Markov chains (English)
    0 references
    0 references
    10 October 2011
    0 references
    Let \(K\) be an irreducible and reversible Markov kernel on a finite set \(\mathcal{X}\), and consider the continuous time heat semigroup on \(\mathcal{X}\) associated with \(K\). It seems natural to ask whether the heat flow can also be identified as the gradient flow of an entropy functional with respect to some metric on the space of probability densities on \(\mathcal{X}\). The author argues that it is easily seen that the \(L^2\)-Wasserstein metric over a discrete space is not appropriate for this purpose; the metric derivative of the heat flow in the Wasserstein metric is typically infinite in a discrete setting, hence the heat flow cannot be interpret as the gradient flow of any functional in the \(L^2\)-Wasserstein metric. To address this issue, the author constructs a metric \(\mathcal{W}\) on the set of probability measures on \(\mathcal{X}\), which allows him to extend the interpretation of the heat flow as the gradient flow of the entropy to the setting of finite Markov chains. This result can be seen as a discrete counterpart of the Wasserstein gradient flow interpretation of the heat flow in \(\mathbb{R}^n\) by \textit{R. Jordan, D. Kinderlehrer} and \textit{F. Otto} [SIAM J. Math. Anal. 29, No. 1, 1--17 (1998; Zbl 0915.35120)]. Furthermore, the metric \(\mathcal{W}\) is similar to, but different from, the \(L^2\)-Wasserstein metric, and is defined via a discrete variant of the Benamou-Brenier formula.
    0 references
    0 references
    Markov chains
    0 references
    gradient flows
    0 references
    Wasserstein metric
    0 references
    optimal transportation
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references