Continuous-time Markov chains. An applications-oriented approach (Q1189368)

From MaRDI portal
scientific article
Language Label Description Also known as
English
Continuous-time Markov chains. An applications-oriented approach
scientific article

    Statements

    Continuous-time Markov chains. An applications-oriented approach (English)
    0 references
    18 September 1992
    0 references
    The time-continuous Markov chains consist of one of the main branches of the stochastic processes. It has played a critical role in the development of probability theory and has various applications in various fields. Even though in the last fifty years, the subject is well- developed and several systematic books appeared almost thirty years ago, the reader may find that the Anderson's book with familiar title is quite different from the existing ones. In the past 20--30 years, the progress on the subject is remarkable. Some important open problems were solved and some new topics have been added. An essential part of the progress is carefully collected in the book. Thus, as mentioned by the author, ``this book is intended to complement and not replace, the sample path oriented books by \textit{K.-L. Chung} [Markov chains with stationary transition probabilities. Berlin etc.: Springer Verlag (1967; Zbl 0146.38401)], \textit{D. Freedman} [Brownian motion and diffusion. San Francisco etc.: Holden-Day (1971; Zbl 0231.60072)] and \textit{D. Williams} [Diffusion, Markov processes and martingales. Vol. 1: Foundations. Chichester etc.: John Wiley (1979; Zbl 0402.60003)]''. Roughly speaking, the book deals with four aspects of the theory of Markov chains. a) The existence and uniqueness criteria for the processes for which the main progress was made in 1970's (Chapters 2 and 4). b) Invariant measures and several types of ergodicity for the processes (Chapters 5 and 6). These topics were studied by many authors and ``completed'' around 1980. c) Reversibility, monotonicity and other properties of the processes (Chapter 7). d) Finally, as some applications of the results discussed in the previous chapters, the author deals with the birth-death processes and multidimensional population processes (Chapters 8 and 9). Of course, these two special processes are most common met in practice. As I know, most of the materials appeared in the book form at the first time. The book is well-organized. The reviewer appreciates the details which should be very much helpful for the reader. It is no doubt that this book will become an excellent reference for both researchers and for works in various applied area. Let me point out that the subject is also well-developed in China, some of the papers are included in Anderson's book. In the past 13 years, about 7 related books have been published in China, some of them have been already translated into English. Refer to the reviewer's book ``From Markov chains to non-equilibrium particle systems.'' Singapore: World Scientific (1992; Zbl 0753.60055) 2nd ed. (2004; Zbl 1078.60003) for more references and additional materials.
    0 references
    0 references
    existence and uniqueness criteria
    0 references
    invariant measures
    0 references
    reversibility
    0 references
    monotonicity
    0 references
    multidimensional population processes
    0 references
    0 references