An introduction to Markov processes. (Q4831227)

From MaRDI portal

!

This is the item page for this Wikibase entity, intended for internal use and editing purposes. Please use the normal view instead:

scientific article; zbMATH DE number 2123740
Language Label Description Also known as
default for all languages
No label defined
    English
    An introduction to Markov processes.
    scientific article; zbMATH DE number 2123740

      Statements

      An Introduction to Markov Processes (English)
      0 references
      An introduction to Markov processes. (English)
      0 references
      0 references
      22 December 2004
      0 references
      random walks
      0 references
      Markov chains
      0 references
      Doeblin's theory
      0 references
      recurrence
      0 references
      transience
      0 references
      periodicity
      0 references
      ergodic theory
      0 references
      reversible Markov processes
      0 references
      Gibbs states
      0 references
      Glauber dynamics
      0 references
      simulated annealing
      0 references
      The theme of the book is an introduction to Markov processes, both discrete and continuous in time, on a countable state space. The book consists of six chapters. In the first chapter, ``Random walks, a good place to begin'', the author discusses nearest neighbour random walks on the square \(d\)-dimensional lattice \(\mathbb Z\): the distribution at time \(n\), passage times, times of first return and, in particular, recurrence and transience. The second chapter, ``Doeblin's theory for Markov chains'' introduces Markov chains and investigates their long time behaviour. Doeblin's theorem and the mean ergodic theorem, recurrence properties and individual ergodic theorems are the topics covered in this chapter. The next chapter presents ``More about the ergodic theory of Markov chains'' and discusses communicating class properties such as recurrence, transience and periodicity. In the first three chapters Markov chains, i.e., Markov processes discrete in time have been considered, now in Chapters 4 and 5, the author additionally investigates Markov processes continuous in time. In Chapter 4, ``Markov processes in continuous time'', he starts with Poisson processes and then discusses Markov processes with bounded and unbounded rates. The last part of this chapter is devoted to an examination of the ergodic behaviour of Markov processes of the type introduced before. Chapter 5 deals with ``Reversible Markov processes'', first discrete in time, then continuous in time. Issues covered are the spectral gap \(\beta\), reversibility, Gibbs states, Glauber dynamics and simulated annealing. The last chapter, rather as an appendix, provides ``Some mild measure theory''. Each chapter ends with a set of exercises. The book is well-written, in a conversational style. A level of solid undergraduate mathematics background is assumed of the readership. On the website of the author one can find a list of errata.
      0 references

      Identifiers

      0 references
      0 references
      0 references
      0 references
      0 references
      0 references
      0 references