On the Theoretical Properties of the Exchange Algorithm

DOI10.3150/21-BEJ1405arXiv2005.09235MaRDI QIDQ6340995FDOQ6340995

Publication date: 19 May 2020

Abstract: The exchange algorithm is one of the most popular extensions of the Metropolis--Hastings algorithm to sample from doubly-intractable distributions. However, the theoretical exploration of the exchange algorithm is very limited. For example, natural questions like `Does exchange algorithm converge at a geometric rate?' or `Does the exchange algorithm admit a Central Limit Theorem?' have not been answered yet. In this paper, we study the theoretical properties of the exchange algorithm, in terms of asymptotic variance and convergence speed. We compare the exchange algorithm with the original Metropolis--Hastings algorithm and provide both necessary and sufficient conditions for the geometric ergodicity of the exchange algorithm. Moreover, we prove that our results can be applied to various practical applications such as location models, Gaussian models, Poisson models, and a large class of exponential families, which includes most of the practical applications of the exchange algorithm. A central limit theorem for the exchange algorithm is also established. Our results justify the theoretical usefulness of the exchange algorithm.

Mathematics Subject Classification ID

Parametric inference (62Fxx) Central limit and other weak theorems (60F05) Probabilistic methods, stochastic differential equations (65Cxx) Markov processes (60Jxx)

This page was built for publication: On the Theoretical Properties of the Exchange Algorithm

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6340995)