Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions (Q473164): Difference between revisions
From MaRDI portal
Created a new Item |
Changed an Item |
||
Property / author | |||
Property / author: Martin Hairer / rank | |||
Normal rank | |||
Property / review text | |||
It is well known that the most widely used method for general target measures are Markov chain Monte Carlo (MCMC) algorithms. The main aim of this article is to study the complexity of certain sampling algorithms in high dimensions, more precisely, the Metropolis-Hastings algorithm in infinite dimensions. The computational cost of such an algorithm is the number of necessary steps \(\times\) cost of a step. While for most algorithms the cost of one step grows with the dimension, a major result of this paper is an lgorithm which, when applied to measures, defines via a finite-dimensional approximation of a measure defined by a density with respect to a Gaussian random field, requires a number of steps independent of the dimension in order to achieve a given level of accuracy. The authors consider Metropolis-Hastings MCMC methods and focus on cases when the proposal is either a Gaussian random walk (RWM) for which the covariance equals to that of a reference measure or an Orstain-Uhlenbeck proposal (pCN) for which the reference measure is invariant. Among the main results belong: {\parindent=6mm \begin{itemize}\item[{\(\bullet\)}] Description of \(RWM\) and \(pCN\) algorithms and study of their properties, both positive and negative ones. \item[{\(\bullet\)}] Statement of the weak Harris theorem and a discussion of the relationship between exponential convergence in a Wasserstein distance and \(L^{2}_{\mu}\)-spectral gaps. \item[{\(\bullet\)}] Formal confirmation of a conjecture that \(pCN\) has a convergence rate that is independent of the dimension while \(RWM\) has undesirable dimension dependent properties. \end{itemize}} The results are presented for separable Hilbert spaces, but in fact they do also hold on an arbitrary Banach space. | |||
Property / review text: It is well known that the most widely used method for general target measures are Markov chain Monte Carlo (MCMC) algorithms. The main aim of this article is to study the complexity of certain sampling algorithms in high dimensions, more precisely, the Metropolis-Hastings algorithm in infinite dimensions. The computational cost of such an algorithm is the number of necessary steps \(\times\) cost of a step. While for most algorithms the cost of one step grows with the dimension, a major result of this paper is an lgorithm which, when applied to measures, defines via a finite-dimensional approximation of a measure defined by a density with respect to a Gaussian random field, requires a number of steps independent of the dimension in order to achieve a given level of accuracy. The authors consider Metropolis-Hastings MCMC methods and focus on cases when the proposal is either a Gaussian random walk (RWM) for which the covariance equals to that of a reference measure or an Orstain-Uhlenbeck proposal (pCN) for which the reference measure is invariant. Among the main results belong: {\parindent=6mm \begin{itemize}\item[{\(\bullet\)}] Description of \(RWM\) and \(pCN\) algorithms and study of their properties, both positive and negative ones. \item[{\(\bullet\)}] Statement of the weak Harris theorem and a discussion of the relationship between exponential convergence in a Wasserstein distance and \(L^{2}_{\mu}\)-spectral gaps. \item[{\(\bullet\)}] Formal confirmation of a conjecture that \(pCN\) has a convergence rate that is independent of the dimension while \(RWM\) has undesirable dimension dependent properties. \end{itemize}} The results are presented for separable Hilbert spaces, but in fact they do also hold on an arbitrary Banach space. / rank | |||
Normal rank | |||
Property / reviewed by | |||
Property / reviewed by: Jaromír Antoch / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 65C05 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 65C40 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 60J22 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 60G50 / rank | |||
Normal rank | |||
Property / Mathematics Subject Classification ID | |||
Property / Mathematics Subject Classification ID: 60G60 / rank | |||
Normal rank | |||
Property / zbMATH DE Number | |||
Property / zbMATH DE Number: 6371855 / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
Wasserstein spectral gaps | |||
Property / zbMATH Keywords: Wasserstein spectral gaps / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
\(L^{2}\)-spectral gaps | |||
Property / zbMATH Keywords: \(L^{2}\)-spectral gaps / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
Markov chain Monte Carlo in infinite dimensions | |||
Property / zbMATH Keywords: Markov chain Monte Carlo in infinite dimensions / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
weak Harris theorem | |||
Property / zbMATH Keywords: weak Harris theorem / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
random walk | |||
Property / zbMATH Keywords: random walk / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
Gaussian random field | |||
Property / zbMATH Keywords: Gaussian random field / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
sampling algorithm | |||
Property / zbMATH Keywords: sampling algorithm / rank | |||
Normal rank | |||
Property / zbMATH Keywords | |||
Metropolis-Hastings algorithm | |||
Property / zbMATH Keywords: Metropolis-Hastings algorithm / rank | |||
Normal rank |
Revision as of 17:14, 30 June 2023
scientific article
Language | Label | Description | Also known as |
---|---|---|---|
English | Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions |
scientific article |
Statements
Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions (English)
0 references
21 November 2014
0 references
It is well known that the most widely used method for general target measures are Markov chain Monte Carlo (MCMC) algorithms. The main aim of this article is to study the complexity of certain sampling algorithms in high dimensions, more precisely, the Metropolis-Hastings algorithm in infinite dimensions. The computational cost of such an algorithm is the number of necessary steps \(\times\) cost of a step. While for most algorithms the cost of one step grows with the dimension, a major result of this paper is an lgorithm which, when applied to measures, defines via a finite-dimensional approximation of a measure defined by a density with respect to a Gaussian random field, requires a number of steps independent of the dimension in order to achieve a given level of accuracy. The authors consider Metropolis-Hastings MCMC methods and focus on cases when the proposal is either a Gaussian random walk (RWM) for which the covariance equals to that of a reference measure or an Orstain-Uhlenbeck proposal (pCN) for which the reference measure is invariant. Among the main results belong: {\parindent=6mm \begin{itemize}\item[{\(\bullet\)}] Description of \(RWM\) and \(pCN\) algorithms and study of their properties, both positive and negative ones. \item[{\(\bullet\)}] Statement of the weak Harris theorem and a discussion of the relationship between exponential convergence in a Wasserstein distance and \(L^{2}_{\mu}\)-spectral gaps. \item[{\(\bullet\)}] Formal confirmation of a conjecture that \(pCN\) has a convergence rate that is independent of the dimension while \(RWM\) has undesirable dimension dependent properties. \end{itemize}} The results are presented for separable Hilbert spaces, but in fact they do also hold on an arbitrary Banach space.
0 references
Wasserstein spectral gaps
0 references
\(L^{2}\)-spectral gaps
0 references
Markov chain Monte Carlo in infinite dimensions
0 references
weak Harris theorem
0 references
random walk
0 references
Gaussian random field
0 references
sampling algorithm
0 references
Metropolis-Hastings algorithm
0 references