Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions (Q473164): Difference between revisions

From MaRDI portal
Importer (talk | contribs)
Created a new Item
 
Importer (talk | contribs)
Changed an Item
Property / author
 
Property / author: Martin Hairer / rank
 
Normal rank
Property / review text
 
It is well known that the most widely used method for general target measures are Markov chain Monte Carlo (MCMC) algorithms. The main aim of this article is to study the complexity of certain sampling algorithms in high dimensions, more precisely, the Metropolis-Hastings algorithm in infinite dimensions. The computational cost of such an algorithm is the number of necessary steps \(\times\) cost of a step. While for most algorithms the cost of one step grows with the dimension, a major result of this paper is an lgorithm which, when applied to measures, defines via a finite-dimensional approximation of a measure defined by a density with respect to a Gaussian random field, requires a number of steps independent of the dimension in order to achieve a given level of accuracy. The authors consider Metropolis-Hastings MCMC methods and focus on cases when the proposal is either a Gaussian random walk (RWM) for which the covariance equals to that of a reference measure or an Orstain-Uhlenbeck proposal (pCN) for which the reference measure is invariant. Among the main results belong: {\parindent=6mm \begin{itemize}\item[{\(\bullet\)}] Description of \(RWM\) and \(pCN\) algorithms and study of their properties, both positive and negative ones. \item[{\(\bullet\)}] Statement of the weak Harris theorem and a discussion of the relationship between exponential convergence in a Wasserstein distance and \(L^{2}_{\mu}\)-spectral gaps. \item[{\(\bullet\)}] Formal confirmation of a conjecture that \(pCN\) has a convergence rate that is independent of the dimension while \(RWM\) has undesirable dimension dependent properties. \end{itemize}} The results are presented for separable Hilbert spaces, but in fact they do also hold on an arbitrary Banach space.
Property / review text: It is well known that the most widely used method for general target measures are Markov chain Monte Carlo (MCMC) algorithms. The main aim of this article is to study the complexity of certain sampling algorithms in high dimensions, more precisely, the Metropolis-Hastings algorithm in infinite dimensions. The computational cost of such an algorithm is the number of necessary steps \(\times\) cost of a step. While for most algorithms the cost of one step grows with the dimension, a major result of this paper is an lgorithm which, when applied to measures, defines via a finite-dimensional approximation of a measure defined by a density with respect to a Gaussian random field, requires a number of steps independent of the dimension in order to achieve a given level of accuracy. The authors consider Metropolis-Hastings MCMC methods and focus on cases when the proposal is either a Gaussian random walk (RWM) for which the covariance equals to that of a reference measure or an Orstain-Uhlenbeck proposal (pCN) for which the reference measure is invariant. Among the main results belong: {\parindent=6mm \begin{itemize}\item[{\(\bullet\)}] Description of \(RWM\) and \(pCN\) algorithms and study of their properties, both positive and negative ones. \item[{\(\bullet\)}] Statement of the weak Harris theorem and a discussion of the relationship between exponential convergence in a Wasserstein distance and \(L^{2}_{\mu}\)-spectral gaps. \item[{\(\bullet\)}] Formal confirmation of a conjecture that \(pCN\) has a convergence rate that is independent of the dimension while \(RWM\) has undesirable dimension dependent properties. \end{itemize}} The results are presented for separable Hilbert spaces, but in fact they do also hold on an arbitrary Banach space. / rank
 
Normal rank
Property / reviewed by
 
Property / reviewed by: Jaromír Antoch / rank
 
Normal rank
Property / Mathematics Subject Classification ID
 
Property / Mathematics Subject Classification ID: 65C05 / rank
 
Normal rank
Property / Mathematics Subject Classification ID
 
Property / Mathematics Subject Classification ID: 65C40 / rank
 
Normal rank
Property / Mathematics Subject Classification ID
 
Property / Mathematics Subject Classification ID: 60J22 / rank
 
Normal rank
Property / Mathematics Subject Classification ID
 
Property / Mathematics Subject Classification ID: 60G50 / rank
 
Normal rank
Property / Mathematics Subject Classification ID
 
Property / Mathematics Subject Classification ID: 60G60 / rank
 
Normal rank
Property / zbMATH DE Number
 
Property / zbMATH DE Number: 6371855 / rank
 
Normal rank
Property / zbMATH Keywords
 
Wasserstein spectral gaps
Property / zbMATH Keywords: Wasserstein spectral gaps / rank
 
Normal rank
Property / zbMATH Keywords
 
\(L^{2}\)-spectral gaps
Property / zbMATH Keywords: \(L^{2}\)-spectral gaps / rank
 
Normal rank
Property / zbMATH Keywords
 
Markov chain Monte Carlo in infinite dimensions
Property / zbMATH Keywords: Markov chain Monte Carlo in infinite dimensions / rank
 
Normal rank
Property / zbMATH Keywords
 
weak Harris theorem
Property / zbMATH Keywords: weak Harris theorem / rank
 
Normal rank
Property / zbMATH Keywords
 
random walk
Property / zbMATH Keywords: random walk / rank
 
Normal rank
Property / zbMATH Keywords
 
Gaussian random field
Property / zbMATH Keywords: Gaussian random field / rank
 
Normal rank
Property / zbMATH Keywords
 
sampling algorithm
Property / zbMATH Keywords: sampling algorithm / rank
 
Normal rank
Property / zbMATH Keywords
 
Metropolis-Hastings algorithm
Property / zbMATH Keywords: Metropolis-Hastings algorithm / rank
 
Normal rank

Revision as of 17:14, 30 June 2023

scientific article
Language Label Description Also known as
English
Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions
scientific article

    Statements

    Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions (English)
    0 references
    0 references
    0 references
    0 references
    0 references
    21 November 2014
    0 references
    It is well known that the most widely used method for general target measures are Markov chain Monte Carlo (MCMC) algorithms. The main aim of this article is to study the complexity of certain sampling algorithms in high dimensions, more precisely, the Metropolis-Hastings algorithm in infinite dimensions. The computational cost of such an algorithm is the number of necessary steps \(\times\) cost of a step. While for most algorithms the cost of one step grows with the dimension, a major result of this paper is an lgorithm which, when applied to measures, defines via a finite-dimensional approximation of a measure defined by a density with respect to a Gaussian random field, requires a number of steps independent of the dimension in order to achieve a given level of accuracy. The authors consider Metropolis-Hastings MCMC methods and focus on cases when the proposal is either a Gaussian random walk (RWM) for which the covariance equals to that of a reference measure or an Orstain-Uhlenbeck proposal (pCN) for which the reference measure is invariant. Among the main results belong: {\parindent=6mm \begin{itemize}\item[{\(\bullet\)}] Description of \(RWM\) and \(pCN\) algorithms and study of their properties, both positive and negative ones. \item[{\(\bullet\)}] Statement of the weak Harris theorem and a discussion of the relationship between exponential convergence in a Wasserstein distance and \(L^{2}_{\mu}\)-spectral gaps. \item[{\(\bullet\)}] Formal confirmation of a conjecture that \(pCN\) has a convergence rate that is independent of the dimension while \(RWM\) has undesirable dimension dependent properties. \end{itemize}} The results are presented for separable Hilbert spaces, but in fact they do also hold on an arbitrary Banach space.
    0 references
    Wasserstein spectral gaps
    0 references
    \(L^{2}\)-spectral gaps
    0 references
    Markov chain Monte Carlo in infinite dimensions
    0 references
    weak Harris theorem
    0 references
    random walk
    0 references
    Gaussian random field
    0 references
    sampling algorithm
    0 references
    Metropolis-Hastings algorithm
    0 references

    Identifiers

    0 references
    0 references
    0 references
    0 references
    0 references
    0 references
    0 references