MCMC methods for functions: modifying old algorithms to make them faster
From MaRDI portal
Abstract: Many problems arising in applications result in the need to probe a probability distribution for functions. Examples include Bayesian nonparametric statistics and conditioned diffusion processes. Standard MCMC algorithms typically become arbitrarily slow under the mesh refinement dictated by nonparametric description of the unknown function. We describe an approach to modifying a whole range of MCMC methods, applicable whenever the target measure has density with respect to a Gaussian process or Gaussian random field reference measure, which ensures that their speed of convergence is robust under mesh refinement. Gaussian processes or random fields are fields whose marginal distributions, when evaluated at any finite set of points, are -valued Gaussians. The algorithmic approach that we describe is applicable not only when the desired probability measure has density with respect to a Gaussian process or Gaussian random field reference measure, but also to some useful non-Gaussian reference measures constructed through random truncation. In the applications of interest the data is often sparse and the prior specification is an essential part of the overall modelling strategy. These Gaussian-based reference measures are a very flexible modelling tool, finding wide-ranging application. Examples are shown in density estimation, data assimilation in fluid mechanics, subsurface geophysics and image registration. The key design principle is to formulate the MCMC method so that it is, in principle, applicable for functions; this may be achieved by use of proposals based on carefully chosen time-discretizations of stochastic dynamical systems which exactly preserve the Gaussian reference measure. Taking this approach leads to many new algorithms which can be implemented via minor modification of existing algorithms, yet which show enormous speed-up on a wide range of applied problems.
Recommendations
- MCMC methods for sampling function space
- Proposals which speed up function-space MCMC
- A function space HMC algorithm with second order Langevin diffusion limit
- Signal processing problems on function space: Bayesian formulation, stochastic PDEs and effective MCMC methods
- Dimension-Independent MCMC Sampling for Inverse Problems with Non-Gaussian Priors
Cites work
- scientific article; zbMATH DE number 1350773 (Why is no real title available?)
- scientific article; zbMATH DE number 472921 (Why is no real title available?)
- scientific article; zbMATH DE number 1124118 (Why is no real title available?)
- scientific article; zbMATH DE number 1983459 (Why is no real title available?)
- scientific article; zbMATH DE number 1522715 (Why is no real title available?)
- scientific article; zbMATH DE number 1827006 (Why is no real title available?)
- scientific article; zbMATH DE number 3250158 (Why is no real title available?)
- A First Course in the Numerical Analysis of Differential Equations
- A note on Metropolis-Hastings kernels for general state spaces
- Analysis of SPDEs arising in path sampling. I: The Gaussian case
- Analysis of SPDEs arising in path sampling. II: The nonlinear case
- Bayesian Nonparametrics
- Bayesian aspects of some nonparametric problems
- Bayesian data assimilation in shape registration
- Bayesian inverse problems for functions and applications to fluid mechanics
- Bayesian learning for neural networks
- Besov priors for Bayesian inverse problems
- Conditional path sampling of SDEs and the Langevin MCMC method
- Diffusion limits of the random walk Metropolis algorithm in high dimensions
- Exponential convergence of Langevin distributions and their discrete approximations
- Gaussian Markov Random Fields
- Group actions, homeomorphisms, and matching: A general framework
- Hybrid Monte Carlo on Hilbert spaces
- Interpolation of spatial data. Some theory for kriging
- Inverse problems: a Bayesian perspective
- MCMC METHODS FOR DIFFUSION BRIDGES
- MCMC using Hamiltonian dynamics
- Monte Carlo strategies in scientific computing
- On inference for partially observed nonlinear diffusion models using the Metropolis-Hastings algorithm
- Optimal Scaling of Discrete Approximations to Langevin Diffusions
- Optimal scaling and diffusion limits for the Langevin algorithm in high dimensions
- Optimal scaling for various Metropolis-Hastings algorithms.
- Optimal tuning of the hybrid Monte Carlo algorithm
- Reversible jump MCMC for nonparametric drift estimation for diffusion processes
- Sampling conditioned diffusions
- Signal processing problems on function space: Bayesian formulation, stochastic PDEs and effective MCMC methods
- Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions
- Stochastic Equations in Infinite Dimensions
- The Geometry of Random Fields
- The variational particle-mesh method for matching curves
- Variational data assimilation using targetted random walks
- Weak convergence and optimal scaling of random walk Metropolis algorithms
Cited in
(only showing first 100 items - show all)- Diffeomorphic measure matching with kernels for generative modeling
- Bayesian inversion for electrical-impedance tomography in medical imaging using the nonlinear Poisson-Boltzmann equation
- Statistical algorithms for low-frequency diffusion data: a PDE approach
- Decreasing flow uncertainty in Bayesian inverse problems through Lagrangian drifter control
- Derivative-informed neural operator acceleration of geometric MCMC for infinite-dimensional Bayesian inverse problems
- Quasi-Monte Carlo and multilevel Monte Carlo methods for computing posterior expectations in elliptic inverse problems
- An optimization problem based on a Bayesian approach for the 2D Helmholtz equation
- A Bayesian level set method for an inverse medium scattering problem in acoustics
- Solving Bayesian inverse problems from the perspective of deep generative networks
- Scaling Up Bayesian Uncertainty Quantification for Inverse Problems Using Deep Neural Networks
- Non-centered parametric variational Bayes’ approach for hierarchical inverse problems of partial differential equations
- Analysis of a Computational Framework for Bayesian Inverse Problems: Ensemble Kalman Updates and MAP Estimators under Mesh Refinement
- MCMC Algorithms for Computational UQ of Nonnegativity Constrained Linear Inverse Problems
- Metropolis-adjusted interacting particle sampling
- Bayesian inference with subset simulation in varying dimensions applied to the Karhunen-Loève expansion
- Demonstration of machine-learning-enhanced Bayesian quantum state estimation
- Fast sampling of parameterised Gaussian random fields
- VI-DGP: a variational inference method with deep generative prior for solving high-dimensional inverse problems
- Efficient derivative-free Bayesian inference for large-scale inverse problems
- Variational Bayes' Method for Functions with Applications to Some Inverse Problems
- Simultaneous estimation of piecewise constant coefficients in elliptic pdes via Bayesian level-set methods
- Generalized Bayes approach to inverse problems with model misspecification
- Sticky PDMP samplers for sparse and local inference problems
- Bayesian updating and marginal likelihood estimation by cross entropy based importance sampling
- Uncertainty quantification for linear inverse problems with Besov prior: a randomize-then-optimize method
- Kernel Methods for Bayesian Elliptic Inverse Problems on Manifolds
- On the accept-reject mechanism for Metropolis-Hastings algorithms
- Statistical Finite Elements via Langevin Dynamics
- Ensemble Kalman methods: a mean-field perspective
- Bayesian approach to inverse scattering with topological priors
- A Randomized Maximum A Posteriori Method for Posterior Sampling of High Dimensional Nonlinear Bayesian Inverse Problems
- Hyperpriors for Matérn fields with applications in Bayesian inversion
- Iterative updating of model error for Bayesian inversion
- Bernstein-von Mises theorems for statistical inverse problems. I: Schrödinger equation
- Deep Gaussian process priors for Bayesian image reconstruction
- How deep are deep Gaussian processes?
- Bayesian inversion for electrical impedance tomography by sparse interpolation
- Bayesian approach for inverse interior scattering problems with limited aperture
- Adaptive inference over Besov spaces in the white noise model using \(p\)-exponential priors
- Uncertainty quantification for goal-oriented inverse problems via variational encoder-decoder networks
- Bayesian inverse problems and Kalman filters
- Comparing two populations using Bayesian Fourier series density estimation
- Error bounds for Metropolis-Hastings algorithms applied to perturbations of Gaussian measures in high dimensions
- Hyperparameter estimation in Bayesian MAP estimation: parameterizations and consistency
- Optimal experimental design for infinite-dimensional Bayesian inverse problems governed by PDEs: a review
- A Bayesian framework for the validation of models for subsurface flows: synthetic experiments
- Bayesian inference with optimal maps
- A new framework for Bayesian function registration
- Auxiliary MCMC samplers for parallelisable inference in high-dimensional latent dynamical systems
- Multilevel Hierarchical Decomposition of Finite Element White Noise with Application to Multilevel Markov Chain Monte Carlo
- Reversibility of elliptical slice sampling revisited
- A Bayesian method for an inverse transmission scattering problem in acoustics
- Unbiased estimation using a class of diffusion processes
- Markov chain Monte Carlo for exact inference for diffusions
- An application of sparse measure valued Bayesian inversion to acoustic sound source identification
- Bayesian imaging inverse problem with SA-roundtrip prior via HMC-pCN sampler
- On statistical Calderón problems
- A Micro-Macro Markov Chain Monte Carlo Method for Molecular Dynamics using Reaction Coordinate Proposals
- Infinite-dimensional diffusion models
- Residual-based error correction for neural operator accelerated Infinite-dimensional Bayesian inverse problems
- Solving linear Bayesian inverse problems using a fractional total variation-Gaussian (FTG) prior and transport map
- A Bayesian approach for consistent reconstruction of inclusions
- CUQIpy: I. Computational uncertainty quantification for inverse problems in Python
- CUQIpy: II. Computational uncertainty quantification for PDE-based inverse problems in Python
- A statistical framework for domain shape estimation in Stokes flows
- The Random Feature Model for Input-Output Maps between Banach Spaces
- On a generalization of the preconditioned Crank-Nicolson metropolis algorithm
- Bayesian inference and uncertainty quantification for medical image reconstruction with Poisson data
- An energy-based model approach to rare event probability estimation
- Multilevel Markov chain Monte Carlo with likelihood scaling for Bayesian inversion with high-resolution observations
- Conditional optimal transport on function spaces
- Variational data assimilation using targetted random walks
- A dynamic bi-orthogonal field equation approach to efficient Bayesian inversion
- Continuum limit and preconditioned Langevin sampling of the path integral molecular dynamics
- Operator learning using random features: a tool for scientific computing
- Importance sampling: intrinsic dimension and computational cost
- Algorithms for Kullback-Leibler approximation of probability measures in infinite dimensions
- Sampling constrained probability distributions using spherical augmentation
- The tamed unadjusted Langevin algorithm
- Continuous-discrete smoothing of diffusions
- Probability and moment inequalities for additive functionals of geometrically ergodic Markov chains
- Uncertainty quantification in graph-based classification of high dimensional data
- A probabilistic finite element method based on random meshes: a posteriori error estimators and Bayesian inverse problems
- An approximation theory framework for measure-transport sampling algorithms
- Scalable conditional deep inverse Rosenblatt transports using tensor trains and gradient-based dimension reduction
- Consistency of Bayesian inference with Gaussian process priors in an elliptic inverse problem
- Efficient estimation of hydraulic conductivity heterogeneity with non-redundant measurement information
- Iterative importance sampling algorithms for parameter estimation
- A replica exchange preconditioned Crank-Nicolson Langevin dynamic MCMC method with multi-variance strategy for Bayesian inverse problems
- Stein variational gradient descent on infinite-dimensional space and applications to statistical inverse problems
- Sequential ensemble transform for Bayesian inverse problems
- On the convergence of adaptive sequential Monte Carlo methods
- Conditional sampling with monotone GANs: from generative models to likelihood-free inference
- Principal feature detection via -Sobolev inequalities
- Multi-index sequential Monte Carlo ratio estimators for Bayesian inverse problems
- Optimal strategies for the control of autonomous vehicles in data assimilation
- Adaptive particle-based approximations of the Gibbs posterior for inverse problems
- Multilevel sequential Monte Carlo for Bayesian inverse problems
- Inferring object boundaries and their roughness with uncertainty quantification
- Information-geometric Markov chain Monte Carlo methods using diffusions
This page was built for publication: MCMC methods for functions: modifying old algorithms to make them faster
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5965033)
