Dimension-independent likelihood-informed MCMC
From MaRDI portal
Publication:2374891
Abstract: Many Bayesian inference problems require exploring the posterior distribution of high-dimensional parameters that represent the discretization of an underlying function. This work introduces a family of Markov chain Monte Carlo (MCMC) samplers that can adapt to the particular structure of a posterior distribution over functions. Two distinct lines of research intersect in the methods developed here. First, we introduce a general class of operator-weighted proposal distributions that are well defined on function space, such that the performance of the resulting MCMC samplers is independent of the discretization of the function. Second, by exploiting local Hessian information and any associated low-dimensional structure in the change from prior to posterior distributions, we develop an inhomogeneous discretization scheme for the Langevin stochastic differential equation that yields operator-weighted proposals adapted to the non-Gaussian structure of the posterior. The resulting dimension-independent, likelihood-informed (DILI) MCMC samplers may be useful for a large class of high-dimensional problems where the target probability measure has a density with respect to a Gaussian reference measure. Two nonlinear inverse problems are used to demonstrate the efficiency of these DILI samplers: an elliptic PDE coefficient inverse problem and path reconstruction in a conditioned diffusion.
Recommendations
- Ensemble sampler for infinite-dimensional inverse problems
- Proposals which speed up function-space MCMC
- Localization for MCMC: sampling high-dimensional posterior distributions with local structure
- Dimension-Independent MCMC Sampling for Inverse Problems with Non-Gaussian Priors
- Adaptive dimension reduction to accelerate infinite-dimensional geometric Markov chain Monte Carlo
Cites work
- scientific article; zbMATH DE number 646825 (Why is no real title available?)
- scientific article; zbMATH DE number 2045498 (Why is no real title available?)
- A Hierarchical Multilevel Markov Chain Monte Carlo Algorithm with Applications to Uncertainty Quantification in Subsurface Flow
- A computational framework for infinite-dimensional Bayesian inverse problems. I: The linearized case, with application to global seismic inversion
- A computational framework for infinite-dimensional Bayesian inverse problems. II: stochastic Newton MCMC with application to ice sheet flow inverse problems
- A note on Metropolis-Hastings kernels for general state spaces
- A sequential particle filter method for static models
- A stable manifold MCMC method for high dimensions
- A stochastic Newton MCMC method for large-scale statistical inverse problems with application to seismic inversion
- Active subspace methods in theory and practice: applications to kriging surfaces
- An adaptive Metropolis algorithm
- An adaptive version for the Metropolis adjusted Langevin algorithm with a truncated drift
- Complexity analysis of accelerated MCMC methods for Bayesian inversion
- Coupling and Ergodicity of Adaptive Markov Chain Monte Carlo Algorithms
- Diffusion limits of the random walk Metropolis algorithm in high dimensions
- Equation of state calculations by fast computing machines
- Exact and Computationally Efficient Likelihood-Based Estimation for Discretely Observed Diffusion Processes (with Discussion)
- Fast algorithms for Bayesian uncertainty quantification in large-scale linear inverse problems based on low-rank partial Hessian approximations
- Finding structure with randomness: probabilistic algorithms for constructing approximate matrix decompositions
- Inverse Problem Theory and Methods for Model Parameter Estimation
- Inverse problems: a Bayesian perspective
- Langevin diffusions and Metropolis-Hastings algorithms
- Likelihood-informed dimension reduction for nonlinear inverse problems
- MAP estimators and their consistency in Bayesian nonparametric inverse problems
- MCMC METHODS FOR DIFFUSION BRIDGES
- MCMC methods for functions: modifying old algorithms to make them faster
- Monte Carlo sampling methods using Markov chains and their applications
- Multilevel Monte Carlo Path Simulation
- On the ergodicity of the adaptive Metropolis algorithm on unbounded domains
- On the ergodicity properties of some adaptive MCMC algorithms
- Optimal Scaling of Discrete Approximations to Langevin Diffusions
- Optimal scaling and diffusion limits for the Langevin algorithm in high dimensions
- Optimal scaling for various Metropolis-Hastings algorithms.
- Particle Markov Chain Monte Carlo Methods
- Proposals which speed up function-space MCMC
- Randomized algorithms for the low-rank approximation of matrices
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Sequential Monte Carlo Samplers
- Signal processing problems on function space: Bayesian formulation, stochastic PDEs and effective MCMC methods
- Spectral gaps for a Metropolis-Hastings algorithm in infinite dimensions
- Stochastic Equations in Infinite Dimensions
- Weak convergence and optimal scaling of random walk Metropolis algorithms
Cited in
(only showing first 100 items - show all)- Consistent inference for diffusions from low frequency measurements
- On an adaptive preconditioned Crank-Nicolson MCMC algorithm for infinite dimensional Bayesian inference
- Accelerating Markov chain Monte Carlo with active subspaces
- hIPPYlib-MUQ: a Bayesian inference software framework for integration of data with complex predictive models under uncertainty
- A Bayesian level set method for an inverse medium scattering problem in acoustics
- Solving Bayesian inverse problems from the perspective of deep generative networks
- Scaling Up Bayesian Uncertainty Quantification for Inverse Problems Using Deep Neural Networks
- Pass-efficient randomized algorithms for low-rank matrix approximation using any number of views
- A posteriori stochastic correction of reduced models in delayed-acceptance MCMC, with application to multiphase subsurface inverse problems
- Randomized maximum likelihood based posterior sampling
- Approximation and sampling of multivariate probability distributions in the tensor train decomposition
- Variational Bayes' Method for Functions with Applications to Some Inverse Problems
- Likelihood-free inference in high dimensions with synthetic likelihood
- Wavelet-based priors accelerate maximum-a-posteriori optimization in Bayesian inverse problems
- A Randomized Maximum A Posteriori Method for Posterior Sampling of High Dimensional Nonlinear Bayesian Inverse Problems
- Adaptive inference over Besov spaces in the white noise model using \(p\)-exponential priors
- Optimal experimental design for infinite-dimensional Bayesian inverse problems governed by PDEs: a review
- Bayesian inference with optimal maps
- Multilevel Hierarchical Decomposition of Finite Element White Noise with Application to Multilevel Markov Chain Monte Carlo
- A Bayesian method for an inverse transmission scattering problem in acoustics
- Residual-based error correction for neural operator accelerated Infinite-dimensional Bayesian inverse problems
- Solution of physics-based inverse problems using conditional generative adversarial networks with full gradient penalty
- Solving linear Bayesian inverse problems using a fractional total variation-Gaussian (FTG) prior and transport map
- A Bayesian approach for consistent reconstruction of inclusions
- Online MCMC Thinning with Kernelized Stein Discrepancy
- On polynomial-time computation of high-dimensional posterior measures by Langevin-type algorithms
- Striated Metropolis-Hastings sampler for high-dimensional models
- Low-rank independence samplers in hierarchical Bayesian inverse problems
- On a generalization of the preconditioned Crank-Nicolson metropolis algorithm
- Projected Wasserstein Gradient Descent for High-Dimensional Bayesian Inference
- A multiscale strategy for Bayesian inference using transport maps
- Forward and backward uncertainty quantification with active subspaces: application to hypersonic flows around a cylinder
- Certified dimension reduction in nonlinear Bayesian inverse problems
- Efficient estimation of hydraulic conductivity heterogeneity with non-redundant measurement information
- Iterative importance sampling algorithms for parameter estimation
- Stein variational gradient descent on infinite-dimensional space and applications to statistical inverse problems
- Sequential ensemble transform for Bayesian inverse problems
- Image inversion and uncertainty quantification for constitutive laws of pattern formation
- Conditional sampling with monotone GANs: from generative models to likelihood-free inference
- Principal feature detection via \(\phi \)-Sobolev inequalities
- Iterative construction of Gaussian process surrogate models for Bayesian inference
- On unifying randomized methods for inverse problems
- Bayesian inference of heterogeneous epidemic models: application to COVID-19 spread accounting for long-term care facilities
- Optimal experimental design: formulations and computations
- Finite element representations of Gaussian processes: balancing numerical and statistical accuracy
- Hessian-based adaptive sparse quadrature for infinite-dimensional Bayesian inverse problems
- Data-free likelihood-informed dimension reduction of Bayesian inverse problems
- Learning physics-based models from data: perspectives from inverse problems and model reduction
- A stable manifold MCMC method for high dimensions
- Accelerated dimension-independent adaptive metropolis
- Two Metropolis--Hastings Algorithms for Posterior Measures with Non-Gaussian Priors in Infinite Dimensions
- Bayesian inversion of a diffusion model with application to biology
- Data-driven forward discretizations for Bayesian inversion
- Properties of the affine‐invariant ensemble sampler's ‘stretch move’ in high dimensions
- On posterior consistency of data assimilation with Gaussian process priors: the 2D-Navier-Stokes equations
- Spatial localization for nonlinear dynamical stochastic models for excitable media
- FEM-based discretization-invariant MCMC methods for PDE-constrained Bayesian inverse problems
- Scaling limits in computational Bayesian inversion
- Localization for MCMC: sampling high-dimensional posterior distributions with local structure
- Multilevel hierarchical decomposition of finite element white noise with application to multilevel Markov chain Monte Carlo
- A Bayesian level set method for the shape reconstruction of inverse scattering problems in elasticity
- Signal processing problems on function space: Bayesian formulation, stochastic PDEs and effective MCMC methods
- A computational framework for infinite-dimensional Bayesian inverse problems. II: stochastic Newton MCMC with application to ice sheet flow inverse problems
- Multilevel dimension-independent likelihood-informed MCMC for large-scale inverse problems
- Goal-oriented optimal approximations of Bayesian linear inverse problems
- MALA-within-Gibbs samplers for high-dimensional distributions with sparse conditional structure
- Optimal neural network approximation of Wasserstein gradient direction via convex optimization
- Probabilistic parameter estimation in a 2-step chemical kinetics model for n-dodecane jet autoignition
- Optimal low-rank approximations of Bayesian linear inverse problems
- Non-stationary multi-layered Gaussian priors for Bayesian inversion
- Multilevel sequential Monte Carlo with dimension-independent likelihood-informed proposals
- Derivative-informed neural operator: an efficient framework for high-dimensional parametric derivative learning
- A hybrid adaptive MCMC algorithm in function spaces
- Analysis of a Class of Multilevel Markov Chain Monte Carlo Algorithms Based on Independent Metropolis–Hastings
- Affine invariant interacting Langevin dynamics for Bayesian inference
- Tensor train construction from tensor actions, with application to compression of large high order derivative tensors
- Rate-optimal refinement strategies for local approximation MCMC
- Multilevel Markov Chain Monte Carlo
- Prior normalization for certified likelihood-informed subspace detection of Bayesian inverse problems
- Sparse approximation of triangular transports. I: The finite-dimensional case
- A unified performance analysis of likelihood-informed subspace methods
- A vine-copula based adaptive MCMC sampler for efficient inference of dynamical systems
- Ensemble sampler for infinite-dimensional inverse problems
- Generalized parallel tempering on Bayesian inverse problems
- Geometric MCMC for infinite-dimensional inverse problems
- Optimization based methods for partially observed chaotic systems
- Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
- Proposals which speed up function-space MCMC
- Langevin diffusion for population based sampling with an application in Bayesian inference for pharmacodynamics
- An Adaptive Independence Sampler MCMC Algorithm for Bayesian Inferences of Functions
- Efficient parameter estimation for a methane hydrate model with active subspaces
- Bayesian inverse problems with \(l_1\) priors: a randomize-then-optimize approach
- Adaptive dimension reduction to accelerate infinite-dimensional geometric Markov chain Monte Carlo
- Particle Filtering for Stochastic Navier--Stokes Signal Observed with Linear Additive Noise
- Large-scale Bayesian optimal experimental design with derivative-informed projected neural network
- Hierarchical Matrix Approximations of Hessians Arising in Inverse Problems Governed by PDEs
- Bayesian inference of random fields represented with the Karhunen-Loève expansion
- Optimization-Based Markov Chain Monte Carlo Methods for Nonlinear Hierarchical Statistical Inverse Problems
- Efficient Marginalization-Based MCMC Methods for Hierarchical Bayesian Inverse Problems
- Scalable Optimization-Based Sampling on Function Space
This page was built for publication: Dimension-independent likelihood-informed MCMC
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2374891)
