Analysis of the Gibbs Sampler for Hierarchical Inverse Problems
From MaRDI portal
Abstract: Many inverse problems arising in applications come from continuum models where the unknown parameter is a field. In practice the unknown field is discretized resulting in a problem in , with an understanding that refining the discretization, that is increasing , will often be desirable. In the context of Bayesian inversion this situation suggests the importance of two issues: (i) defining hyper-parameters in such a way that they are interpretable in the continuum limit and so that their values may be compared between different discretization levels; (ii) understanding the efficiency of algorithms for probing the posterior distribution, as a function of large Here we address these two issues in the context of linear inverse problems subject to additive Gaussian noise within a hierarchical modelling framework based on a Gaussian prior for the unknown field and an inverse-gamma prior for a hyper-parameter, namely the amplitude of the prior variance. The structure of the model is such that the Gibbs sampler can be easily implemented for probing the posterior distribution. Subscribing to the dogma that one should think infinite-dimensionally before implementing in finite dimensions, we present function space intuition and provide rigorous theory showing that as increases, the component of the Gibbs sampler for sampling the amplitude of the prior variance becomes increasingly slower. We discuss a reparametrization of the prior variance that is robust with respect to the increase in dimension; we give numerical experiments which exhibit that our reparametrization prevents the slowing down. Our intuition on the behaviour of the prior hyper-parameter, with and without reparametrization, is sufficiently general to include a broad class of nonlinear inverse problems as well as other families of hyper-priors.
Recommendations
- A Metropolis-Hastings-within-Gibbs sampler for nonlinear hierarchical-Bayesian inverse problems
- Bayesian and fiducial inference for the inverse gaussian distribution via Gibbs sampler
- Efficient Marginalization-Based MCMC Methods for Hierarchical Bayesian Inverse Problems
- Fast Gibbs sampling for high-dimensional Bayesian inversion
- Low-rank independence samplers in hierarchical Bayesian inverse problems
- A CVAE-within-Gibbs sampler for Bayesian linear inverse problems with hyperparameters
- Dimension-Independent MCMC Sampling for Inverse Problems with Non-Gaussian Priors
- Efficient Gaussian Sampling for Solving Large-Scale Inverse Problems Using MCMC
- Gibbs sampling for a Bayesian hierarchical general linear model
- Stability of the Gibbs sampler for Bayesian hierarchical models
Cited in
(32)- Fitting large-scale structured additive regression models using Krylov subspace methods
- Hierarchical Bayesian level set inversion
- Markov chain simulation for multilevel Monte Carlo
- Analysis of a quasi-reversibility method for nonlinear parabolic equations with uncertainty data
- Hyperparameter estimation in Bayesian MAP estimation: parameterizations and consistency
- Gaussian process methods for one-dimensional diffusions: optimal rates and adaptation
- Fast Gibbs sampling for high-dimensional Bayesian inversion
- Polynomial Accelerated Solutions to a Large Gaussian Model for Imaging Biofilms: In Theory and Finite Precision
- Fast sampling in a linear-Gaussian inverse problem
- Posterior contraction in Bayesian inverse problems under Gaussian priors
- Parameterizations for ensemble Kalman inversion
- Point spread function estimation in X-ray imaging with partially collapsed Gibbs sampling
- Low-rank independence samplers in hierarchical Bayesian inverse problems
- A hybrid Gibbs sampler for edge-preserving tomographic reconstruction with uncertain view angles
- Sampling Strategies for Fast Updating of Gaussian Markov Random Fields
- MCMC Algorithms for Computational UQ of Nonnegativity Constrained Linear Inverse Problems
- Optimization-Based Markov Chain Monte Carlo Methods for Nonlinear Hierarchical Statistical Inverse Problems
- A Bayesian approach for energy-based estimation of acoustic aberrations in high intensity focused ultrasound treatment
- Efficient Marginalization-Based MCMC Methods for Hierarchical Bayesian Inverse Problems
- Well-Posed Bayesian Inverse Problems: Priors with Exponential Tails
- The Efficiency of Next-Generation Gibbs-Type Samplers: An Illustration Using a Hierarchical Model in Cosmology
- Priorconditioned CGLS-based quasi-MAP estimate, statistical stopping rule, and ranking of priors
- Variational Bayes' Method for Functions with Applications to Some Inverse Problems
- A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors
- Convergence Rates for Learning Linear Operators from Noisy Data
- Non-centered parametric variational Bayes’ approach for hierarchical inverse problems of partial differential equations
- Adaptive inference over Besov spaces in the white noise model using \(p\)-exponential priors
- Heavy-tailed Bayesian nonparametric adaptation
- A Gaussian Process Emulator Based Approach for Bayesian Calibration of a Functional Input
- Accelerated convergence in Hit-and-Run Monte Carlo and a coordinate-free randomized Kaczmarz algorithm
- Complex-valued signal recovery using a generalized Bayesian Lasso
- Efficient sampling for sparse Bayesian learning using hierarchical prior normalization
This page was built for publication: Analysis of the Gibbs Sampler for Hierarchical Inverse Problems
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2938456)
