Iterative construction of Gaussian process surrogate models for Bayesian inference
From MaRDI portal
Publication:2301102
Abstract: A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced by traditional Markov Chain Monte Carlo (MCMC) samplers, through constructing proposal probability densities that are both, easy to sample and that provide a better approximation to the target density than a simple Gaussian proposal distribution would. To achieve that, a Gaussian proposal distribution is augmented with a Gaussian Process (GP) surface that helps capture non-linearities in the log-likelihood function. In order to train the GP surface, an iterative approach is adopted for the optimal selection of points in parameter space. Optimality is sought by maximizing the information gain of the GP surface using a minimum number of forward model simulation runs. The accuracy of the GP-augmented surface approximation is assessed in two ways. The first consists of comparing predictions obtained from the approximate surface with those obtained through running the actual simulation model at hold-out points in parameter space. The second consists of a measure based on the relative variance of sample weights obtained from sampling the approximate posterior probability distribution of the model parameters. The efficacy of this new algorithm is tested on inferring reaction rate parameters in a 3-node and 6-node network toy problems, which imitate idealized reaction networks in combustion applications.
Recommendations
- Adaptive construction of surrogates for the Bayesian solution of inverse problems
- Adaptive Gaussian Process Approximation for Bayesian Inference with Expensive Likelihood Functions
- Convergence analysis of surrogate-based methods for Bayesian inverse problems
- Adaptive Hessian-Based Nonstationary Gaussian Process Response Surface Method for Probability Density Approximation with Application to Bayesian Solution of Large-Scale Inverse Problems
- Stochastic collocation algorithms using \(l_1\)-minimization for Bayesian solution of inverse problems
Cites work
- A Bayesian approach to model inadequacy for polynomial regression
- A general purpose sampling algorithm for continuous distributions (the t-walk)
- A stochastic Newton MCMC method for large-scale statistical inverse problems with application to seismic inversion
- Active learning with adaptive regularization
- Adaptive rejection Metropolis sampling using Lagrange interpolation polynomials of degree 2
- Adaptive Rejection Metropolis Sampling within Gibbs Sampling
- Advances in the sequential design of computer experiments based on active learning
- An efficient proposal distribution for Metropolis-Hastings using a \(B\)-splines technique
- Approximation errors and model reduction with an application in optical diffusion tomography
- Bayesian calibration of computer models. (With discussion)
- Bayesian Design and Analysis of Computer Experiments: Use of Derivatives in Surface Prediction
- Bayesian inference with optimal maps
- Bayesian treed Gaussian process models with an application to computer modeling
- Coarse-gradient Langevin algorithms for dynamic data integration and uncertainty quantification
- Computer Model Calibration Using High-Dimensional Output
- Design and analysis of computer experiments. With comments and a rejoinder by the authors
- Dimension-independent likelihood-informed MCMC
- Efficient global optimization of expensive black-box functions
- Ensemble samplers with affine invariance
- Exponential convergence of Langevin distributions and their discrete approximations
- Gaussian processes for machine learning.
- scientific article; zbMATH DE number 49187 (Why is no real title available?)
- scientific article; zbMATH DE number 3583145 (Why is no real title available?)
- scientific article; zbMATH DE number 1209388 (Why is no real title available?)
- scientific article; zbMATH DE number 1304257 (Why is no real title available?)
- scientific article; zbMATH DE number 1149423 (Why is no real title available?)
- Independent Doubly Adaptive Rejection Metropolis Sampling Within Gibbs Sampling
- Inverse Problem Theory and Methods for Model Parameter Estimation
- Iterative importance sampling algorithms for parameter estimation
- MCMC using Hamiltonian dynamics
- Model Reduction for Large-Scale Systems with High-Dimensional Parametric Input Space
- Multi-output separable Gaussian process: towards an efficient, fully Bayesian paradigm for uncertainty quantification
- On markov chain monte carlo methods for nonlinear and non-gaussian state-space models
- Preconditioning Markov Chain Monte Carlo Simulations Using Coarse-Scale Models
- Query efficient posterior estimation in scientific experiments via Bayesian active learning
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Sampling the posterior: an approach to non-Gaussian data assimilation
- Spectral Methods for Uncertainty Quantification
- Stochastic inverse heat conduction using a spectral approach
- Stochastic spectral methods for efficient Bayesian solution of inverse problems
- Transport map accelerated Markov chain Monte Carlo
- Using Bayesian statistics in the estimation of heat source in radiation
Cited in
(4)- Surrogate-based sequential Bayesian experimental design using non-stationary Gaussian processes
- Gaussian process surrogates for failure detection: a Bayesian experimental design approach
- Hybrid nested sampling algorithm for Bayesian model selection applied to inverse subsurface flow problems
- Surrogate Modeling with Gaussian Processes for an Inverse Problem in Polymer Dynamics
This page was built for publication: Iterative construction of Gaussian process surrogate models for Bayesian inference
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2301102)
