A Continuation Method in Bayesian Inference
From MaRDI portal
Abstract: We present a continuation method that entails generating a sequence of transition probability density functions from the prior to the posterior in the context of Bayesian inference for parameter estimation problems. The characterization of transition distributions, by tempering the likelihood function, results in a homogeneous nonlinear partial integro-differential equation whose existence and uniqueness of solutions are addressed. The posterior probability distribution comes as the interpretation of the final state of the path of transition distributions. A computationally stable scaling domain for the likelihood is explored for the approximation of the expected deviance, where we manage to hold back all the evaluations of the forward predictive model at the prior stage. It follows the computational tractability of the posterior distribution and opens access to the posterior distribution for direct samplings. To get a solution formulation of the expected deviance, we derive a partial differential equation governing the moments generating function of the log-likelihood. We show also that a spectral formulation of the expected deviance can be obtained for low-dimensional problems under certain conditions. The computational efficiency of the proposed method is demonstrated through three differents numerical examples that focus on analyzing the computational bias generated by the method, assessing the continuation method in the Bayesian inference with non-Gaussian noise, and evaluating its ability to invert a multimodal parameter of interest.
Recommendations
- Bayesian inference with optimal maps
- Spectral likelihood expansions for Bayesian inference
- Discrete gradients for computational Bayesian inference
- Stochastic spectral methods for efficient Bayesian solution of inverse problems
- Estimating deterministic parameters by Bayesian inference with emphasis on estimating the uncertainty of the parameters
Cites work
- A multiscale strategy for Bayesian inference using transport maps
- A path sampling identity for computing the Kullback-Leibler and J divergences
- Approximation of eigenfunctions in kernel-based spaces
- Bayesian inference with optimal maps
- Boundary value problems for integro-differential equations of Barbashin type
- Deviance information criteria for model selection in approximate Bayesian computation
- Eigenvalues of Positive Definite Kernels
- Equi-energy sampler with applications in statistical inference and statistical mechanics
- Estimating Bayes factors via thermodynamic integration and population MCMC
- Fast Bayesian experimental design: Laplace-based importance sampling for the expected information gain
- Hilbert space of probability density functions based on Aitchison geometry
- scientific article; zbMATH DE number 5666340 (Why is no real title available?)
- scientific article; zbMATH DE number 1909499 (Why is no real title available?)
- scientific article; zbMATH DE number 1438360 (Why is no real title available?)
- Importance sampling: intrinsic dimension and computational cost
- Improving power posterior estimation of statistical evidence
- Inverse problems: a Bayesian perspective
- Iterative importance sampling algorithms for parameter estimation
- Marginal Likelihood Estimation via Power Posteriors
- Non-Reversible Parallel Tempering: A Scalable Highly Parallel MCMC Scheme
- On linear integro-differential equations of Barbashin type in spaces of continuous and measurable functions
- On the consistency of ensemble transform filter formulations
- Parameter estimation by implicit sampling
- Posterior contraction rates for the Bayesian approach to linear ill-posed inverse problems
- Real-Parameter Evolutionary Monte Carlo With Applications to Bayesian Mixture Models
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
- Some aspects of the theory of integro-differential Barbashin equations in function spaces
- The geometry of optimal transportation
- Unbiased Markov Chain Monte Carlo Methods with Couplings
- Unnormalized optimal transport
- WASSERSTEIN METRIC-DRIVEN BAYESIAN INVERSION WITH APPLICATIONS TO SIGNAL PROCESSING
Cited in
(4)- A Bayesian interpretation of Whittaker-Henderson graduation
- A new network approach to Bayesian inference in partial differential equations
- scientific article; zbMATH DE number 1114396 (Why is no real title available?)
- Greedy selection of optimal location of sensors for uncertainty reduction in seismic moment tensor inversion
This page was built for publication: A Continuation Method in Bayesian Inference
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6164173)
