Iterative importance sampling algorithms for parameter estimation
From MaRDI portal
Publication:4607633
Abstract: In parameter estimation problems one computes a posterior distribution over uncertain parameters defined jointly by a prior distribution, a model, and noisy data. Markov Chain Monte Carlo (MCMC) is often used for the numerical solution of such problems. An alternative to MCMC is importance sampling, which can exhibit near perfect scaling with the number of cores on high performance computing systems because samples are drawn independently. However, finding a suitable proposal distribution is a challenging task. Several sampling algorithms have been proposed over the past years that take an iterative approach to constructing a proposal distribution. We investigate the applicability of such algorithms by applying them to two realistic and challenging test problems, one in subsurface flow, and one in combustion modeling. More specifically, we implement importance sampling algorithms that iterate over the mean and covariance matrix of Gaussian or multivariate t-proposal distributions. Our implementation leverages massively parallel computers, and we present strategies to initialize the iterations using "coarse" MCMC runs or Gaussian mixture models.
Recommendations
Cites work
- Title not available (Why is no real title available?)
- scientific article; zbMATH DE number 4070125 (Why is no real title available?)
- scientific article; zbMATH DE number 2117227 (Why is no real title available?)
- A computational framework for infinite-dimensional Bayesian inverse problems. I: The linearized case, with application to global seismic inversion
- A computational framework for infinite-dimensional Bayesian inverse problems. II: stochastic Newton MCMC with application to ice sheet flow inverse problems
- A method for the solution of certain non-linear problems in least squares
- A multiscale strategy for Bayesian inference using transport maps
- A random map implementation of implicit filters
- A stochastic Newton MCMC method for large-scale statistical inverse problems with application to seismic inversion
- Adaptive importance sampling in monte carlo integration
- Adaptive independent Metropolis-Hastings
- An Algorithm for Least-Squares Estimation of Nonlinear Parameters
- An adaptive Metropolis algorithm
- Bayesian inference with optimal maps
- CAPILLARY CONDUCTION OF LIQUIDS THROUGH POROUS MEDIUMS
- Can local particle filters beat the curse of dimensionality?
- Convergence of adaptive mixtures of importance sampling schemes
- Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems
- Dimension-independent likelihood-informed MCMC
- Ensemble samplers with affine invariance
- Fast algorithms for Bayesian uncertainty quantification in large-scale linear inverse problems based on low-rank partial Hessian approximations
- Implicit particle filters for data assimilation
- Implicit sampling, with application to data assimilation
- Inverse Problem Theory and Methods for Model Parameter Estimation
- Inverse problems: a Bayesian perspective
- Iterative Bayesian inversion with Gaussian mixtures: finite sample implementation and large sample asymptotics
- Likelihood-informed dimension reduction for nonlinear inverse problems
- Limitations of polynomial chaos expansions in the Bayesian solution of inverse problems
- Local Adaptive Importance Sampling for Multivariate Densities With Strong Nonlinear Relationships
- MCMC methods for functions: modifying old algorithms to make them faster
- MCMC using Hamiltonian dynamics
- Minimization for conditional simulation: relationship to optimal transport
- Nonlinear data assimilation
- Nonparametric Importance Sampling
- Optimal Scaling of Discrete Approximations to Langevin Diffusions
- Optimal low-rank approximations of Bayesian linear inverse problems
- Parameter and state model reduction for large-scale statistical inverse problems
- Parameter estimation by implicit sampling
- Population Monte Carlo algorithm in high dimensions
- Pushing the Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh
- Riemann manifold Langevin and Hamiltonian Monte Carlo methods. With discussion and authors' reply
- Sampling, feasibility, and priors in data assimilation
- Scalable posterior approximations for large-scale Bayesian inverse problems via likelihood-informed parameter and state reduction
- Sequential Monte Carlo Methods for Dynamic Systems
- Sequential Monte Carlo Methods in Practice
- Sequential Monte Carlo Samplers
- Sequential Monte Carlo methods for Bayesian elliptic inverse problems
- Small-noise analysis and symmetrization of implicit Monte Carlo samplers
- Stochastic tools in mathematics and science
- Transport map accelerated Markov chain Monte Carlo
- VODE: A Variable-Coefficient ODE Solver
Cited in
(13)- Iterative construction of Gaussian process surrogate models for Bayesian inference
- A fast particle-based approach for calibrating a 3-D model of the Antarctic ice sheet
- An adaptive importance sampling algorithm for Bayesian inversion with multimodal distributions
- Iterated importance sampling in missing data problems
- A Sample-Wise Data Driven Control Solver for the Stochastic Optimal Control Problem with Unknown Model Parameters
- A direct filter method for parameter estimation
- A bi-fidelity ensemble Kalman method for PDE-constrained inverse problems in computational mechanics
- Efficient simulated maximum likelihood estimation through explicitly parameter dependent importance sampling
- Bayesian updating and marginal likelihood estimation by cross entropy based importance sampling
- Iterative importance sampling with Markov chain Monte Carlo sampling in robust Bayesian analysis
- A backward SDE method for uncertainty quantification in deep learning
- On spatially correlated observations in importance sampling methods for subsidence estimation
- A Continuation Method in Bayesian Inference
This page was built for publication: Iterative importance sampling algorithms for parameter estimation
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4607633)
