Abstract: Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use implicit sampling in parameter estimation problems, where the goal is to find parameters of a numerical model, e.g.~a partial differential equation (PDE), such that the output of the numerical model is compatible with (noisy) data. We use the Bayesian approach to parameter estimation, in which a posterior probability density describes the probability of the parameter conditioned on data and compute an empirical estimate of this posterior with implicit sampling. Our approach generates independent samples, so that some of the practical difficulties one encounters with Markov Chain Monte Carlo methods, e.g.~burn-in time or correlations among dependent samples, are avoided. We describe a new implementation of implicit sampling for parameter estimation problems that makes use of multiple grids (coarse to fine) and BFGS optimization coupled to adjoint equations for the required gradient calculations. The implementation is "dimension independent", in the sense that a well-defined finite dimensional subspace is sampled as the mesh used for discretization of the PDE is refined. We illustrate the algorithm with an example where we estimate a diffusion coefficient in an elliptic equation from sparse and noisy pressure measurements. In the example, dimensionslash mesh-independence is achieved via Karhunen-Lo`{e}ve expansions.
Recommendations
Cited in
(24)- Efficient estimation of hydraulic conductivity heterogeneity with non-redundant measurement information
- A convex optimization framework for the inverse problem of identifying a random parameter in a stochastic partial differential equation
- Estimating the DINA model parameters using the No‐U‐Turn Sampler
- MALA-within-Gibbs samplers for high-dimensional distributions with sparse conditional structure
- Least squares estimation of parameters in implicit models
- A fast particle-based approach for calibrating a 3-D model of the Antarctic ice sheet
- An iteratively regularized stochastic gradient method for estimating a random parameter in a stochastic PDE. A variational inequality approach
- Sampling and empirical risk minimization
- Boosting iterative stochastic ensemble method for nonlinear calibration of subsurface flow models
- A variational inequality based stochastic approximation for inverse problems in stochastic partial differential equations
- Importance sampling: intrinsic dimension and computational cost
- Implicit particle filtering \textit{via} a bank of nonlinear Kalman filters
- Parameter estimation in nonlinear environmental problems
- Implicit sampling, with application to data assimilation
- Implicit sampling, with application to data assimilation
- Implicit estimation of ecological model parameters
- Sampling without replacement-based Parzen window ensemble method
- Implicit sampling for hierarchical Bayesian inversion and applications in fractional multiscale diffusion models
- Sequential implicit sampling methods for Bayesian inverse problems
- An iterative stochastic ensemble method for parameter estimation of subsurface flow models
- Sampling, feasibility, and priors in data assimilation
- Iterative importance sampling algorithms for parameter estimation
- Small-noise analysis and symmetrization of implicit Monte Carlo samplers
- A Continuation Method in Bayesian Inference
This page was built for publication: Parameter estimation by implicit sampling
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q891599)
