Abstract: Implicit sampling is a weighted sampling method that is used in data assimilation, where one sequentially updates estimates of the state of a stochastic model based on a stream of noisy or incomplete data. Here we describe how to use implicit sampling in parameter estimation problems, where the goal is to find parameters of a numerical model, e.g.~a partial differential equation (PDE), such that the output of the numerical model is compatible with (noisy) data. We use the Bayesian approach to parameter estimation, in which a posterior probability density describes the probability of the parameter conditioned on data and compute an empirical estimate of this posterior with implicit sampling. Our approach generates independent samples, so that some of the practical difficulties one encounters with Markov Chain Monte Carlo methods, e.g.~burn-in time or correlations among dependent samples, are avoided. We describe a new implementation of implicit sampling for parameter estimation problems that makes use of multiple grids (coarse to fine) and BFGS optimization coupled to adjoint equations for the required gradient calculations. The implementation is "dimension independent", in the sense that a well-defined finite dimensional subspace is sampled as the mesh used for discretization of the PDE is refined. We illustrate the algorithm with an example where we estimate a diffusion coefficient in an elliptic equation from sparse and noisy pressure measurements. In the example, dimensionslash mesh-independence is achieved via Karhunen-Lo`{e}ve expansions.
Recommendations
Cited in
(24)- A variational inequality based stochastic approximation for inverse problems in stochastic partial differential equations
- An iteratively regularized stochastic gradient method for estimating a random parameter in a stochastic PDE. A variational inequality approach
- Sampling, feasibility, and priors in data assimilation
- Implicit estimation of ecological model parameters
- A convex optimization framework for the inverse problem of identifying a random parameter in a stochastic partial differential equation
- Boosting iterative stochastic ensemble method for nonlinear calibration of subsurface flow models
- Sampling and empirical risk minimization
- Importance sampling: intrinsic dimension and computational cost
- Estimating the DINA model parameters using the No‐U‐Turn Sampler
- Efficient estimation of hydraulic conductivity heterogeneity with non-redundant measurement information
- Iterative importance sampling algorithms for parameter estimation
- Implicit sampling, with application to data assimilation
- Implicit sampling for hierarchical Bayesian inversion and applications in fractional multiscale diffusion models
- Least squares estimation of parameters in implicit models
- MALA-within-Gibbs samplers for high-dimensional distributions with sparse conditional structure
- Small-noise analysis and symmetrization of implicit Monte Carlo samplers
- Implicit sampling, with application to data assimilation
- An iterative stochastic ensemble method for parameter estimation of subsurface flow models
- Parameter estimation in nonlinear environmental problems
- A Continuation Method in Bayesian Inference
- Sequential implicit sampling methods for Bayesian inverse problems
- Implicit particle filtering \textit{via} a bank of nonlinear Kalman filters
- A fast particle-based approach for calibrating a 3-D model of the Antarctic ice sheet
- Sampling without replacement-based Parzen window ensemble method
This page was built for publication: Parameter estimation by implicit sampling
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q891599)
