Selection of Proposal Distributions for Multiple Importance Sampling
From MaRDI portal
(Redirected from Selection of Proposal Distributions for Multiple Importance Sampling)
Abstract: The naive importance sampling (IS) estimator generally does not work well in examples involving simultaneous inference on several targets, as the importance weights can take arbitrarily large values, making the estimator highly unstable. In such situations, alternative multiple IS estimators involving samples from multiple proposal distributions are preferred. Just like the naive IS, the success of these multiple IS estimators crucially depends on the choice of the proposal distributions. The selection of these proposal distributions is the focus of this article. We propose three methods: (i) a geometric space filling approach, (ii) a minimax variance approach, and (iii) a maximum entropy approach. The first two methods are applicable to any IS estimator, whereas the third approach is described in the context of Doss's (2010) two-stage IS estimator. For the first method, we propose a suitable measure of 'closeness' based on the symmetric Kullback-Leibler divergence, while the second and third approaches use estimates of asymptotic variances of Doss's (2010) IS estimator and Geyer's (1994) reverse logistic regression estimator, respectively. Thus, when samples from the proposal distributions are obtained by running Markov chains, we provide consistent spectral variance estimators for these asymptotic variances. The proposed methods for selecting proposal densities are illustrated using various detailed examples.
Cites work
- A Theory of Statistical Models for Monte Carlo Integration
- Annealing Markov Chain Monte Carlo with Applications to Ancestral Inference
- Batch means and spectral variance estimators in Markov chain Monte Carlo
- Centered parameterizations and dependence limitations in Markov random field models
- Computational approaches for empirical Bayes methods and Bayesian sensitivity analysis
- Efficient estimation and prediction for the Bayesian binary spatial model with flexible link functions
- Empirical distributions in selection bias models
- Estimates and Standard Errors for Ratios Of Normalizing Constants from Multiple Markov Chains Via Regeneration
- Estimating standard errors for importance sampling estimators with multiple Markov chains
- Estimation and prediction for spatial generalized linear mixed models using high order Laplace approximation
- Estimation of large families of Bayes factors from Markov chain output
- Generalized multiple importance sampling
- scientific article; zbMATH DE number 5954262 (Why is no real title available?)
- scientific article; zbMATH DE number 3936273 (Why is no real title available?)
- scientific article; zbMATH DE number 3513115 (Why is no real title available?)
- scientific article; zbMATH DE number 947416 (Why is no real title available?)
- Large sample theory of empirical distributions in biased sampling models
- On a Likelihood Approach for Monte Carlo Integration
- On estimation in binary autologistic spatial models
- Principled selection of hyperparameters in the latent Dirichlet allocation model
- Safe and Effective Importance Sampling
- Selection of tuning parameters, solution paths and standard errors for Bayesian Lassos
- Strong consistency of multivariate spectral variance estimators in Markov chain Monte Carlo
- Two-Stage Importance Sampling With Mixture Proposals
Cited in
(2)
This page was built for publication: Selection of Proposal Distributions for Multiple Importance Sampling
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6144618)
