A tutorial on bridge sampling
From MaRDI portal
Abstract: The marginal likelihood plays an important role in many areas of Bayesian statistics such as parameter estimation, model comparison, and model averaging. In most applications, however, the marginal likelihood is not analytically tractable and must be approximated using numerical methods. Here we provide a tutorial on bridge sampling (Bennett, 1976; Meng & Wong, 1996), a reliable and relatively straightforward sampling method that allows researchers to obtain the marginal likelihood for models of varying complexity. First, we introduce bridge sampling and three related sampling methods using the beta-binomial model as a running example. We then apply bridge sampling to estimate the marginal likelihood for the Expectancy Valence (EV) model---a popular model for reinforcement learning. Our results indicate that bridge sampling provides accurate estimates for both a single participant and a hierarchical version of the EV model. We conclude that bridge sampling is an attractive method for mathematical psychologists who typically aim to approximate the marginal likelihood for a limited set of possibly high-dimensional models.
Recommendations
- Estimating marginal likelihoods for mixture and Markov switching models using bridge sampling techniques*
- Thermodynamic integration and steppingstone sampling methods for estimating Bayes factors: a tutorial
- Keeping the balance -- bridge sampling for marginal likelihood estimation in finite mixture, mixture of experts and Markov mixture models
- Estimating marginal likelihoods from the posterior draws through a geometric identity
- scientific article; zbMATH DE number 2104218
Cites work
- scientific article; zbMATH DE number 3152611 (Why is no real title available?)
- scientific article; zbMATH DE number 509150 (Why is no real title available?)
- scientific article; zbMATH DE number 597911 (Why is no real title available?)
- scientific article; zbMATH DE number 947416 (Why is no real title available?)
- scientific article; zbMATH DE number 2104218 (Why is no real title available?)
- scientific article; zbMATH DE number 795289 (Why is no real title available?)
- scientific article; zbMATH DE number 3189754 (Why is no real title available?)
- scientific article; zbMATH DE number 3196612 (Why is no real title available?)
- A Bayesian test for the hot hand phenomenon
- A comparison model of reinforcement-learning and win-stay-lose-shift decision-making processes: a tribute to W. K. Estes
- A tutorial on Bayes factor estimation with the product space method
- An encompassing prior generalization of the Savage-Dickey density ratio
- An evaluation of alternative methods for testing hypotheses, from the perspective of Harold Jeffreys
- Bayes Factors
- Bayesian Measures of Model Complexity and Fit
- Bayesian estimation of multinomial processing tree models with heterogeneity in participants and items
- Bayesian model averaging: A tutorial. (with comments and a rejoinder).
- Bayesian parameter estimation in the Expectancy Valence model of the Iowa gambling task
- Bayesian predictive information criterion for the evaluation of hierarchical Bayesian and empirical Bayes models
- Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
- Default Bayesian model determination methods for generalised linear mixed models
- Editors' introduction to the special issue ``Bayes factors for testing hypotheses in psychological research: practical relevance and new developments
- Estimating Bayes Factors via Posterior Simulation With the Laplace-Metropolis Estimator
- Estimating marginal likelihoods for mixture and Markov switching models using bridge sampling techniques*
- Estimating the dimension of a model
- Evaluating evidence for invariant items: a Bayes factor applied to testing measurement invariance in IRT models
- Harold Jeffreys's default Bayes factor hypothesis tests: explanation, extension, and application in psychology
- J. B. S. Haldane's contribution to the Bayes factor hypothesis test
- Likelihood-free estimation of model evidence
- Marginal Likelihood From the Metropolis–Hastings Output
- Markov chain Monte Carlo. Stochastic simulation for Bayesian inference.
- Modeling individual differences using Dirichlet processes
- Polynomial splines and their tensor products in extended linear modeling. (With discussions)
- Posterior model probabilities via path‐based pairwise priors
- Prototypes, exemplars and the response scaling parameter: a Bayes factor perspective
- Rejection odds and rejection ratios: a proposal for statistical practice in testing hypotheses
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determination
- Safe and Effective Importance Sampling
- Signal detection models with random participant and item effects
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
- Special issue on model selection
- The Weighted Likelihood Ratio, Linear Hypotheses on Normal Location Parameters
- The Weighted Likelihood Ratio, Sharp Hypotheses about Chances, the Order of a Markov Chain
- The expected demise of the Bayes factor
- The growth of Bayesian methods in statistics and economics since 1970
Cited in
(22)- Mixtures of peaked power Batschelet distributions for circular data with application to saccade directions
- Improving the efficiency and robustness of nested sampling using posterior repartitioning
- Thermodynamic integration and steppingstone sampling methods for estimating Bayes factors: a tutorial
- Approximate leave-future-out cross-validation for Bayesian time series models
- Bayesian model-averaged meta-analysis in medicine
- Hamiltonian Markov chain Monte Carlo for partitioned sample spaces with application to Bayesian deep neural nets
- Beyond conjugacy for chain event graph model selection
- A simple method for comparing complex models: Bayesian model comparison for hierarchical multinomial processing tree models using Warp-III bridge sampling
- Objective Bayesian edge screening and structure selection for Ising networks
- A Bayes Factor for Replications of ANOVA Results
- Bayesian modelling of effects of prenatal alcohol exposure on child cognition based on data from multiple cohorts
- Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
- Target-aware Bayesian inference: how to beat optimal conventional estimators
- Hierarchical multivariate directed acyclic graph autoregressive models for spatial diseases mapping
- A tutorial on Fisher information
- Standard errors, priors, and bridge sampling: a discussion of Liu et al.
- Keeping the balance -- bridge sampling for marginal likelihood estimation in finite mixture, mixture of experts and Markov mixture models
- Warp Bridge Sampling: The Next Generation
- Properties of the bridge sampler with a focus on splitting the MCMC sample
- Bayesian shrinkage in mixture-of-experts models: identifying robust determinants of class membership
- A Mode-Jumping Algorithm for Bayesian Factor Analysis
- A general approximation to nested Bayes factors with informed priors
This page was built for publication: A tutorial on bridge sampling
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q1690608)
