Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
From MaRDI portal
The Bayes factor is a ratio of two posterior normalizing constants, which may be difficult to compute. We compare several methods of estimating Bayes factors when it is possible to simulate observations from the posterior distributions, via Markov chain Monte Carlo or other techniques. The methods that we study are all easily applied without consideration of special features of the problem, provided that each posterior distribution is well behaved in the sense of having a single dominant mode. We consider a simulated version of Laplace's method, a simulated version of Bartlett correction, importance sampling, and a reciprocal importance sampling technique. We also introduce local volume corrections for each of these. In addition, we apply the bridge sampling method of \textit{X-L. Meng} and \textit{W.H. Wong} [Stat. Sin. 6, 831--860 (1996; Zbl 0857.62017)]. We find that a simulated version of Laplace's method, with local volume correction, furnishes an accurate approximation that is especially useful when likelihood function evaluations are costly. A simple bridge sampling technique in conjunction with Laplace's method often achieves an order of magnitude improvement in accuracy.
Recommendations
- Computing Bayes Factors Using a Generalization of the Savage-Dickey Density Ratio
- Computing the Bayes factor from a Markov chain Monte Carlo simulation of the posterior distribution
- Efficient Bayes factor estimation from the reversible jump output
- Using MCMC chain outputs to efficiently estimate Bayes factors
Cited in
(only showing first 100 items - show all)- MCMC-based local parametric sensitivity estimations
- Marginal likelihoods for non-Gaussian models using auxiliary mixture sampling
- On Bayesian estimation and model comparison of an integrated structural equation model
- Bayes factors and hierarchical models
- Decomposing posterior variance
- Posterior inference in the random intercept model based on samples obtained with Markov chain Monte Carlo methods
- Bayesian model averaging: A tutorial. (with comments and a rejoinder).
- A Bayesian model selection method with applications
- An internally consistent approach to the estimation of market power and cost efficiency with an application to U.S. banking
- Smooth approximations to monotone concave functions in production analysis: an alternative to nonparametric concave least squares
- Debt dynamics in Europe: a network general equilibrium GVAR approach
- A tutorial on bridge sampling
- On the estimation of total factor productivity: a novel Bayesian non-parametric approach
- Endogenous bank risk and efficiency
- Model uncertainty
- Bayesian analysis of mixture models with an unknown number of components\,--\,an alternative to reversible jump methods.
- Approximating the marginal likelihood estimate for models with random parameters
- On the calibration of Bayesian model choice criteria
- Optimal volume-corrected Laplace-Metropolis method
- A semiparametric Bayesian approach to generalized partial linear mixed models for longitudinal data
- An introduction to model selection
- Bayesian model selection and model averaging
- Generalized estimation of productivity with multiple bad outputs: the importance of materials balance constraints
- Comparison of stochastic frontier models using the Hyvärinen factor
- A model selection approach for variable selection with censored data
- Approximate Laplace importance sampling for the estimation of expected Shannon information gain in high-dimensional Bayesian design for nonlinear models
- Bayes factor asymptotics for variable selection in the Gaussian process framework
- A comparison of Monte Carlo methods for computing marginal likelihoods of item response theory models
- Modeling price response from retail sales: an empirical comparison of models with different representations of heterogeneity
- Model comparison of nonlinear structural equation models with fixed covariates
- Bayesian analysis of nonlinear structural equation models with nonignorable missing data
- Keeping the balance -- bridge sampling for marginal likelihood estimation in finite mixture, mixture of experts and Markov mixture models
- A simple method for comparing complex models: Bayesian model comparison for hierarchical multinomial processing tree models using Warp-III bridge sampling
- Bayesian analysis for dynamic generalized linear latent model with application to tree survival rate
- Joint genome-wide prediction in several populations accounting for randomness of genotypes: a hierarchical Bayes approach. II: Multivariate spike and slab priors for marker effects and derivation of approximate Bayes and fractional Bayes factors for the complete family of models
- Bayesian inference and model comparison for metallic fatigue data
- Monte Carlo integration with Markov chain
- A tutorial on the Bayesian approach for analyzing structural equation models
- Bayesian inference with stochastic volatility models using continuous superpositions of non-Gaussian Ornstein-Uhlenbeck processes
- Bayes model selection with path sampling: factor models and other examples
- Explaining the behavior of joint and marginal Monte Carlo estimators in latent variable models with independence assumptions
- Computing the Bayes factor from a Markov chain Monte Carlo simulation of the posterior distribution
- Generalized fiducial factor: an alternative to the Bayes factor for forensic identification of source problems
- Improved marginal likelihood estimation via power posteriors and importance sampling
- A matching prior for the shape parameter of the skew-normal distribution
- Computing critical values of exact tests by incorporating Monte Carlo simulations combined with statistical tables
- A Hybrid Approximation Bayesian Test of Variance Components for Longitudinal Data
- A Stochastic Simulation Approach to Model Selection for Stochastic Volatility Models
- Bayesian inference for generalized linear mixed models
- Bayesian mixture modeling using a hybrid sampler with application to protein subfamily identification
- Performance of Variable Selection Methods in Regression Using Variations of the Bayesian Information Criterion
- scientific article; zbMATH DE number 1052811 (Why is no real title available?)
- Estimating Bayes Factors via Posterior Simulation With the Laplace-Metropolis Estimator
- A new class of multivariate skew distributions with applications to bayesian regression models
- A fast distance-based approach for determining the number of components in mixtures
- A criterion-based model comparison statistic for structural equation models with heterogeneous data
- Trends and cycles in economic time series: a Bayesian approach
- Bayes Factors and Approximations for Variance Component Models
- Corbelled Domes in Two and Three Dimensions: The Treasury of Atreus
- Computing Bayes Factors Using a Generalization of the Savage-Dickey Density Ratio
- Bayesian comparative study on binary time series
- Simultaneous probability statements for Bayesian P-splines
- Bayesian model selection in complex linear systems, as illustrated in genetic association studies
- scientific article; zbMATH DE number 7508945 (Why is no real title available?)
- Bayesian Approaches to Shrinkage and Sparse Estimation
- Bain: a program for Bayesian testing of order constrained hypotheses in structural equation models
- Extended Bayesian model averaging for heritability in twin studies
- Some results on the scalar skew-normal distribution
- Importance sampling schemes for evidence approximation in mixture models
- An MCMC model search algorithm for regression problems
- Variable selection in Bayesian generalized linear‐mixed models: An illustration using candidate gene case‐control association studies
- Motor Unit Number Estimation—A Bayesian Approach
- Bayesian analysis of the factor model with finance applications
- Bayesian methods for analysing ringing data
- Bayesian Adaptive Regression Splines for Hierarchical Data
- Recursive computing and simulation-free inference for general factorizable models
- Efficient Bayes factor estimation from the reversible jump output
- Marginal Likelihood Computation for Model Selection and Hypothesis Testing: An Extensive Review
- Monte Carlo Approximation of Bayes Factors via Mixing With Surrogate Distributions
- Warp Bridge Sampling: The Next Generation
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
- Bayesian survival estimation of Pareto distribution of the second kind based on failure-censored data.
- Bayesian artificial neural networks for frontier efficiency analysis
- Applications of Laplace’s method in Bayesian analysis and related topics
- Dynamic network data envelopment analysis with a sequential structure and behavioural-causal analysis: application to the Chinese banking industry
- Minimax regret priors for efficiency estimation
- Bayesian learning in performance. Is there any?
- An efficient stochastic simulation algorithm for Bayesian unit root testing in stochastic volatility models
- Bayesian hybrid generative discriminative learning based on finite Liouville mixture models
- A tutorial on Bayes factor estimation with the product space method
- Using MCMC chain outputs to efficiently estimate Bayes factors
- Model selection in toxicity studies
- Bayesian inference using least median of squares and least trimmed squares in models with independent or correlated errors and outliers
- Bayesian Spline-Based Hidden Markov Models with Applications to Actimetry Data and Sleep Analysis
- Monte Carlo methods with infinite variances
- Easily computed marginal likelihoods from posterior simulation using the THAMES estimator
- A review of Markov chain Monte Carlo and information theory tools for inverse problems in subsurface flow
- Determine the number of states in hidden Markov models via marginal likelihood
- Generalized Bayesian Additive Regression Trees Models: Beyond Conditional Conjugacy
- Women, immigrants, and microcredit in Europe: a Bayesian approach
This page was built for publication: Computing Bayes Factors by Combining Simulation and Asymptotic Approximations
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q4366181)
