Recursive pathways to marginal likelihood estimation with prior-sensitivity analysis
From MaRDI portal
Abstract: We investigate the utility to computational Bayesian analyses of a particular family of recursive marginal likelihood estimators characterized by the (equivalent) algorithms known as "biased sampling" or "reverse logistic regression" in the statistics literature and "the density of states" in physics. Through a pair of numerical examples (including mixture modeling of the well-known galaxy data set) we highlight the remarkable diversity of sampling schemes amenable to such recursive normalization, as well as the notable efficiency of the resulting pseudo-mixture distributions for gauging prior sensitivity in the Bayesian model selection context. Our key theoretical contributions are to introduce a novel heuristic ("thermodynamic integration via importance sampling") for qualifying the role of the bridging sequence in this procedure and to reveal various connections between these recursive estimators and the nested sampling technique.
Recommendations
- Estimating marginal likelihoods from the posterior draws through a geometric identity
- Nested sampling for general Bayesian computation
- Properties of nested sampling
- Estimating marginal likelihoods for mixture and Markov switching models using bridge sampling techniques*
- Marginal Likelihood from the Gibbs Output
Cites work
- -stable limit laws for harmonic mean estimators of marginal likelihoods
- A path sampling identity for computing the Kullback-Leibler and J divergences
- A sequential particle filter method for static models
- A Stochastic Simulation Approach to Model Selection for Stochastic Volatility Models
- A Theory of Statistical Models for Monte Carlo Integration
- Adaptive multiple importance sampling
- Application of the Radon-Nikodym Theorem to the Theory of Sufficient Statistics
- Bayes Factors
- Bayesian analysis of mixture models with an unknown number of components\,--\,an alternative to reversible jump methods.
- Bayesian Density Estimation and Inference Using Mixtures
- Bayesian model averaging: A tutorial. (with comments and a rejoinder).
- Computing the Bayes factor from a Markov chain Monte Carlo simulation of the posterior distribution
- Conditional distributions as derivatives
- Density Estimation With Confidence Sets Exemplified by Superclusters and Voids in the Galaxies
- Empirical distributions in selection bias models
- Estimating Bayes factors via thermodynamic integration and population MCMC
- Exact sampling and counting for fixed-margin matrices
- scientific article; zbMATH DE number 6114089 (Why is no real title available?)
- scientific article; zbMATH DE number 3824308 (Why is no real title available?)
- scientific article; zbMATH DE number 509150 (Why is no real title available?)
- scientific article; zbMATH DE number 597901 (Why is no real title available?)
- scientific article; zbMATH DE number 597911 (Why is no real title available?)
- scientific article; zbMATH DE number 1085980 (Why is no real title available?)
- scientific article; zbMATH DE number 947416 (Why is no real title available?)
- scientific article; zbMATH DE number 1911984 (Why is no real title available?)
- scientific article; zbMATH DE number 849932 (Why is no real title available?)
- scientific article; zbMATH DE number 3274494 (Why is no real title available?)
- scientific article; zbMATH DE number 3189754 (Why is no real title available?)
- scientific article; zbMATH DE number 3060775 (Why is no real title available?)
- Hyperparameter and model selection for nonparametric Bayes problems via Radon-Nikodym derivatives
- Invariance principles for sums of Banach space valued random elements and empirical processes
- Large sample theory of empirical distributions in biased sampling models
- Marginal Likelihood Estimation via Power Posteriors
- Marginal Likelihood from the Gibbs Output
- Markov chain Monte Carlo methods and the label switching problem in Bayesian mixture modeling
- Markov chains for exploring posterior distributions. (With discussion)
- Mixtures of Dirichlet processes with applications to Bayesian nonparametric problems
- Monotone Iterations for Nonlinear Equations with Application to Gauss-Seidel Methods
- Monte Carlo methods in Bayesian computation
- Monte Carlo strategies in scientific computing
- Nested sampling for general Bayesian computation
- On Monte Carlo methods for estimating ratios of normalizing constants
- On resolving the Savage-Dickey paradox
- Practical Bayesian Density Estimation Using Mixtures of Normals
- Probability Theory
- Properties of nested sampling
- Sequential Imputations and Bayesian Missing Data Problems
- Sequential Monte Carlo Samplers
- Simulating normalizing constants: From importance sampling to bridge sampling to path sampling
- Weighted Average Importance Sampling and Defensive Mixture Distributions
Cited in
(13)- Bayes posterior convergence for loss functions via almost additive thermodynamic formalism
- Dynamic nested sampling: an improved algorithm for parameter estimation and evidence calculation
- Thermodynamic Bayesian model comparison
- Consistency of adaptive importance sampling and recycling schemes
- A statistical test for nested sampling algorithms
- An efficient computational approach for prior sensitivity analysis and cross‐validation
- Constraining the break of spatial diffeomorphism invariance with Planck data
- Marginal Likelihood Computation for Model Selection and Hypothesis Testing: An Extensive Review
- Nested sampling methods
- On the safe use of prior densities for Bayesian model selection
- Combining adaptive MCMC and nested sampling for robust Bayesian model selection with reduced prior sensitivity
- A note on the area under the likelihood and the fake evidence for model selection
- Enhanced convergence rates of adaptive importance sampling with recycling schemes via quasi-Monte Carlo methods
This page was built for publication: Recursive pathways to marginal likelihood estimation with prior-sensitivity analysis
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q252729)
