Quantifying observed prior impact
From MaRDI portal
Abstract: We distinguish two questions (i) how much information does the prior contain? and (ii) what is the effect of the prior? Several measures have been proposed for quantifying effective prior sample size, for example Clarke [1996] and Morita et al. [2008]. However, these measures typically ignore the likelihood for the inference currently at hand, and therefore address (i) rather than (ii). Since in practice (ii) is of great concern, Reimherr et al. [2014] introduced a new class of effective prior sample size measures based on prior-likelihood discordance. We take this idea further towards its natural Bayesian conclusion by proposing measures of effective prior sample size that not only incorporate the general mathematical form of the likelihood but also the specific data at hand. Thus, our measures do not average across datasets from the working model, but condition on the current observed data. Consequently, our measures can be highly variable, but we demonstrate that this is because the impact of a prior can be highly variable. Our measures are Bayes estimates of meaningful quantities and well communicate the extent to which inference is determined by the prior, or framed differently, the amount of effort saved due to having prior information. We illustrate our ideas through a number of examples including a Gaussian conjugate model (continuous observations), a Beta-Binomial model (discrete observations), and a linear regression model (two unknown parameters). Future work on further developments of the methodology and an application to astronomy are discussed at the end.
Cites work
- scientific article; zbMATH DE number 5133222 (Why is no real title available?)
- scientific article; zbMATH DE number 946667 (Why is no real title available?)
- scientific article; zbMATH DE number 3322635 (Why is no real title available?)
- f -Divergence Inequalities
- A general divergence criterion for prior selection
- A simulation-based approach to Bayesian sample size determination for performance under a given model and for separating models
- Assessing the accuracy of the maximum likelihood estimator: Observed versus expected Fisher information
- Asymptotic Statistics
- Calibration concordance for astronomical instruments via multiplicative shrinkage
- Checking for prior-data conflict
- Checking for prior-data conflict using prior-to-posterior divergences
- Closed form expressions for Bayesian sample size
- Commensurate priors for incorporating historical information in clinical trials using general and generalized linear models
- Determining the Effective Sample Size of a Parametric Prior
- Diagnostics of prior-data agreement in applied Bayesian analysis
- Handbook of Markov Chain Monte Carlo
- Implications of Reference Priors for Prior Information and for Sample Size
- Imprecision and prior-data conflict in generalized Bayesian inference
- Inequalities for E k(X, Y) when the marginals are fixed
- Information conversion, effective samples, and parameter size
- Monte Carlo strategies in scientific computing.
- Objective priors: an introduction for frequentists
- On a class of objective priors from scoring rules (with discussion)
- Overall objective priors
- Predictively consistent prior effective sample sizes
- Prior distributions for objective Bayesian analysis
- Quantification of prior impact in terms of effective current sample size
- Robust Bayes and empirical Bayes analysis with -contaminated priors
- Robust Bayesian analysis: sensitivity to the prior
- Sensitivity analysis for Bayesian hierarchical models
- Sensitivity analysis in Bayesian generalized linear mixed models for binary data
- The Selection of Prior Distributions by Formal Rules
- Using prior expansions for prior-data conflict checking
This page was built for publication: Quantifying observed prior impact
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6121775)