Blending Bayesian and frequentist methods according to the precision of prior information with applications to hypothesis testing
From MaRDI portal
(Redirected from Publication:897846)
Abstract: The following zero-sum game between nature and a statistician blends Bayesian methods with frequentist methods such as p-values and confidence intervals. Nature chooses a posterior distribution consistent with a set of possible priors. At the same time, the statistician selects a parameter distribution for inference with the goal of maximizing the minimum Kullback-Leibler information gained over a confidence distribution or other benchmark distribution. An application to testing a simple null hypothesis leads the statistician to report a posterior probability of the hypothesis that is informed by both Bayesian and frequentist methodology, each weighted according how well the prior is known. Since neither the Bayesian approach nor the frequentist approach is entirely satisfactory in situations involving partial knowledge of the prior distribution, the proposed procedure reduces to a Bayesian method given complete knowledge of the prior, to a frequentist method given complete ignorance about the prior, and to a blend between the two methods given partial knowledge of the prior. The blended approach resembles the Bayesian method rather than the frequentist method to the precise extent that the prior is known. The problem of testing a point null hypothesis illustrates the proposed framework. The blended probability that the null hypothesis is true is equal to the p-value or a lower bound of an unknown Bayesian posterior probability, whichever is greater. Thus, given total ignorance represented by a lower bound of 0, the p-value is used instead of any Bayesian posterior probability. At the opposite extreme of a known prior, the p-value is ignored. In the intermediate case, the possible Bayesian posterior probability that is closest to the p-value is used for inference. Thus, both the Bayesian method and the frequentist method influence the inferences made.
Recommendations
- Bayesian frequentist hybrid inference
- The multivariate point null testing problem: a Bayesian discussion
- Reconciling Bayesian and frequentist evidence in the point null testing problem
- scientific article; zbMATH DE number 1302157
- \(\varepsilon\)-contaminated priors in testing point null hypothesis: A procedure to determine the prior probability
Cites work
- scientific article; zbMATH DE number 3934086 (Why is no real title available?)
- scientific article; zbMATH DE number 3667770 (Why is no real title available?)
- scientific article; zbMATH DE number 48344 (Why is no real title available?)
- scientific article; zbMATH DE number 3583699 (Why is no real title available?)
- scientific article; zbMATH DE number 3621626 (Why is no real title available?)
- scientific article; zbMATH DE number 720689 (Why is no real title available?)
- scientific article; zbMATH DE number 4123039 (Why is no real title available?)
- scientific article; zbMATH DE number 3441432 (Why is no real title available?)
- scientific article; zbMATH DE number 5586074 (Why is no real title available?)
- scientific article; zbMATH DE number 3068128 (Why is no real title available?)
- scientific article; zbMATH DE number 3087284 (Why is no real title available?)
- A Bayesian perspective on the Bonferroni adjustment
- A STATISTICAL PARADOX
- A predictive approach to measuring the strength of statistical evidence for single and multiple comparisons
- A prior-free framework of coherent inference and its derivation of simple shrinkage estimators
- A unified conditional frequentist and Bayesian test for fixed and sequential simple hypothesis testing
- Abstract methods in information theory
- Ancillaries and conditional inference (with comments and rejoinder)
- Bayes factors: Prior sensitivity and model generalizability
- Bayesian and robust Bayesian analysis under a general class of balanced loss functions
- Bayesian frequentist hybrid inference
- Calibration of \(\rho \) values for testing precise null hypotheses
- Coherent frequentism: a decision theory based on confidence sets
- Combining marginal probability distributions via minimization of weighted sum of Kullback-Leibler divergences
- Combining probability distributions: A critique and an annotated bibliography
- Comment
- Confidence and Likelihood*
- Confidence distributions: a review
- Controlling the degree of caution in statistical inference with the Bayesian and frequentist approaches as opposite extremes
- Elementary fundamentals of a more general probability theory. I: Interval probability as comprehensive conception. In cooperation with T. Augustin and A. Wallner
- Elements of Information Theory
- Estimating the null distribution to adjust observed confidence levels for genome-scale screening
- Estimators of the local false discovery rate designed for small numbers of tests
- Expected utility within a generalized concept of probability -- a comprehensive framework for decision making under ambiguity
- Game theory, maximum entropy, minimum discrepancy and robust Bayesian decision theory
- Game-theoretic probability combination with applications to resolving conflicts between statistical methods
- In defence of objective Bayesianism
- In defense of the maximum entropy inference process
- Inference rules and inferential distributions
- Large-scale inference. Empirical Bayes methods for estimation, testing, and prediction
- Mathematical foundations for a theory of confidence structures
- Maximum entropy fundamentals
- Maxmin expected utility with non-unique prior
- Observed Confidence Levels
- Optimal decisions under complex uncertainty – basic notions and a general algorithm for data‐based decision making with partial prior knowledge described by interval probability
- Principles of Statistical Inference
- Probability Theory
- Rectangular Confidence Regions for the Means of Multivariate Normal Distributions
- Rejoinder
- Robust Bayesian analysis: sensitivity to the prior
- Sensitivity in Bayesian Statistics: The Prior and the Likelihood
- Simple estimators of false discovery rates given as few as one or two \(p\)-values without strong parametric assumptions
- Small-scale inference: empirical Bayes and confidence methods for as few as a single comparison
- Statistical decision theory and Bayesian analysis. 2nd ed
- Stochastic independence in a coherent setting
- Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence
- That BLUP is a good thing: The estimation of random effects. With comments and a rejoinder by the author
- The Selection of Prior Distributions by Formal Rules
- The Uncertain Reasoner's Companion
- The formal definition of reference priors
- The functional-model basis of fiducial inference
- The theory of interval-probability as a unifying concept for uncertainty
- Unreliable probabilities, risk taking, and decision making
- Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems
- Γ-Minimax: A Paradigm for Conservative Robust Bayesians
Cited in
(6)- Departing from Bayesian inference toward minimaxity to the extent that the posterior distribution is unreliable
- Bayesian frequentist hybrid inference
- Inference after checking multiple Bayesian models for data conflict and applications to mitigating the influence of rejected priors
- Model fusion and multiple testing in the likelihood paradigm: shrinkage and evidence supporting a point null hypothesis
- Maximum entropy derived and generalized under idempotent probability to address Bayes-frequentist uncertainty and model revision uncertainty: an information-theoretic semantics for possibility theory
- Bayesian neural tree models for nonparametric regression
This page was built for publication: Blending Bayesian and frequentist methods according to the precision of prior information with applications to hypothesis testing
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q897846)
