Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence

DOI10.2307/2289131zbMath0612.62022OpenAlexW4243759473MaRDI QIDQ3753258

Publication date: 1987

Published in: Journal of the American Statistical Association (Search for Journal in Brave)

Full work available at URL: https://doi.org/10.2307/2289131

zbMATH Keywords

p-values posterior probability objective prior point null hypothesis frequentist testing impartial prior Jeffreys' Bayesian analysis

Mathematics Subject Classification ID

Parametric hypothesis testing (62F03) Bayesian inference (62F15) Foundations and philosophical topics in statistics (62A01)

Related Items

Belief and truth in hypothesised behaviours, Bayesian and frequentist evidence in one-sided hypothesis testing, Statistical evidence and sample size determination for Bayesian hypothesis testing, Posterior robustness with more than one sampling model. (With discussion), Robust Bayesian hypothesis testing in the presence of nuisance parameters, Bayesian nonparametric \(k\)-sample tests for censored and uncensored data, Bayesian testing of a point null hypothesis based on the latent information prior, A novel relative entropy-posterior predictive model checking approach with limited information statistics for latent trait models in sparse \(2^k\) contingency tables, Improved estimation of accuracy in simple hypothesis versus simple alternative testing, Editors' introduction to the special issue ``Bayes factors for testing hypotheses in psychological research: practical relevance and new developments, The philosophy of Bayes factors and the quantification of statistical evidence, Automatic Bayes factors for testing variances of two independent normal distributions, Bayesian tests of symmetry for the generalized von Mises distribution, Testing un-separated hypotheses by estimating a distance, An overview of robust Bayesian analysis. (With discussion), Distance weighted losses for testing and confidence set evaluation, A Bayesian approach to the multivariate Behrens-Fisher problem under the assumption of proportional covariance matrices, Bayesian inference given data `significant at \(\alpha\)': Tests of point hypotheses, Theoretical and empirical distributions of the \(p\) value, Invariant \(P\)-values for model checking, Prediction markets, Bayesian priors, and clinical trials, On intrinsic priors for nonnested models, The likelihood of various stock market return distributions. I: Principles of inference, Modified \(p\)-values for one-sided testing in restricted parameter spaces, Bayesian model selection for unit root testing with multiple structural breaks, Noninformative Bayesian testing and neutral Bayes factors, Convergence of posterior odds, Bayesian tests for the balanced two-way analysis of variance model, Goodness of fit for models with intractable likelihood, Bayesian hypotheses testing using posterior density ratios, Uniformly most powerful Bayesian tests, Bayesian inference through encompassing priors and importance sampling for a class of marginal models for categorical data, A prior-free framework of coherent inference and its derivation of simple shrinkage estimators, Decision-theoretic justifications for Bayesian hypothesis testing using credible sets, Blending Bayesian and frequentist methods according to the precision of prior information with applications to hypothesis testing, Equivalence between the posterior distribution of the likelihood ratio and a \(p\)-value in an invariant frame, Harold Jeffreys's \textit{Theory of probability} revisited, Optimal properties of some Bayesian inferences, The consistency test does not -- and cannot -- deliver what is advertised: a comment on Francis (2013), The Jeffreys-Lindley paradox and discovery criteria in high energy physics, A tutorial on the Bayesian approach for analyzing structural equation models, Subjective probability and quantum certainty, Using MCMC chain outputs to efficiently estimate Bayes factors, Fuzzy \(p\)-value in testing fuzzy hypotheses with crisp data, Asymptotic relationships between posterior probabilities and \(p\)-values using the hazard rate., Posterior predictive checks: principles and discussion procedures, Type S error for classical and Bayesian single and multiple comparison procedures, Reconciling Bayesian and frequentist evidence in the point null testing problem, Bayesian model averaging: A tutorial. (with comments and a rejoinder)., Could Fisher, Jeffreys and Neyman have agreed on testing? (With comments and a rejoinder)., Statistical properties of the fuzzy \(p\)-value, Frequentist properties of Bayesian inequality tests, Forecasting seasonal time series data: a Bayesian model averaging approach, \(\varepsilon\)-contaminated priors in testing point null hypothesis: A procedure to determine the prior probability, \(\varepsilon\)-contaminated priors in contingency tables, Power analysis and type I and type II error rates of Bayesian nonparametric two-sample tests for location-shifts based on the Bayes factor under Cauchy priors, Highest predictive density estimator in regression models, The agreement between the generalized \(p\) value and Bayesian evidence in the one-sided testing problem, Bayesian inference and testing of group differences in brain networks, The multivariate point null testing problem: a Bayesian discussion, A note on Lindley's paradox, A two-component Weibull mixture to model early and late mortality in a Bayesian framework, Bayesian model selection approach to the one way analysis of variance under homoscedasticity, A Bayesian alternative to parametric hypothesis testing, The Bayesian and frequentist approaches to testing a one-sided hypothesis about a multivariate mean, A conversation with James O. Berger, Bayesian Semiparametric Mixed Effects Markov Models With Application to Vocalization Syntax, On stochastic orderings of the Wilcoxon rank sum test statistic-with applications to reproducibility probability estimation testing, \(r\times s\) tables from a Bayesian viewpoint, The false discovery rate: a variable selection perspective, Default Bayes factors for ANOVA designs, Estimation of careless error and lucky guess probabilities for dichotomous test items: a psychometric application of a biometric latent class model with random effects, Integral priors for Bayesian model selection: how they operate from simple to complex cases, Two-sample test for sparse high-dimensional multinomial distributions, Assessing post-data weight of evidence, Bayesian value-at-risk backtesting: the case of annuity pricing, Bayesian nonparametric model selection and model testing, Analysis of type I and II error rates of Bayesian and frequentist parametric and nonparametric two-sample hypothesis tests under preliminary assessment of normality, Model equivalence tests in a parametric framework, A new Bayesian procedure for testing point null hypotheses, False confidence, non-additive beliefs, and valid statistical inference, Robust Bayesian analysis: sensitivity to the prior, The Bayes factor for inequality and about equality constrained models, Bayesian significance testing and multiple comparisons from MCMC outputs, Lower bounds on Bayes factors for invariant testing situations, Automatic Bayes factors for testing equality- and inequality-constrained hypotheses on variances, Robust Bayesian displays for standard inferences concerning a normal mean, A conversation with Robert E. Kass, Some new statistics for testing point null hypotheses with prior information, Bayesian hypothesis testing: redux, Comparison of the \(p\)-value and posterior probability, Bayes factors and hierarchical models, Tests and optimal guarded weights of evidence, The posterior predictive \(p\)-value for the problem of goodness of fit, Interpreting \(p\)-values and confidence intervals using well-calibrated null preference priors, Unified frequentist and Bayesian testing of a precise hypothesis. With comments by Dennis V. Lindley, Thomas A. Louis and David Hinkley and a rejoinder by the authors, Nonsubjective Bayes testing -- an overview, A classical measure of evidence for general null hypotheses, Approximate Bayesian model selection with the deviance statistic, Bayesian measures of surprise for outlier detection, Prior-based Bayesian information criterion, Discussion on prior-based Bayes information criterion, AN ADAPTIVE PROCEDURE FOR GOODNESS-OF-FIT BASED ON SAMPLE SPACINGS, How the Maximal Evidence of P-Values Against Point Null Hypotheses Depends on Sample Size, Bayesian, classical and hybrid methods of inference when one parameter value is special, Multiple testing with heterogeneous multinomial distributions, Bayes Factors Based on p-Values and Sets of Priors With Restricted Strength, A SUITABLE BAYESIAN APPROACH IN TESTING POINT NULL HYPOTHESIS: SOME EXAMPLES REVISITED, Hypothesis Testing in Presence of Adversaries, Toward Replicability With Confidence Intervals for the Exceedance Probability, Reconnecting p-Value and Posterior Probability Under One- and Two-Sided Tests, Bayesian testing of an exponential point null hypothesis, A bayesian approach to the comparison of two means, Empirical Bayes approach to wavelet regression using ϵ-contaminated priors, Plug-in tests for nonequivalence of means of independent normal populations, Lower bounds on bayes factors for a linear regression model, Detection of outliers and influential observations in regression analysis using stochastic prior information, Analysis of incomplete data under non-random mechanisms: bayesian inference, Bayesian Calibration of p‐Values from Fisher's Exact Test, Calibrated Bayes factors under flexible priors, A more powerful test for three-arm non-inferiority via risk difference: Frequentist and Bayesian approaches, Classical \(p\)-values and the Bayesian posterior probability that the hypothesis is approximately true, Non-Experimental Data, Hypothesis Testing, and the Likelihood Principle: A Social Science Perspective, The evidence interval and the Bayesian evidence value: On a unified theory for Bayesian hypothesis testing and interval estimation, Fisher's exact test from a Bayes perspective, Bayesian optimization analysis with ML-II ϵ-contaminated prior, LesP-values comme votes d'experts, The widespread misinterpretation ofp-values as error probabilities, Correlation in a Bayesian framework, Multiplicity-calibrated Bayesian hypothesis tests, Power estimation for testing normal means, A Bayesian Analysis for the Homogeneity Testing Problem Using ϵ–Contaminated Priors, A SHORT NOTE ON REPEATED SIGNIFICANCE TESTS AND THE UNIFIED BAYESIAN-FREQUENTIST MEASURE, On the correspondence between frequentist and Bayesian tests, A multiple testing protocol for exploratory data analysis and the local misclassification rate, Decision analysis and bioequivalence trials, Bayesian Hypothesis Testing in Two‐Arm Trials with Dichotomous Outcomes, Why should clinicians care about Bayesian methods? (With discussions and response), On the Use of Bayes Factor in Frequentist Testing of a Precise Hypothesis, Objective Bayesian Testing of a Poisson Mean, Objective Testing Procedures in Linear Models: Calibration of the p‐values, Comparison of testing procedures utilizingP-values and Bayes factors in some common situations, Bayesian testing of an exponential point null hypothesis, Consistent fractional Bayes factor for nested normal linear models, Sensitivity of some posterior summaries when the prior is unimodal with specified quantiles, Reconciling Classical and Prior PredictiveP-Values in the Two-Sided Location Parameter Testing Problem, The application of robust Bayesian analysis to hypothesis testing and Occam's Razor, Critical issues in different inferential paradigms, An Objective Bayesian Approach to Multistage Hypothesis Testing, Objective priors for hypothesis testing in one‐way random effects models, Unnamed Item, A bayesian test for a two-way contingency table using independence priors, Generalized P-values and Bayesian evidence in the one-sided testing problems under exponential distributions, Restricted most powerful Bayesian tests for linear models, A bayes test for simple versus one-sided hypothesis on the mean vector of a multivariate normal Distribution, Modified p-Value of Two-Sided Test for Normal Distribution with Restricted Parameter Space, A Condition to Obtain the Same Decision in the Homogeneity Testing Problem from the Frequentist and Bayesian Point of View, Bayesian ikference procedures derived via the concept of relative surprise, An evaluation of bayes posterior probability regions for a survival curve, Unnamed Item, Bayes factor in testing precise hypotheses, Comparing Objective and Subjective Bayes Factors for the Two-Sample Comparison: The Classification Theorem in Action, Will the ASA's Efforts to Improve Statistical Practice be Successful? Some Evidence to the Contrary, Quality Control for Scientific Research: Addressing Reproducibility, Responsiveness, and Relevance, ValidP-Values Behave Exactly as They Should: Some Misleading Criticisms ofP-Values and Their Resolution WithS-Values, Evidence From Marginally Significant t Statistics, An Introduction to Second-Generation p-Values, A Proposed Hybrid Effect Size Plus p-Value Criterion: Empirical Evidence Supporting its Use, The False Positive Risk: A Proposal Concerning What to Do About p-Values, Abandon Statistical Significance, Assessing the Statistical Analyses Used in Basic and Applied Social Psychology After Their p-Value Ban, Benjamin, D. J., and Berger, J. O. (2019), “Three Recommendations for Improving the Use of p-Values”, The American Statistician, 73, 186–191: Comment by Foulley, The Detection of Nonnegligible Directional Effects With Associated Measures of Statistical Significance, Bayesian evidence for α-attractor dark energy models, Advantages of Variance Stabilization, The numerical reconcilability of Bayesian measure and p-value in interval hypotheses is not possible in general, A Default Bayesian Hypothesis Test for ANOVA Designs