Practical valid inferences for the two-sample binomial problem (Q76638)

This paper is a study on Fisher's exact test. The question is whether two binomial parameters differ, which parameter is larger, and by how much. The authors define a frequentist triple as an estimator of the parameter of interest, a confidence interval, and a \(p\)-value function with computational issues. They evaluate both, the properties of validity and power \textit{and} confidence intervals, their coverage, and expected length. They limit the scope of this paper by considering only frequentist approaches, leaving out asymptotic methods or other approximations. They work out that no method can meet all the desirable properties and give recommendations based on which properties are given more importance. They examine a real application to discuss the issues. They show properties of frequentist triples. They develop methods for creating one-sided exact unconditional testing procedures, one-sided conditional exact tests, melded confidence intervals, non-central confidence intervals and associated tests, and mid-\(p\) methods. Finally, they give some recommendations how to perform frequentist inferences on the two-sample binomial problem.