What is a Randomization Test?
From MaRDI portal
Abstract: The meaning of randomization tests has become obscure in statistics education and practice over the last century. This article makes a fresh attempt at rectifying this core concept of statistics. A new term -- "quasi-randomization test" -- is introduced to define significance tests based on theoretical models and distinguish these tests from the "randomization tests" based on the physical act of randomization. The practical importance of this distinction is illustrated through a real stepped-wedge cluster-randomized trial. Building on the recent literature of randomization inference, a general framework of conditional randomization tests is developed and some practical methods to construct conditioning events are given. The proposed terminology and framework are then applied to understand several widely used (quasi-)randomization tests, including Fisher's exact test, permutation tests for treatment effect, quasi-randomization tests for independence and conditional independence, adaptive randomization, and conformal prediction.
Cites work
- scientific article; zbMATH DE number 3117956 (Why is no real title available?)
- scientific article; zbMATH DE number 3551712 (Why is no real title available?)
- scientific article; zbMATH DE number 2168212 (Why is no real title available?)
- scientific article; zbMATH DE number 1416649 (Why is no real title available?)
- scientific article; zbMATH DE number 3076948 (Why is no real title available?)
- A Graph-Theoretic Approach to Randomization Tests of Causal Effects under General Interference
- A tutorial on conformal prediction
- Another Look at the Lady Tasting Tea and Differences Between Permutation Tests and Randomisation Tests
- Causal Inference Using Potential Outcomes
- Causal inference in genetic trio studies
- Combining p-values via averaging
- Comment on J. Neyman and causal inference in experiments and observational studies: On the application of probability theory to agricultural experiments. Essay on principles. Section 9 [Ann. Agric. Sci. 10 (1923), 1--51]
- Comments on the Neyman-Fisher controversy and its consequences
- Conservative hypothesis tests and confidence intervals using importance sampling
- Covariance adjustment in radomized experiments and observational studies
- Distribution-Free Prediction Sets
- Distribution-free predictive inference for regression
- Empirical Bayes Analysis of a Microarray Experiment
- Estimating average causal effects under general interference, with application to a social network experiment
- Evidence factors in observational studies
- Exact \(p\)-values for network interference
- Fast and powerful conditional randomization testing via distillation
- Identification of treatment response with social interactions
- Integrating the evidence from evidence factors in observational studies
- Likelihood Methods and Nonparametric Tests
- Multi-center clinical trials: randomization and ancillary statistics
- ON THE z-TEST IN RANDOMIZED BLOCKS AND LATIN SQUARES
- On the power of conditional independence testing under model-X
- Panning for Gold: ‘Model-X’ Knockoffs for High Dimensional Controlled Variable Selection
- Permutation methods: a basis for exact inference
- Random variables with maximum sums
- Randomization Analysis of Experimental Data: The Fisher Randomization Test
- Randomization inference for peer effects
- Randomization inference for stepped-wedge cluster-randomized trials: an application to community-based health insurance
- Randomization tests of causal effects under interference
- Randomization tests. With CD-ROM.
- Rerandomization Inference on Regression and Shift Effects: Computationally Feasible Methods
- Rerandomization and regression adjustment
- Rerandomization to improve covariate balance in experiments
- Statistical Models
- Statistics and Causal Inference
- THE MEANING OF A SIGNIFICANCE LEVEL
- Test of Significance for 2 × 2 Contingency Tables
- Testing Statistical Hypotheses
- The Fisher, Neyman-Pearson Theories of Testing Hypotheses: One Theory or Two?
- The behaviour of some significance tests under experimental randomization
- The conditional permutation test for independence while controlling for confounders
- The general structure of evidence factors in observational studies
- Toward Causal Inference With Interference
Cited in
(9)- On the Term “Randomization Test”
- Design-Based Causal Inference with Missing Outcomes: Missingness Mechanisms, Imputation-Assisted Randomization Tests, and Covariate Adjustment
- Design of randomized clinical trials with a binary endpoint: conditional versus unconditional analyses of a two-by-two table
- Unifying different theories of conformal prediction
- Fast Conservative Monte Carlo Confidence Sets
- A geometrically informed permutation test for dependency in spatiotemporal patterns of protein species in microscopy images
- Sensitivity Analysis for Binary Outcome Misclassification in Randomization Tests via Integer Programming
- Multiple conditional randomization tests for lagged and spillover treatment effects
- Covariate-adaptive randomization inference in matched designs
This page was built for publication: What is a Randomization Test?
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6185588)
