Exact and asymptotically robust permutation tests
From MaRDI portal
Abstract: Given independent samples from P and Q, two-sample permutation tests allow one to construct exact level tests when the null hypothesis is P=Q. On the other hand, when comparing or testing particular parameters of P and Q, such as their means or medians, permutation tests need not be level , or even approximately level in large samples. Under very weak assumptions for comparing estimators, we provide a general test procedure whereby the asymptotic validity of the permutation test holds while retaining the exact rejection probability in finite samples when the underlying distributions are identical. The ideas are broadly applicable and special attention is given to the k-sample problem of comparing general parameters, whereby a permutation test is constructed which is exact level under the hypothesis of identical distributions, but has asymptotic rejection probability under the more general null hypothesis of equality of parameters. A Monte Carlo simulation study is performed as well. A quite general theory is possible based on a coupling construction, as well as a key contiguity argument for the multinomial and multivariate hypergeometric distributions.
Recommendations
- Multivariate and multiple permutation tests
- Permuiation tesis for k-sample binomial data with comparisons of exact and approximate P-levels
- Robust two-sample permutation tests
- Publication:4860267
- Asymptotic Behavior of Linear Permutation Tests under General Alternatives, with Application to Test Selection and Study Design
Cites work
- scientific article; zbMATH DE number 3671500 (Why is no real title available?)
- A Monte-Carlo comparison of Studentized bootstrap and permutation tests for heteroscedastic two-sample problems
- A Studentized permutation test for the non-parametric Behrens-Fisher problem
- A parametric bootstrap approach for ANOVA with unequal variances: fixed and random models
- Approximation Theorems of Mathematical Statistics
- Asymptotically valid and exact permutation tests based on two-sample \(U\)-statistics
- Bootstrap and randomization tests of some nonparametric hypotheses
- Bootstrap methods: another look at the jackknife
- Conditional rank tests for the two-sample problem under random censorship
- Discussion about the quality of F-ratio resampling tests for comparing variances
- Exact and asymptotically robust permutation tests
- How do bootstrap and permutation tests work?
- On smoothing and the bootstrap
- On the Behavior of Randomization Tests Without a Group Invariance Assumption
- One-way analysis of variance with unequal variances.
- Resampling Student's \(t\)-type statistics
- Studentized permutation tests for non-i.i.d. hypotheses and the generalized Behrens-Fisher problem
- Testing Statistical Hypotheses
- Testing equality of correlation coefficients in two populations via permutation methods
- Testing nonparametric statistical functionals with applications to rank tests
- The Large-Sample Power of Tests Based on Permutations of Observations
Cited in
(98)- Randomization tests of copula symmetry
- Conformal Prediction: A Gentle Introduction
- Randomization Tests for Weak Null Hypotheses in Randomized Experiments
- Permutation test for the multivariate coefficient of variation in factorial designs
- Uniformly implementable small sample integrated likelihood ratio test for one-way and two-way ANOVA under heteroscedasticity and normality
- Randomization-based tests for ``no treatment effects
- On the weak consistency of permutation tests
- scientific article; zbMATH DE number 833760 (Why is no real title available?)
- On unbiasedness and power of permutation tests
- Higher order cumulants and Tchebyshev--Markov bounds for \(P\)-values in distribution-free matched-pairs tests
- Permutation tests for homogeneity based on some characterizations
- Exact testing with random permutations
- Applications of permutations to the simulations of critical values
- Permutation test for heterogeneous treatment effects with a nuisance parameter
- A permutation test for matching and its asymptotic distribution
- Robust permutation tests for one sample
- A paradox from randomization-based causal inference
- A note on conditional versus joint unconditional weak convergence in bootstrap consistency results
- Permuiation tesis for k-sample binomial data with comparisons of exact and approximate P-levels
- The asymptotic theory of permutation statistics.
- Selective inference with a randomized response
- Efficient calculation of the permutation distribution of robust two- sample statistics
- Forecast dominance testing via sign randomization
- Asymptotically valid and exact permutation tests based on two-sample \(U\)-statistics
- Permutation test for incomplete paired data with application to cDNA microarray data
- Optimal rates for independence testing via \(U\)-statistic permutation tests
- An apparent paradox explained
- Wald-type statistics using \(\{2 \}\)-inverses for hypothesis testing in general factorial designs
- Modified Wilcoxon–Mann–Whitney Test and Power Against Strong Null
- The split sample permutation \(t\)-tests
- Permuting longitudinal data in spite of the dependencies
- Exact and asymptotically robust permutation tests
- Inference Under Covariate-Adaptive Randomization
- Invalid permutation tests
- Permutation tests for general dependent truncation
- Distribution-free tests for cluster samples of ordinal responses
- Permutation Tests at Nonparametric Rates
- Permutation-based inference for the AUC: a unified approach for continuous and discontinuous data
- Minimax optimality of permutation tests
- Bootstrap and permutation rank tests for proportional hazards under right censoring
- Permuting incomplete paired data: a novel exact and asymptotic correct randomization test
- Robust permutation tests for two samples
- Controlling the false discovery rate via knockoffs
- Studentized sensitivity analysis for the sample average treatment effect in paired observational studies
- Agnostic notes on regression adjustments to experimental data: reexamining Freedman's critique
- Permutation tests from biased samples for the equality of two distributions
- A bi-aspect nonparametric test for the two-sample location problem
- QANOVA: quantile-based permutation methods for general factorial designs
- Assessing Equality of Means Using the Overlap of Range-Preserving Confidence Intervals
- Inference in Experiments With Matched Pairs
- Two permutation tests and the Mann-Whitney test: a robustness study
- Numerical comparison of classical and permutation statistical hypothesis testing methods
- Transformations which preserve exchangeability and application to permutation tests
- Multivariate and multiple permutation tests
- A New Scale-Invariant Nonparametric Test for Two-Sample Bivariate Location Problem with Application
- Exact nonparametric two-sample homogeneity tests
- Bootstrap- and permutation-based inference for the Mann-Whitney effect for right-censored and tied data
- Resampling-based inference methods for comparing two coefficients alpha
- Covariate-adjusted Fisher randomization tests for the average treatment effect
- Bootstrap and permutation tests of independence for point processes
- Robust two-sample permutation tests
- A causal bootstrap
- Causal inference: a missing data perspective
- Robust multivariate nonparametric tests via projection averaging
- Asymptotic Behavior of Linear Permutation Tests under General Alternatives, with Application to Test Selection and Study Design
- Power boosting: fusion of multiple test statistics via resampling
- Large sample results for permutation tests of association
- Fisher-Pitman Permutation Tests Based on Nonparametric Poisson Mixtures with Application to Single Cell Genomics
- CASANOVA: Permutation inference in factorial survival designs
- Quantile-based MANOVA: a new tool for inferring multivariate data in factorial designs
- Tests for group-specific heterogeneity in high-dimensional factor models
- Letter to the editor: ``Exact permutation tests for correlated binomial variables by J. Yu, J. L. Kepner and R. Iyer
- Robust tests for multivariate repeated measures with small samples
- Dealing with imperfect randomization: inference for the highscope Perry preschool program
- Statistical nonparametric mapping: multivariate permutation tests for location, correlation, and regression problems in neuroimaging
- Nonparametric tests for semiparametric regression models
- A Permutation Test for Two-Sample Means and Signal Identification of High-dimensional Data
- Permutation test of tail dependence
- Is Fisher inference inferior to Neyman inference for policy analysis?
- A robust permutation test for Kendall's tau
- Randomization Tests for Equality in Dependence Structure
- Asymptotic‐based bootstrap approach for matched pairs with missingness in a single arm
- scientific article; zbMATH DE number 5973733 (Why is no real title available?)
- Permutation‐based tests for discontinuities in event studies
- Fast approximation of small \(p\)-values in permutation tests by partitioning the permutations
- Wild bootstrap logrank tests with broader power functions for testing superiority
- Multiplication-combination tests for incomplete paired data
- Permutation testing for dependence in time series
- The Generalized Oaxaca-Blinder Estimator
- Testing Weak Nulls in Matched Observational Studies
- A Two-Sample Test for Threshold Crossing Latent Variables with Application to Valuation Studies
- More powerful logrank permutation tests for two-sample survival data
- Tests of matrix structure for construct validation
- Permutation Tests for Comparing Inequality Measures
- Maintaining the exchangeability assumption for a two-group permutation test in the non-randomized setting
- Randomized empirical processes by algebraic groups, and tests for weak null hypotheses
- Inference in cluster randomized trials with matched pairs
- Permutation tests of scale using deviances
This page was built for publication: Exact and asymptotically robust permutation tests
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q355084)
