Testing Independence Under Biased Sampling
From MaRDI portal
Abstract: Testing for association or dependence between pairs of random variables is a fundamental problem in statistics. In some applications, data are subject to selection bias that causes dependence between observations even when it is absent from the population. An important example is truncation models, in which observed pairs are restricted to a specific subset of the X-Y plane. Standard tests for independence are not suitable in such cases, and alternative tests that take the selection bias into account are required. To deal with this issue, we generalize the notion of quasi-independence with respect to the sampling mechanism, and study the problem of detecting any deviations from it. We develop two test statistics motivated by the classic Hoeffding's statistic, and use two approaches to compute their distribution under the null: (i) a bootstrap-based approach, and (ii) a permutation-test with non-uniform probability of permutations, sampled using either MCMC or importance sampling with various proposal distributions. We show that our tests can tackle cases where the biased sampling mechanism is estimated from the data, with an important application to the case of censoring with truncation. We prove the validity of the tests, and show, using simulations, that they perform well for important special cases of the problem and improve power compared to competing methods. The tests are applied to four datasets, two that are subject to truncation, with and without censoring, and two to positive bias mechanisms related to length bias.
Recommendations
- Testing quasi-independence for truncation data
- A general class for quasi-independence tests for left-truncated right-censored data
- Testing the assumption of independence of truncation time and failure time
- Permutation tests for general dependent truncation
- Testing Quasi-Independence of Failure and Truncation Times via Conditional Kendall's Tau
Cites work
- A consistent multivariate test of association based on ranks of distances
- A Non-Parametric Test of Independence
- A Nonparametric Test for Independence Based on Sample Space Partitions
- An introduction to copulas.
- Approximating the -permanent
- Brownian distance covariance
- Conservative hypothesis tests and confidence intervals using importance sampling
- Consistent distribution-free K-sample and independence tests for univariate random variables
- Empirical distributions in selection bias models
- Equation of state calculations by fast computing machines
- Estimation from cross-sectional samples under bias and dependence
- Large sample theory of estimation in biased sampling regression models. I
- Monte Carlo sampling methods using Markov chains and their applications
- Nonparametric analysis of truncated survival data, with application to AIDS
- Nonparametric Methods for Doubly Truncated Data
- Permutation tests for general dependent truncation
- Sequential Monte-Carlo methods for permutations tests on truncated data
- Statistical problems involving permutations with restricted positions
- Testing quasi-independence for truncation data
- Testing Quasi-Independence of Failure and Truncation Times via Conditional Kendall's Tau
- Testing the assumption of independence of truncation time and failure time
- The Analysis of Cross-Classified Data: Independence, Quasi-Independence, and Interactions in Contingency Tables with or Without Missing Entries
- The competing risks illness-death model under cross-sectional sampling
- The Product-Moment Correlation Coefficient and Linear Regression for Truncated Data
Cited in
(6)- Sample Tests for Detection of Size-Biased Sampling Mechanism
- Letter to the editor/lettre à la rédactionbiased sampling with right censoring: A note on sun, Cui & Tiwari (2002)
- scientific article; zbMATH DE number 3999022 (Why is no real title available?)
- A robust permutation test for Kendall's tau
- Left-truncated health insurance claims data: theoretical review and empirical application
- Hypothesis Testing for Matched Pairs with Missing Data by Maximum Mean Discrepancy: An Application to Continuous Glucose Monitoring
This page was built for publication: Testing Independence Under Biased Sampling
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6110733)
