Testing Weak Nulls in Matched Observational Studies
From MaRDI portal
Publication:6079705
Abstract: We develop sensitivity analyses for weak nulls in matched observational studies while allowing unit-level treatment effects to vary. The methods may be applied to studies using any optimal without-replacement matching algorithm. In contrast to randomized experiments and to paired observational studies, we show for general matched designs that over a large class of test statistics, any valid sensitivity analysis for the entirety of the weak null must be unnecessarily conservative if Fisher's sharp null of no treatment effect for any individual also holds. We present a sensitivity analysis valid for the weak null, and illustrate why it is generally conservative if the sharp null holds through new connections to inverse probability weighted estimators. An alternative procedure is presented that is asymptotically sharp if treatment effects are constant, and that is valid for the weak null under additional restrictions which may be deemed benign by practitioners. Simulations demonstrate that this alternative procedure results in a valid sensitivity analysis for the weak null hypothesis under a host of reasonable data-generating processes. The procedures allow practitioners to assess robustness of estimated sample average treatment effects to hidden bias while allowing for unspecified effect heterogeneity in matched observational studies.
Recommendations
- Sensitivity analysis for certain permutation inferences in matched observational studies
- A conditional test with demonstrated insensitivity to unmeasured bias in matched observational studies
- Design sensitivity and efficiency in observational studies
- Sensitivity Analysis for m‐Estimates, Tests, and Confidence Intervals in Matched Observational Studies
- Studentized sensitivity analysis for the sample average treatment effect in paired observational studies
Cites work
- A paradox from randomization-based causal inference
- An apparent paradox explained
- Asymptotic Separability in Sensitivity Analysis
- Bounded, efficient and doubly robust estimation with inverse weighting
- Comments on the Neyman-Fisher controversy and its consequences
- Exact and asymptotically robust permutation tests
- Flexible sensitivity analysis for observational studies without observable implications
- Full matching approach to instrumental variables estimation with application to the effect of malaria on stunting
- Full Matching in an Observational Study of Coaching for the SAT
- Gaussian Prepivoting for Finite Population Causal Inference
- scientific article; zbMATH DE number 469127 (Why is no real title available?)
- scientific article; zbMATH DE number 1487684 (Why is no real title available?)
- Impact of Multiple Matched Controls on Design Sensitivity in Observational Studies
- Inference in Experiments With Matched Pairs
- Matching methods for causal inference: a review and a look forward
- Observational studies.
- On Estimation of the Survivor Average Causal Effect in Observational Studies When Important Confounders Are Missing Due to Death
- On mitigating the analytical limitations of finely stratified experiments
- Sensitivity analysis for inverse probability weighting estimators via the percentile bootstrap
- Sensitivity analysis for trend tests: application to the risk of radiation exposure
- Studentized permutation tests for non-i.i.d. hypotheses and the generalized Behrens-Fisher problem
- Studentized sensitivity analysis for the sample average treatment effect in paired observational studies
- The sensitivity of linear regression coefficients' confidence limits to the omission of a confounder
Cited in
(14)- Data-driven sensitivity analysis for matching estimators
- Matching for balance, pairing for heterogeneity in an observational study of the effectiveness of for-profit and not-for-profit high schools in Chile
- Strong control of the familywise error rate in observational studies that discover effect modification by exploratory methods
- Using Quantile Averages in Matched Observational Studies
- Sensitivity analysis for matched pair analysis of binary data: from worst case to average case analysis
- Studentized sensitivity analysis for the sample average treatment effect in paired observational studies
- Multivariate one-sided testing in matched observational studies as an adversarial game
- A conditional test with demonstrated insensitivity to unmeasured bias in matched observational studies
- Testing Biased Randomization Assumptions and Quantifying Imperfect Matching and Residual Confounding in Matched Observational Studies
- Testing one hypothesis twice in observational studies
- Bridging the gap between design and analysis: randomization inference and sensitivity analysis for matched observational studies with treatment doses
- Covariate-adaptive randomization inference in matched designs
- Risk set matched difference-in-differences for the analysis of effect modification in an observational study on the impact of gun violence on health outcomes
- Asymptotic validity and finite-sample properties of approximate randomization tests
This page was built for publication: Testing Weak Nulls in Matched Observational Studies
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6079705)
