A framework for mediation analysis with massive data

DOI10.1007/S11222-023-10255-XMaRDI QIDQ6173567zbMATH OpenFDO

Authors

Publication date 21 July 2023

Published in Statistics and Computing (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2302.06768

zbMATH Keywords

big datadivide-and-conquermediation effectsstructural equation modelingsubsampled double bootstrap

Mathematics Subject Classification ID

Computational methods for problems pertaining to statistics (62-08) Nonparametric statistical resampling methods (62G09) Statistical aspects of big data and data science (62R07)

Abstract: During the past few years, mediation analysis has gained increasing popularity across various research fields. The primary objective of mediation analysis is to examine the direct impact of exposure on outcome, as well as the indirect effects that occur along the pathways from exposure to outcome. There has been a great number of articles that applied mediation analysis to data from hundreds or thousands of individuals. With the rapid development of technology, the volume of avaliable data increases exponentially, which brings new challenges to researchers. Directly conducting statistical analysis for large datasets is often computationally infeasible. Nonetheless, there is a paucity of findings regarding mediation analysis in the context of big data. In this paper, we propose utilizing subsampled double bootstrap and divide-and-conquer algorithms to conduct statistical mediation analysis on large-scale datasets. The proposed algorithms offer a significant enhancement in computational efficiency over traditional bootstrap confidence interval and Sobel test, while simultaneously ensuring desirable confidence interval coverage and power. We conducted extensive numerical simulations to evaluate the performance of our method. The practical applicability of our approach is demonstrated through two real-world data examples.

Recommendations

• Causal mediation analysis on failure time outcome without sequential ignorability
• Hypothesis test of mediation effect in causal mediation model with high-dimensional continuous mediators
• A Multiple-Testing Procedure for High-Dimensional Mediation Hypotheses
• Quantile regression in big data: a divide and conquer based strategy

Cites work

• A class of distribution-free models for longitudinal mediation analysis
• A massive data framework for M-estimators with cubic-rate
• A split-and-conquer approach for analysis of
• Bootstrap methods: another look at the jackknife
• Conceptual issues concerning mediation, interventions and composition
• Distributed inference for quantile regression processes
• Distributed testing and estimation under sparse high dimensional models
• scientific article; zbMATH DE number 3605764 (Why is no real title available?)
• Methods for mediation analysis with missing data
• Social network mediation analysis: a latent space approach

Cited in

(3)

• Dealing with the biased effects issue when handling huge datasets: the case of INVALSI data
• An online updating approach for estimating and testing mediation effects with big data streams
• Understanding power anomalies in mediation analysis

This page was built for publication: A framework for mediation analysis with massive data

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6173567)