Optimal Subsampling Bootstrap for Massive Data
From MaRDI portal
Abstract: The bootstrap is a widely used procedure for statistical inference because of its simplicity and attractive statistical properties. However, the vanilla version of bootstrap is no longer feasible computationally for many modern massive datasets due to the need to repeatedly resample the entire data. Therefore, several improvements to the bootstrap method have been made in recent years, which assess the quality of estimators by subsampling the full dataset before resampling the subsamples. Naturally, the performance of these modern subsampling methods is influenced by tuning parameters such as the size of subsamples, the number of subsamples, and the number of resamples per subsample. In this paper, we develop a novel hyperparameter selection methodology for selecting these tuning parameters. Formulated as an optimization problem to find the optimal value of some measure of accuracy of an estimator subject to computational cost, our framework provides closed-form solutions for the optimal hyperparameter values for subsampled bootstrap, subsampled double bootstrap and bag of little bootstraps, at no or little extra time cost. Using the mean square errors as a proxy of the accuracy measure, we apply our methodology to study, compare and improve the performance of these modern versions of bootstrap developed for massive data through simulation study. The results are promising.
Cites work
- A general Bahadur representation of M-estimators and its application to linear regression with nonstochastic designs
- A Scalable Bootstrap for Massive Data
- Communication-efficient distributed statistical inference
- Distributed inference for quantile regression processes
- Distributed statistical inference for massive data
- scientific article; zbMATH DE number 711515 (Why is no real title available?)
- scientific article; zbMATH DE number 1057566 (Why is no real title available?)
- More Efficient Bootstrap Computations
- On the choice of m in the m out of n bootstrap and confidence bounds for extrema
- Quantile regression under memory constraint
- Quantile regression.
- Sample Correlation Coefficients Based on Survey Data Under Regression Imputation
- Subsampling
- Weak convergence and empirical processes. With applications to statistics
Cited in
(2)
This page was built for publication: Optimal Subsampling Bootstrap for Massive Data
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6190779)
