A model robust subsampling approach for generalised linear models in big data settings
From MaRDI portal
Publication:6080693
Abstract: In today's modern era of Big data, computationally efficient and scalable methods are needed to support timely insights and informed decision making. One such method is sub-sampling, where a subset of the Big data is analysed and used as the basis for inference rather than considering the whole data set. A key question when applying sub-sampling approaches is how to select an informative subset based on the questions being asked of the data. A recent approach for this has been proposed based on determining sub-sampling probabilities for each data point, but a limitation of this approach is that appropriate sub-sampling probabilities rely on an assumed model for the Big data. In this article, to overcome this limitation, we propose a model robust approach where a set of models is considered, and the sub-sampling probabilities are evaluated based on the weighted average of probabilities that would be obtained if each model was considered singularly. Theoretical support for such an approach is provided. Our model robust sub-sampling approach is applied in a simulation study and in two real world applications where performance is compared to current sub-sampling practices. The results show that our model robust approach outperforms alternative approaches.
Cites work
- A new look at the statistical model identification
- A Scalable Bootstrap for Massive Data
- A sequential split-and-conquer approach for the analysis of big dependent data in computer experiments
- A statistical perspective on algorithmic leveraging
- Aggregated estimating equation estimation
- An online updating approach for testing the proportional hazards assumption with streams of survival data
- Divide and conquer local average regression
- Divide and recombine (D&R): Data science for large complex data
- Estimating the dimension of a model
- Generalized additive models
- Information-Based Optimal Subdata Selection for Big Data Linear Regression
- Information-based optimal subdata selection for big data logistic regression
- LowCon: A Design-based Subsampling Approach in a Misspecified Linear Model
- Model-free global likelihood subsampling for massive data
- Model-robust subdata selection for big data
- More efficient estimation for logistic regression with optimal subsamples
- Optimal subsampling algorithms for big data regressions
- Optimal subsampling for large sample logistic regression
- Optimal subsampling for large-scale quantile regression
- Optimal subsampling for softmax regression
- Optimum experimental designs, with SAS
- Principles of experimental design for big data analysis
- Robust designs for generalized linear models with possible overdispersion and misspecified link functions
- Robust designs for misspecified logistic models
- Statistical methods and computing for big data
- Subdata selection algorithm for linear model discrimination
Cited in
(5)
This page was built for publication: A model robust subsampling approach for generalised linear models in big data settings
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6080693)
