Information-Based Optimal Subdata Selection for Big Data Linear Regression
From MaRDI portal
Publication:5229921
Abstract: Extraordinary amounts of data are being produced in many branches of science. Proven statistical methods are no longer applicable with extraordinary large data sets due to computational limitations. A critical step in big data analysis is data reduction. Existing investigations in the context of linear regression focus on subsampling-based methods. However, not only is this approach prone to sampling errors, it also leads to a covariance matrix of the estimators that is typically bounded from below by a term that is of the order of the inverse of the subdata size. We propose a novel approach, termed information-based optimal subdata selection (IBOSS). Compared to leading existing subdata methods, the IBOSS approach has the following advantages: (i) it is significantly faster; (ii) it is suitable for distributed parallel computing; (iii) the variances of the slope parameter estimators converge to 0 as the full data size increases even if the subdata size is fixed, i.e., the convergence rate depends on the full data size; (iv) data analysis for IBOSS subdata is straightforward and the sampling distribution of an IBOSS estimator is easy to assess. Theoretical results and extensive simulations demonstrate that the IBOSS approach is superior to subsampling-based methods, sometimes by orders of magnitude. The advantages of the new approach are also illustrated through analysis of real data.
Recommendations
- Orthogonal subsampling for big data linear regression
- Distributed subdata selection for big data via sampling-based approach
- Divide-and-conquer information-based optimal subdata selection algorithm
- Optimal subsampling algorithms for big data regressions
- Information-based optimal subdata selection for big data logistic regression
Cites work
- A statistical perspective on algorithmic leveraging
- Aggregated estimating equation estimation
- Fast approximation of matrix coherence and statistical leverage
- Faster least squares approximation
- scientific article; zbMATH DE number 3986617 (Why is no real title available?)
- scientific article; zbMATH DE number 3176492 (Why is no real title available?)
- scientific article; zbMATH DE number 193528 (Why is no real title available?)
- scientific article; zbMATH DE number 845714 (Why is no real title available?)
- scientific article; zbMATH DE number 2207482 (Why is no real title available?)
- Lasso-type recovery of sparse representations for high-dimensional data
- Mathematical methods for physical and analytical chemistry
- On the relative stability of large order statistics
- Sampling algorithms for l₂ regression and applications
- Sure independence screening for ultrahigh dimensional feature space. With discussion and authors' reply
- The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
Cited in
(only showing first 100 items - show all)- Randomized sketches for kernel CCA
- On greedy heuristics for computing D-efficient saturated subsets
- Optimal subsampling for large-scale quantile regression
- Surprise sampling: improving and extending the local case-control sampling
- Optimal designs for model averaging in non-nested models
- Model-robust subdata selection for big data
- Parallel-and-stream accelerator for computationally fast supervised learning
- Optimal subsampling for composite quantile regression in big data
- Optimal subsampling for least absolute relative error estimators with massive data
- Model-free global likelihood subsampling for massive data
- Subdata selection algorithm for linear model discrimination
- Robust active learning with binary responses
- Optimal subsample selection for massive logistic regression with distributed data
- Score-matching representative approach for big data analysis with generalized linear models
- A two-stage optimal subsampling estimation for missing data problems with large-scale data
- Inversion-free subsampling Newton's method for large sample logistic regression
- Surface temperature monitoring in liver procurement via functional variance change-point analysis
- Information-based optimal subdata selection for big data logistic regression
- Online updating method to correct for measurement error in big data streams
- Adaptive iterative Hessian sketch via A-optimal subsampling
- Crawling subsampling for multivariate spatial autoregression model in large-scale networks
- Orthogonal subsampling for big data linear regression
- Divide-and-conquer information-based optimal subdata selection algorithm
- Optimal subsampling for softmax regression
- Experimental design issues in big data: the question of bias
- Accounting for factor variables in big data regression
- Optimal subsampling algorithms for big data regressions
- On stochastic Kaczmarz type methods for solving large scale systems of ill-posed equations
- scientific article; zbMATH DE number 7625175 (Why is no real title available?)
- Randomized Spectral Clustering in Large-Scale Stochastic Block Models
- Optimal Sampling for Generalized Linear Models Under Measurement Constraints
- LowCon: A Design-based Subsampling Approach in a Misspecified Linear Model
- Online Updating of Survival Analysis
- Gaussian Process Prediction using Design-Based Subsampling
- More efficient estimation for logistic regression with optimal subsamples
- Optimal Distributed Subsampling for Maximum Quasi-Likelihood Estimators With Massive Data
- Comments on ``Data science, big data and statistics
- Model Checking in Large-Scale Dataset via Structure-Adaptive-Sampling
- Divide and conquer for accelerated failure time model with massive time‐to‐event data
- Optimal subsampling for large‐sample quantile regression with massive data
- Fast Calibration for Computer Models with Massive Physical Observations
- Optimal subsampling for multiplicative regression with massive data
- Subsampling spectral clustering for stochastic block models in large-scale networks
- Global debiased DC estimations for biased estimators via pro forma regression
- Information-based optimal subdata selection for non-linear models
- Optimal subsampling design for polynomial regression in one covariate
- Accounting for outliers in optimal subsampling methods
- A model robust subsampling approach for generalised linear models in big data settings
- Predictive Subdata Selection for Computer Models
- Sketched approximation of regularized canonical correlation analysis
- Subdata selection based on orthogonal array for big data
- Generalized linear models for massive data via doubly-sketching
- A Systematic View of Information-Based Optimal Subdata Selection: Algorithm Development, Performance Evaluation, and Application in Financial Data
- Optimal subsampling algorithms for composite quantile regression in massive data
- Optimal sampling designs for multidimensional streaming time series with application to power grid sensor data
- LIC criterion for optimal subset selection in distributed interval estimation
- Subsampling in longitudinal models
- Distributed sequential estimation procedures
- Unweighted estimation based on optimal sample under measurement constraints
- Optimal subsampling for modal regression in massive data
- Entropy-based subsampling methods for big data
- Emerging directions in Bayesian computation
- Optimal subsampling for the Cox proportional hazards model with massive survival data
- A note on centering in subsample selection for linear regression
- A review on design inspired subsampling for big data
- Approximating Partial Likelihood Estimators via Optimal Subsampling
- Deterministic subsampling for logistic regression with massive data
- Robust optimal subsampling based on weighted asymmetric least squares
- A novel residual subsampling method for skew-normal mode regression model with massive data
- Robust and efficient subsampling algorithms for massive data logistic regression
- Poisson subsampling-based estimation for growing-dimensional expectile regression in massive data
- Distributed optimal subsampling for quantile regression with massive data
- Optimal Poisson subsampling for softmax regression
- A distance metric-based space-filling subsampling method for nonparametric models
- Distributed subsampling for multiplicative regression
- The COR criterion for optimal subset selection in distributed estimation
- On the inversion-free Newton's method and its applications
- A selective review on statistical methods for massive data computation: distributed computing, subsampling, and minibatch techniques
- Feature Screening for Massive Data Analysis by Subsampling
- Sampling-based estimation for massive survival data with additive hazards model
- SPlit: An Optimal Method for Data Splitting
- Density Regression with Conditional Support Points
- A Subsampling Method for Regression Problems Based on Minimum Energy Criterion
- Efficient Model-Free Subsampling Method for Massive Data
- Core-elements for large-scale least squares estimation
- Optimal Subsampling via Predictive Inference
- Differential evolution variants for searching D- and A-optimal designs for nonlinear models in the bioscience
- D-optimal subsampling design for multiple linear regression on massive data
- Communication-efficient distributed composite quantile regression via convolution smoothing and Poisson subsampling
- Efficient subsampling for high-dimensional data
- Refitted cross-validation estimation for high-dimensional subsamples from low-dimension full data
- Big data subsampling: a review
- Removal of redundant candidate points for the exact D-optimal design problem
- Optimal distributed subsampling for accelerated failure time models with massive censored data
- The A-optimal subsampling approach to the analysis of count data of massive size
- D-criterion based optimal subsampling in Poisson regression with one covariate
- Optimal subsampling algorithm for composite quantile regression with distributed data
- Optimal Subsampling for Data Streams with Measurement Constrained Categorical Responses
- Subsampled one-step estimation for fast statistical inference
- DsubCox: a fast subsampling algorithm for Cox model with distributed and massive survival data
This page was built for publication: Information-Based Optimal Subdata Selection for Big Data Linear Regression
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5229921)
