A massive data framework for M-estimators with cubic-rate
From MaRDI portal
Abstract: The divide and conquer method is a common strategy for handling massive data. In this article, we study the divide and conquer method for cubic-rate estimators under the massive data framework. We develop a general theory for establishing the asymptotic distribution of the aggregated M-estimators using a simple average. Under certain condition on the growing rate of the number of subgroups, the resulting aggregated estimators are shown to have faster convergence rate and asymptotic normal distribution, which are more tractable in both computation and inference than the original M-estimators based on pooled data. Our theory applies to a wide class of M-estimators with cube root convergence rate, including the location estimator, maximum score estimator and value search estimator. Empirical performance via simulations also validate our theoretical findings.
Recommendations
- scientific article; zbMATH DE number 7071638
- Distributed statistical estimation and rates of convergence in normal approximation
- Distributed testing and estimation under sparse high dimensional models
- A partially linear framework for massive heterogeneous data
- Divide and conquer local average regression
Cites work
- A partially linear framework for massive heterogeneous data
- A robust method for estimating optimal treatment regimes
- A Scalable Bootstrap for Massive Data
- A split-and-conquer approach for analysis of
- An approximation of partial sums of independent RV'-s, and the sample DF. I
- Asymptotic normality of the \(L_1\) error of the Grenander estimator
- Cube root asymptotics
- Divide and conquer in nonstandard problems and the super-efficiency phenomenon
- Estimation of the mode
- Gaussian approximation of suprema of empirical processes
- Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors
- scientific article; zbMATH DE number 3949394 (Why is no real title available?)
- scientific article; zbMATH DE number 5228082 (Why is no real title available?)
- Introduction to empirical processes and semiparametric inference
- Komlós-Major-Tusnády approximation for the general empirical process and Haar expansions of classes of functions
- Local invariance principles and their application to density estimation
- Measure Theory and Probability Theory
- On the application of probability theory to agricultural experiments. Essay on principles. Section 9. Translated from the Polish and edited by D. M. Dąbrowska and T. P. Speed
- On the asymptotics of constrained \(M\)-estimation
- Sharp asymptotics for isotonic regression
- Superefficiency in nonparametric function estimation
- Weak convergence and empirical processes. With applications to statistics
Cited in
(50)- Divide and conquer in nonstandard problems and the super-efficiency phenomenon
- Randomized sketches for kernel CCA
- Circumventing superefficiency: an effective strategy for distributed computing in non-standard problems
- Distributed linear regression by averaging
- Optimal subsample selection for massive logistic regression with distributed data
- Score-matching representative approach for big data analysis with generalized linear models
- Distributed estimation in heterogeneous reduced rank regression: with application to order determination in sufficient dimension reduction
- Robust reduced rank regression in a distributed setting
- Multi-round smoothed composite quantile regression for distributed data
- Communication-efficient distributed \(M\)-estimation with missing data
- Quantile regression under memory constraint
- Projected spline estimation of the nonparametric function in high-dimensional partially linear models for massive data
- Distributed feature screening via componentwise debiasing
- Communication-Efficient Distributed Linear Discriminant Analysis for Binary Classification
- Distributed high-dimensional regression under a quantile loss function
- Distributed inference for linear support vector machine
- Divide and conquer local average regression
- Discussion on the paper ‘A review of distributed statistical inference’
- Distributed estimation with empirical likelihood
- Optimal subsampling for multiplicative regression with massive data
- Distributed Sparse Composite Quantile Regression in Ultrahigh Dimensions
- Global debiased DC estimations for biased estimators via pro forma regression
- Distributed Estimation for Principal Component Analysis: An Enlarged Eigenspace Analysis
- First-Order Newton-Type Estimator for Distributed Estimation and Inference
- Transformation-Invariant Learning of Optimal Individualized Decision Rules with Time-to-Event Outcomes
- Communication-Efficient Accurate Statistical Estimation
- Distributed testing on mutual independence of massive multivariate data
- A framework for mediation analysis with massive data
- Divide-and-Conquer: A Distributed Hierarchical Factor Approach to Modeling Large-Scale Time Series Data
- Distributed quantile regression in decentralized optimization
- Distributed SGD in overparametrized linear regression
- Optimal subsampling for modal regression in massive data
- Approximating Partial Likelihood Estimators via Optimal Subsampling
- Distributed debiased estimation of high-dimensional partially linear models with jumps
- Distributed estimation and inference for semiparametric binary response models
- Sampling-based estimation for massive survival data with additive hazards model
- DDAC-SpAM: A Distributed Algorithm for Fitting High-dimensional Sparse Additive Models with Feature Division and Decorrelation
- Distributed Tensor Principal Component Analysis with Data Heterogeneity
- Divide and conquer for generalized approximately expectile regression
- Distributed empirical likelihood inference with or without Byzantine failures
- Communication-efficient distributed gradient descent via random projection
- An algorithm for distributed parameter estimation in modal regression models
- A Simple Divide-and-Conquer-based Distributed Method for the Accelerated Failure Time Model
- Efficient Nonparametric Estimation of 3D Point Cloud Signals through Distributed Learning
- Uniform inference in linear error-in-variables models: Divide-and-conquer
- Distributed penalizing function criterion for local polynomial estimation in nonparametric regression with massive data
- Distributed Mallows model averaging for ridge regressions
- A novel approach of empirical likelihood with massive data
- Decentralized sparse linear regression via gradient-tracking
- Distributed subdata selection for big data via sampling-based approach
This page was built for publication: A massive data framework for M-estimators with cubic-rate
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q3121561)
