Distributed testing and estimation under sparse high dimensional models

DOI10.1214/17-AOS1587zbMath1392.62060WikidataQ90398883 ScholiaQ90398883MaRDI QIDQ1650081

Junwei Lu, Ziwei Zhu, Han Liu, Heather Battey, Jianqing Fan

Publication date: 29 June 2018

Published in: The Annals of Statistics (Search for Journal in Brave)

Full work available at URL: https://projecteuclid.org/euclid.aos/1525313085

zbMATH Keywords

thresholdingmassive datadivide and conquerdebiasing

Mathematics Subject Classification ID

Asymptotic properties of parametric estimators (62F12) Point estimation (62F10) Asymptotic properties of parametric tests (62F05)

Related Items

A review of distributed statistical inference, Partitioned Approach for High-dimensional Confidence Intervals with Large Split Sizes, Distributed Sufficient Dimension Reduction for Heterogeneous Massive Data, Automatic variable selection in a linear model on massive data, Asymptotic covariance estimation by Gaussian random perturbation, Distributed subdata selection for big data via sampling-based approach, Distributed nonparametric function estimation: optimal rate of convergence and cost of adaptation, Robust distributed estimation and variable selection for massive datasets via rank regression, Optimal subsample selection for massive logistic regression with distributed data, Score-matching representative approach for big data analysis with generalized linear models, WONDER: Weighted one-shot distributed ridge regression in high dimensions, Distributed estimation in heterogeneous reduced rank regression: with application to order determination in sufficient dimension reduction, Unnamed Item, Distributed testing and estimation under sparse high dimensional models, Robust reduced rank regression in a distributed setting, Multi-round smoothed composite quantile regression for distributed data, Unnamed Item, Efficient fused learning for distributed imbalanced data, Online updating of information based model selection in the big data setting, Communication-Efficient Distributed Linear Discriminant Analysis for Binary Classification, Model Checking in Large-Scale Dataset via Structure-Adaptive-Sampling, Robust estimation for nonrandomly distributed data, Distributed inference for two‐sample U‐statistics in massive data analysis, Distributed estimation with empirical likelihood, Divide and conquer for accelerated failure time model with massive time‐to‐event data, Optimal subsampling for multiplicative regression with massive data, Distributed Sparse Composite Quantile Regression in Ultrahigh Dimensions, Global debiased DC estimations for biased estimators via pro forma regression, CEDAR: Communication Efficient Distributed Analysis for Regressions, Communication-efficient estimation for distributed subset selection, A distributed community detection algorithm for large scale networks under stochastic block models, Model aggregation for doubly divided data with large size and large dimension, Scalable and efficient inference via CPE, Distributed Estimation for Principal Component Analysis: An Enlarged Eigenspace Analysis, First-Order Newton-Type Estimator for Distributed Estimation and Inference, Individual Data Protected Integrative Regression Analysis of High-Dimensional Heterogeneous Data, Unbalanced distributed estimation and inference for the precision matrix in Gaussian graphical models, Unnamed Item, Optimal subsampling algorithms for composite quantile regression in massive data, A communication efficient distributed one-step estimation, Online inference in high-dimensional generalized linear models with streaming data, Post-selection Inference of High-dimensional Logistic Regression Under Case–Control Design, Communication-efficient surrogate quantile regression for non-randomly distributed system, Conditional characteristic feature screening for massive imbalanced data, A distributed multiple sample testing for massive data, Communication-Efficient Accurate Statistical Estimation, Online renewable smooth quantile regression, Distributed statistical optimization for non-randomly stored big data with application to penalized learning, A framework for mediation analysis with massive data, An Asymptotic Analysis of Random Partition Based Minibatch Momentum Methods for Linear Regression Models, Estimates of matrix solutions of operator equations with random parameters under uncertainties, Prediction Using Many Samples with Models Possibly Containing Partially Shared Parameters, Distributed estimation and inference for spatial autoregression model with large scale networks, Estimation and inference in sparse multivariate regression and conditional Gaussian graphical models under an unbalanced distributed setting, Empirical likelihood ratio tests for non-nested model selection based on predictive losses, Distributed function estimation: adaptation using minimal communication, Distributed Bayesian posterior voting strategy for massive data, Econometrics with Privacy Preservation, Inference on Multi-level Partial Correlations Based on Multi-subject Time Series Data, Adaptive distributed methods under communication constraints, LIC criterion for optimal subset selection in distributed interval estimation, Unnamed Item, Robust distributed modal regression for massive data, Robust communication-efficient distributed composite quantile regression and variable selection for massive data, Distributed one-step upgraded estimation for non-uniformly and non-randomly distributed data, Unnamed Item, Circumventing superefficiency: an effective strategy for distributed computing in non-standard problems, Quantile regression under memory constraint, Distributed linear regression by averaging, Distributed simultaneous inference in generalized linear models via confidence distribution, Distributed statistical inference for massive data, Accounting for Factor Variables in Big Data Regression, A scalable nonparametric specification testing for massive data, Divide-and-conquer information-based optimal subdata selection algorithm, Distributed adaptive Huber regression, Unnamed Item, Distributed adaptive Gaussian mean estimation with unknown variance: interactive protocol helps adaptation

Cites Work

• Unnamed Item
• Unnamed Item
• Unnamed Item
• Sure independence screening in generalized linear models with NP-dimensionality
• On asymptotically optimal confidence regions and tests for high-dimensional models
• Nearly unbiased variable selection under minimax concave penalty
• A partially linear framework for massive heterogeneous data
• Optimal computational and statistical rates of convergence for sparse nonconvex learning problems
• A general theory of hypothesis tests and confidence regions for sparse high dimensional models
• Statistics for high-dimensional data. Methods, theory and applications.
• Distributed testing and estimation under sparse high dimensional models
• Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors
• The Dantzig selector: statistical estimation when \(p\) is much larger than \(n\). (With discussions and rejoinder).
• High-dimensional graphs and variable selection with the Lasso
• Divide and Conquer Kernel Ridge Regression: A Distributed Algorithm with Minimax Optimal Rates
• Confidence Intervals and Hypothesis Testing for High-Dimensional Regression
• A split-and-conquer approach for analysis of
• One-Step Huber Estimates in the Linear Model
• Foundations of Modern Probability
• Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
• On the optimality of averaging in distributed statistical learning
• Variance Estimation Using Refitted Cross-Validation in Ultrahigh Dimensional Regression
• A Scalable Bootstrap for Massive Data
• Nonconcave Penalized Likelihood With NP-Dimensionality
• Regularized M-estimators with nonconvexity: Statistical and algorithmic theory for local optima
• Confidence Intervals for Low Dimensional Parameters in High Dimensional Linear Models
• A unified framework for high-dimensional analysis of \(M\)-estimators with decomposable regularizers
• A general theory of concave regularization for high-dimensional sparse estimation problems