Stochastic distributed learning with gradient quantization and double-variance reduction
From MaRDI portal
Recommendations
- Uncertainty principle for communication compression in distributed and federated learning and the search for an optimal compressor
- Distributed stochastic variance reduced gradient methods by sampling extra data with replacement
- On arbitrary compression for decentralized consensus and stochastic optimization over directed networks
- Decentralized online convex optimization with compressed communications
- Optimal convergence rates for convex distributed optimization in networks
Cites work
- A Stochastic Approximation Method
- Distributed coordinate descent method for learning with big data
- Distributed optimization with arbitrary local solvers
- Large-scale machine learning with stochastic gradient descent
- Optimal distributed online prediction using mini-batches
- Robust Stochastic Approximation Approach to Stochastic Programming
- Stochastic dual coordinate ascent methods for regularized loss minimization
Cited in
(19)- EGC: entropy-based gradient compression for distributed deep learning
- Distributed stochastic variance reduced gradient methods by sampling extra data with replacement
- scientific article; zbMATH DE number 7365721 (Why is no real title available?)
- NUQSGD: provably communication-efficient data-parallel SGD via nonuniform quantization
- Convergence Rates of Distributed Gradient Methods Under Random Quantization: A Stochastic Approximation Approach
- Uncertainty principle for communication compression in distributed and federated learning and the search for an optimal compressor
- Federated Variance-Reduced Stochastic Gradient Descent With Robustness to Byzantine Attacks
- Privacy-preserving federated learning on lattice quantization
- Unified analysis of stochastic gradient methods for composite convex and smooth optimization
- Preconditioning meets biased compression for efficient distributed optimization
- Nonlinear Gradient Mappings and Stochastic Optimization: A General Framework with Applications to Heavy-Tail Noise
- Compression and data similarity: combination of two techniques for communication-efficient solving of distributed variational inequalities
- FLSwitch: towards secure and fast model aggregation for federated deep learning with a learning state-aware switch
- Real acceleration of communication process in distributed algorithms with compression
- Federated primal dual fixed point algorithm
- Accelerated methods with compression for horizontal and vertical federated learning
- Distributed learning with compressed gradient differences
- Compressed gradient tracking algorithms for distributed nonconvex optimization
- Zero order algorithm for decentralized optimization problems
This page was built for publication: Stochastic distributed learning with gradient quantization and double-variance reduction
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5882226)
