Fundamental resource trade-offs for encoded distributed optimization

DOI10.1093/IMAIAI/IAAA026MaRDI QIDQ5006488zbMATH OpenOpenAlexFDO

Authors A. Salman Avestimehr, Seyed Mohammadreza Mousavi Kalan, Mahdi Soltanolkotabi

Publication date 16 August 2021

Published in Information and Inference: A Journal of the IMA (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/1804.00217

zbMATH Keywords

distributed computingmachine learningoptimizationstragglers

Mathematics Subject Classification ID

Computer system organization (68Mxx) Theory of data (68Pxx)

Recommendations

• Redundancy techniques for straggler mitigation in distributed optimization and learning
• Coded Computing: Mitigating Fundamental Bottlenecks in Large-Scale Distributed Computing and Machine Learning
• Group stochastic gradient descent: a tradeoff between straggler and staleness
• Distributed asynchronous deterministic and stochastic gradient optimization algorithms
• Multi-task learning for straggler avoiding predictive job scheduling

Cited in

(6)

• Multi-task learning for straggler avoiding predictive job scheduling
• Coded Computing: Mitigating Fundamental Bottlenecks in Large-Scale Distributed Computing and Machine Learning
• Near Optimal Coded Data Shuffling for Distributed Learning
• Redundancy techniques for straggler mitigation in distributed optimization and learning
• Fundamental Resource Trade-offs for Encoded Distributed Optimization
• A code-based distributed gradient descent scheme for decentralized convex optimization

This page was built for publication: Fundamental resource trade-offs for encoded distributed optimization

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5006488)