Weighted Gradient Coding with Leverage Score Sampling
From MaRDI portal
Abstract: A major hurdle in machine learning is scalability to massive datasets. Approaches to overcome this hurdle include compression of the data matrix and distributing the computations. extit{Leverage score sampling} provides a compressed approximation of a data matrix using an importance weighted subset. extit{Gradient coding} has been recently proposed in distributed optimization to compute the gradient using multiple unreliable worker nodes. By designing coding matrices, gradient coded computations can be made resilient to stragglers, which are nodes in a distributed network that degrade system performance. We present a novel extit{weighted leverage score} approach, that achieves improved performance for distributed gradient coding by utilizing an importance sampling.
This page was built for publication: Weighted Gradient Coding with Leverage Score Sampling
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6334243)
