Limits on the Universal Method for Matrix Multiplication

DOI10.4086/TOC.2021.V017A001MaRDI QIDQ6311457arXivFDO

Authors Josh Alman

Publication date 20 December 2018

Published in arXiv

Full work available at URL https://doi.org/10.4086/TOC.2021.V017A001

Mathematics Subject Classification ID

Multilinear algebra, tensor calculus (15A69) Analysis of algorithms and problem complexity (68Q25) Symbolic computation and algebraic computation (68W30) Computational difficulty of problems (lower bounds, completeness, difficulty of approximation, etc.) (68Q17)

arXiv classification

cs.DScs.CCmath.CO

Abstract: In this work, we prove limitations on the known methods for designing matrix multiplication algorithms. Alman and Vassilevska Williams recently defined the Universal Method, which substantially generalizes all the known approaches including Strassen's Laser Method and Cohn and Umans' Group Theoretic Method. We prove concrete lower bounds on the algorithms one can design by applying the Universal Method to many different tensors. Our proofs use new tools for upper bounding the asymptotic slice rank of a wide range of tensors. Our main result is that the Universal method applied to any Coppersmith-Winograd tensor $C{W}_q$ cannot yield a bound on $omega$, the exponent of matrix multiplication, better than $2.16805$. By comparison, it was previously only known that the weaker `Galactic Method' applied to $C{W}_q$ could not achieve an exponent of $2$. We also study the Laser Method (which is, in principle, a highly special case of the Universal Method) and prove that it is "complete" for matrix multiplication algorithms: when it applies to a tensor $T$, it achieves $omega=2$ if and only if it is possible for the Universal method applied to $T$ to achieve $omega=2$. Hence, the Laser Method, which was originally used as an algorithmic tool, can also be seen as a lower bounding tool. For example, in their landmark paper, Coppersmith and Winograd achieved a bound of $omegaleq2.376$, by applying the Laser Method to $C{W}_q$. By our result, the fact that they did not achieve $omega=2$ implies a lower bound on the Universal Method applied to $C{W}_q$. Indeed, if it were possible for the Universal Method applied to $C{W}_q$ to achieve $omega=2$, then Coppersmith and Winograd's application of the Laser Method would have achieved $omega=2$.

This page was built for publication: Limits on the Universal Method for Matrix Multiplication

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6311457)