Uncertainty principle for communication compression in distributed and federated learning and the search for an optimal compressor

DOI10.1093/imaiai/iaab006zbMath1494.94003arXiv2002.08958OpenAlexW3154043723MaRDI QIDQ5095263

Egor Shulgin, Peter Richtárik, Mher Safaryan

Publication date: 5 August 2022

Published in: Information and Inference: A Journal of the IMA (Search for Journal in Brave)

Full work available at URL: https://arxiv.org/abs/2002.08958

zbMATH Keywords

uncertainty principlecompressiondimension-free boundsKashin's representation

Mathematics Subject Classification ID

Learning and adaptive systems in artificial intelligence (68T05) Coding and information theory (compaction, compression, models of communication, encoding schemes, etc.) (aspects in computer science) (68P30) Communication theory (94A05)