A mathematical perspective on transformers

DOI10.1090/BULL/1863MaRDI QIDQ6964504zbMATH OpenFDO

Authors Borjan Geshkovski, Cyril Letrouit, Yury Polyanskiy, Philippe Rigollet

Publication date 4 July 2025

Published in Bulletin of the American Mathematical Society. New Series (Search for Journal in Brave)

zbMATH Keywords

clusteringgradient flowsinteracting particle systemstransformersself-attention

Mathematics Subject Classification ID

Asymptotic properties of solutions to ordinary differential equations (34D05) Synchronization of solutions to ordinary differential equations (34D06) Vlasov equations (35Q83) Packing and covering in (n) dimensions (aspects of discrete geometry) (52C17) Interacting particle systems in time-dependent statistical mechanics (82C22)

This page was built for publication: A mathematical perspective on transformers

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q6964504)