ConViT: improving vision transformers with soft convolutional inductive biases*

DOI10.1088/1742-5468/AC9830MaRDI QIDQ5055416zbMATH OpenOpenAlexFDO

Authors Stéphane D'Ascoli, Hugo Touvron, Matthew L. Leavitt, Ari S. Morcos, Levent Sagun, Giulio Biroli

Publication date 13 December 2022

Published in Journal of Statistical Mechanics: Theory and Experiment (Search for Journal in Brave)

Full work available at URL https://arxiv.org/abs/2103.10697

zbMATH Keywords

deep learningmachine learning

Mathematics Subject Classification ID

Statistical mechanics, structure of matter (82-XX)

Cites work

• Deep learning

Describes a project that uses

Uses Software

• ImageNet
• Tensor2Tensor
• BERT

This page was built for publication: ConViT: improving vision transformers with soft convolutional inductive biases*

Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q5055416)