The quarks of attention: structure and capacity of neural attention building blocks (Q6161491)
From MaRDI portal
scientific article; zbMATH DE number 7702943
Language | Label | Description | Also known as |
---|---|---|---|
English | The quarks of attention: structure and capacity of neural attention building blocks |
scientific article; zbMATH DE number 7702943 |
Statements
The quarks of attention: structure and capacity of neural attention building blocks (English)
0 references
27 June 2023
0 references
neural networks
0 references
deep learning
0 references
attention
0 references
gating
0 references
synaptic modulation
0 references
transformers
0 references
capacity
0 references
circuit complexity
0 references