Iterative SE(3)-transformers
From MaRDI portal
Publication:2117906
DOI10.1007/978-3-030-80209-7_63zbMATH Open1486.92140arXiv2102.13419OpenAlexW3183520159MaRDI QIDQ2117906FDOQ2117906
Edward Wagstaff, I. Posner, Justas Dauparas, Fabian Fuchs
Publication date: 22 March 2022
Abstract: When manipulating three-dimensional data, it is possible to ensure that rotational and translational symmetries are respected by applying so-called SE(3)-equivariant models. Protein structure prediction is a prominent example of a task which displays these symmetries. Recent work in this area has successfully made use of an SE(3)-equivariant model, applying an iterative SE(3)-equivariant attention mechanism. Motivated by this application, we implement an iterative version of the SE(3)-Transformer, an SE(3)-equivariant attention-based model for graph data. We address the additional complications which arise when applying the SE(3)-Transformer in an iterative fashion, compare the iterative and single-pass versions on a toy problem, and consider why an iterative model may be beneficial in some problem settings. We make the code for our implementation available to the community.
Full work available at URL: https://arxiv.org/abs/2102.13419
Uses Software
This page was built for publication: Iterative SE(3)-transformers
Report a bug (only for logged in users!)Click here to report a bug for this page (MaRDI item Q2117906)
