On the Anatomy of Attention

2 July 2024

Papers citing "On the Anatomy of Attention"

6 / 6 papers shown

Title
A Pattern Language for Machine Learning Tasks Benjamin Rodatz Ian Fan Tuomas Laakkonen Neil John Ortega Thomas Hoffman Vincent Wang-Ma'scianica 24 3 0 02 Jul 2024
Neural Circuit Diagrams: Robust Diagrams for the Communication, Implementation, and Analysis of Deep Learning Architectures Vincent Abbott 22 3 0 08 Feb 2024
An introduction to graphical tensor notation for mechanistic interpretability Jordan K. Taylor 14 1 0 02 Feb 2024
MLP-Mixer: An all-MLP Architecture for Vision Ilya O. Tolstikhin N. Houlsby Alexander Kolesnikov Lucas Beyer Xiaohua Zhai ... Andreas Steiner Daniel Keysers Jakob Uszkoreit Mario Lucic Alexey Dosovitskiy 222 2,132 0 04 May 2021
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges M. Bronstein Joan Bruna Taco S. Cohen Petar Velivcković GNN 151 948 0 27 Apr 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 225 1,684 0 28 Jul 2020