Linear Self-Attention Approximation via Trainable Feedforward Kernel

8 November 2022

Papers citing "Linear Self-Attention Approximation via Trainable Feedforward Kernel"

2 / 2 papers shown

Title
On Learning the Transformer Kernel Sankalan Pal Chowdhury Adamos Solomou Kumar Avinava Dubey Mrinmaya Sachan ViT 39 14 0 15 Oct 2021
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 238 579 0 12 Mar 2020