Input-independent Attention Weights Are Expressive Enough: A Study of Attention in Self-supervised Audio Transformers

9 June 2020

Papers citing "Input-independent Attention Weights Are Expressive Enough: A Study of Attention in Self-supervised Audio Transformers"

1 / 1 papers shown

Title
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 238 578 0 12 Mar 2020