DARTFormer: Finding The Best Type Of Attention

2 October 2022

Papers citing "DARTFormer: Finding The Best Type Of Attention"

2 / 2 papers shown

Title
SimA: Simple Softmax-free Attention for Vision Transformers Soroush Abbasi Koohpayegani Hamed Pirsiavash 16 25 0 17 Jun 2022
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 262 2,013 0 28 Jul 2020