Diffuser: Efficient Transformers with Multi-hop Attention Diffusion for Long Sequences

21 October 2022

Papers citing "Diffuser: Efficient Transformers with Multi-hop Attention Diffusion for Long Sequences"

4 / 4 papers shown

Title
Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humans John J. Nay ELM AILaw 84 27 0 14 Sep 2022
Vision Transformers in 2022: An Update on Tiny ImageNet Ethan Huynh ViT 26 11 0 21 May 2022
Combiner: Full Attention Transformer with Sparse Computation Cost Hongyu Ren H. Dai Zihang Dai Mengjiao Yang J. Leskovec Dale Schuurmans Bo Dai 73 77 0 12 Jul 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 254 2,012 0 28 Jul 2020