Treeformer: Dense Gradient Trees for Efficient Attention Computation

Treeformer: Dense Gradient Trees for Efficient Attention Computation

18 August 2022

Srinadh Bhojanapalli

Papers citing "Treeformer: Dense Gradient Trees for Efficient Attention Computation"

8 / 8 papers shown

Title
HiRE: High Recall Approximate Top- $k$ Estimation for Efficient LLM Inference Yashas Samaga Varun Yerram Chong You Srinadh Bhojanapalli Sanjiv Kumar Prateek Jain Praneeth Netrapalli 51 4 0 14 Feb 2024
Tree Cross Attention Zixuan Chen Zewei He Ziqian Lu Zheming Lu Mohamed Osama Ahmed 39 0 0 29 Sep 2023
Training-free Diffusion Model Adaptation for Variable-Sized Text-to-Image Synthesis Zhiyu Jin Xuli Shen Bin Li Xiangyang Xue 21 36 0 14 Jun 2023
Multiple Instance Learning with Trainable Decision Tree Ensembles A. Konstantinov Lev V. Utkin 9 0 0 13 Feb 2023
Efficient Attention via Control Variates Lin Zheng Jianbo Yuan Chong-Jun Wang Lingpeng Kong 24 18 0 09 Feb 2023
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 251 2,012 0 28 Jul 2020
Efficient Content-Based Sparse Attention with Routing Transformers Aurko Roy M. Saffar Ashish Vaswani David Grangier MoE 238 579 0 12 Mar 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018