Breaking the Attention Bottleneck

16 June 2024

Kalle Hilsenbek

Papers citing "Breaking the Attention Bottleneck"

2 / 2 papers shown

Title
Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention Tsendsuren Munkhdalai Manaal Faruqui Siddharth Gopal LRM LLMAG CLL 76 101 0 10 Apr 2024
Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models Zhen Qin Weigao Sun Dong Li Xuyang Shen Weixuan Sun Yiran Zhong 49 21 0 09 Jan 2024