On The Adaptation of Unlimiformer for Decoder-Only Transformers

2 October 2024

Xia Song

Papers citing "On The Adaptation of Unlimiformer for Decoder-Only Transformers"

2 / 2 papers shown

Title
Unlimiformer: Long-Range Transformers with Unlimited Length Input Amanda Bertsch Uri Alon Graham Neubig Matthew R. Gormley RALM 94 122 0 02 May 2023
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation Ofir Press Noah A. Smith M. Lewis 242 690 0 27 Aug 2021