Position Interpolation Improves ALiBi Extrapolation

18 October 2023

Papers citing "Position Interpolation Improves ALiBi Extrapolation"

3 / 3 papers shown

Title
Spline-based Transformers Prashanth Chandran Agon Serifi Markus Gross Moritz Bächer 36 0 0 03 Apr 2025
Flash STU: Fast Spectral Transform Units Y. Isabel Liu Windsor Nguyen Yagiz Devre Evan Dogariu Anirudha Majumdar Elad Hazan AI4TS 64 1 0 16 Sep 2024
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation Ofir Press Noah A. Smith M. Lewis 242 695 0 27 Aug 2021