SCCA: Shifted Cross Chunk Attention for long contextual semantic expansion

12 December 2023

Papers citing "SCCA: Shifted Cross Chunk Attention for long contextual semantic expansion"

2 / 2 papers shown

Title
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training Dawei Zhu Nan Yang Liang Wang Yifan Song Wenhao Wu Furu Wei Sujian Li 55 77 0 19 Sep 2023
Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation Ofir Press Noah A. Smith M. Lewis 242 690 0 27 Aug 2021