A Controlled Study on Long Context Extension and Generalization in LLMs

18 September 2024

Jing Nathan Yan

Justin T. Chiu

Fei Yuan

Papers citing "A Controlled Study on Long Context Extension and Generalization in LLMs"

3 / 3 papers shown

Title
Effective Length Extrapolation via Dimension-Wise Positional Embeddings Manipulation Yi Lu Wanxu Zhao Xin Zhou Chenxin An C. Wang ... Jun Zhao Tao Ji Tao Gui Qi Zhang Xuanjing Huang 39 0 0 26 Apr 2025
Scaling Multi-Document Event Summarization: Evaluating Compression vs. Full-Text Approaches Adithya Pratapa Teruko Mitamura 91 1 0 10 Feb 2025
How to Train Long-Context Language Models (Effectively) Tianyu Gao Alexander Wettig Howard Yen Danqi Chen RALM 66 37 0 03 Oct 2024