Context-Scaling versus Task-Scaling in In-Context Learning

16 October 2024

Papers citing "Context-Scaling versus Task-Scaling in In-Context Learning"

4 / 4 papers shown

Title
A Survey of Scaling in Large Language Model Reasoning Zihan Chen Song Wang Zhen Tan Xingbo Fu Zhenyu Lei Peng Wang Huan Liu Cong Shen Jundong Li LRM 84 0 0 02 Apr 2025
Overfitting Regimes of Nadaraya-Watson Interpolators Daniel Barzilai Guy Kornowski Ohad Shamir 68 0 0 11 Feb 2025
Training Dynamics of In-Context Learning in Linear Attention Yedi Zhang Aaditya K. Singh Peter E. Latham Andrew Saxe MLT 53 1 0 28 Jan 2025
Can Looped Transformers Learn to Implement Multi-step Gradient Descent for In-context Learning? Khashayar Gatmiry Nikunj Saunshi Sashank J. Reddi Stefanie Jegelka Sanjiv Kumar 61 17 0 10 Oct 2024