Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting

28 May 2024

Papers citing "Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting"

8 / 8 papers shown

Title
ICL CIPHERS: Quantifying "Learning'' in In-Context Learning via Substitution Ciphers Zhouxiang Fang Aayush Mishra Muhan Gao Anqi Liu Daniel Khashabi 44 0 0 28 Apr 2025
Strategy Coopetition Explains the Emergence and Transience of In-Context Learning Aaditya K. Singh Ted Moskovitz Sara Dragutinovic Felix Hill Stephanie C. Y. Chan Andrew Saxe 68 0 0 07 Mar 2025
Training Dynamics of In-Context Learning in Linear Attention Yedi Zhang Aaditya K. Singh Peter E. Latham Andrew Saxe MLT 59 1 0 28 Jan 2025
In-context Learning in Presence of Spurious Correlations Hrayr Harutyunyan R. Darbinyan Samvel Karapetyan Hrant Khachatrian LRM 30 1 0 04 Oct 2024
Investigating the Pre-Training Dynamics of In-Context Learning: Task Recognition vs. Task Learning Xiaolei Wang Xinyu Tang Wayne Xin Zhao Ji-Rong Wen 25 2 0 20 Jun 2024
The dynamic interplay between in-context and in-weight learning in humans and neural networks Jacob Russin Ellie Pavlick Michael J. Frank 38 1 0 13 Feb 2024
The Transient Nature of Emergent In-Context Learning in Transformers Aaditya K. Singh Stephanie C. Y. Chan Ted Moskovitz Erin Grant Andrew M. Saxe Felix Hill 62 31 0 14 Nov 2023
Transformers generalize differently from information stored in context vs in weights Stephanie C. Y. Chan Ishita Dasgupta Junkyung Kim D. Kumaran Andrew Kyle Lampinen Felix Hill 98 45 0 11 Oct 2022