Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting

28 May 2024

Papers citing "Dual Process Learning: Controlling Use of In-Context vs. In-Weights Strategies with Weight Forgetting"

6 / 6 papers shown

Title
ICL CIPHERS: Quantifying "Learning'' in In-Context Learning via Substitution Ciphers Zhouxiang Fang Aayush Mishra Muhan Gao Anqi Liu Daniel Khashabi 40 0 0 28 Apr 2025
Strategy Coopetition Explains the Emergence and Transience of In-Context Learning Aaditya K. Singh Ted Moskovitz Sara Dragutinovic Felix Hill Stephanie C. Y. Chan Andrew Saxe 65 0 0 07 Mar 2025
In-context Learning in Presence of Spurious Correlations Hrayr Harutyunyan R. Darbinyan Samvel Karapetyan Hrant Khachatrian LRM 30 1 0 04 Oct 2024
The dynamic interplay between in-context and in-weight learning in humans and neural networks Jacob Russin Ellie Pavlick Michael J. Frank 36 3 0 13 Feb 2024
The Transient Nature of Emergent In-Context Learning in Transformers Aaditya K. Singh Stephanie C. Y. Chan Ted Moskovitz Erin Grant Andrew M. Saxe Felix Hill 62 31 0 14 Nov 2023
Transformers generalize differently from information stored in context vs in weights Stephanie C. Y. Chan Ishita Dasgupta Junkyung Kim D. Kumaran Andrew Kyle Lampinen Felix Hill 98 45 0 11 Oct 2022