In-context Learning Generalizes, But Not Always Robustly: The Case of
Syntax

In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax

13 November 2023

Papers citing "In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax"

14 / 14 papers shown

Title
Towards Contamination Resistant Benchmarks Rahmatullah Musawi Sheng Lu 36 0 0 13 May 2025
ICL CIPHERS: Quantifying "Learning'' in In-Context Learning via Substitution Ciphers Zhouxiang Fang Aayush Mishra Muhan Gao Anqi Liu Daniel Khashabi 44 0 0 28 Apr 2025
ObscuraCoder: Powering Efficient Code LM Pre-Training Via Obfuscation Grounding Indraneil Paul Haoyi Yang Goran Glavas Kristian Kersting Iryna Gurevych AAML SyDa 41 0 0 27 Mar 2025
Optimizing Decomposition for Optimal Claim Verification Yining Lu Noah Ziems Hy Dang Meng-Long Jiang 56 0 0 19 Mar 2025
Can Input Attributions Interpret the Inductive Reasoning Process Elicited in In-Context Learning? Mengyu Ye Tatsuki Kuribayashi Goro Kobayashi Jun Suzuki LRM 92 0 0 20 Dec 2024
How Does Code Pretraining Affect Language Model Task Performance? Jackson Petty Sjoerd van Steenkiste Tal Linzen 60 8 0 06 Sep 2024
Look Further Ahead: Testing the Limits of GPT-4 in Path Planning Mohamed Aghzal E. Plaku Ziyu Yao ELM 36 6 0 17 Jun 2024
Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers Kabir Ahuja Vidhisha Balachandran Madhur Panwar Tianxing He Noah A. Smith Navin Goyal Yulia Tsvetkov 39 8 0 25 Apr 2024
Experimental Contexts Can Facilitate Robust Semantic Property Inference in Language Models, but Inconsistently Kanishka Misra Allyson Ettinger Kyle Mahowald 21 4 0 12 Jan 2024
Transformers generalize differently from information stored in context vs in weights Stephanie C. Y. Chan Ishita Dasgupta Junkyung Kim D. Kumaran Andrew Kyle Lampinen Felix Hill 104 45 0 11 Oct 2022
Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought Abulhair Saparov He He ELM LRM ReLM 121 275 0 03 Oct 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 311 11,915 0 04 Mar 2022
Transformers Generalize Linearly Jackson Petty Robert Frank AI4CE 216 16 0 24 Sep 2021
How Can We Accelerate Progress Towards Human-like Linguistic Generalization? Tal Linzen 218 188 0 03 May 2020