On the Compositional Generalization Gap of In-Context Learning

15 November 2022

Papers citing "On the Compositional Generalization Gap of In-Context Learning"

25 / 25 papers shown

Title
E-InMeMo: Enhanced Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Hong Liu Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 99 0 0 25 Apr 2025
Learning to Substitute Components for Compositional Generalization Z. Li Gangwei Jiang Chenwang Wu Ying Wei Defu Lian Enhong Chen 57 0 0 28 Feb 2025
Not All LLM Reasoners Are Created Equal Arian Hosseini Alessandro Sordoni Daniel Toyama Aaron C. Courville Rishabh Agarwal LRM 36 11 0 02 Oct 2024
When can transformers compositionally generalize in-context? Seijin Kobayashi Simon Schug Yassir Akram Florian Redhardt J. Oswald Razvan Pascanu Guillaume Lajoie João Sacramento ViT 23 0 0 17 Jul 2024
Attention as a Hypernetwork Simon Schug Seijin Kobayashi Yassir Akram João Sacramento Razvan Pascanu GNN 22 3 0 09 Jun 2024
Compositional Generalization with Grounded Language Models Sondre Wold Étienne Simon Lucas Georges Gabriel Charpentier Egor V. Kostylev Erik Velldal Lilja Øvrelid KELM 18 0 0 07 Jun 2024
DiNeR: a Large Realistic Dataset for Evaluating Compositional Generalization ChenGang Hu Xiao Liu Yansong Feng CoGe 26 0 0 07 Jun 2024
A General Theory for Compositional Generalization Jingwen Fu Zhizheng Zhang Yan Lu Nanning Zheng AI4CE CoGe 24 2 0 20 May 2024
Exploring the Compositional Deficiency of Large Language Models in Mathematical Reasoning Jun Zhao Jingqi Tong Yurong Mou Ming Zhang Qi Zhang Xuanjing Huang LRM 42 3 0 05 May 2024
Towards Understanding the Relationship between In-context Learning and Compositional Generalization Sungjun Han Sebastian Padó CoGe 16 2 0 18 Mar 2024
Positional Information Matters for Invariant In-Context Learning: A Case Study of Simple Function Classes Yongqiang Chen Binghui Xie Kaiwen Zhou Bo Han Yatao Bian James Cheng 19 2 0 30 Nov 2023
Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks Rahul Ramesh Ekdeep Singh Lubana Mikail Khona Robert P. Dick Hidenori Tanaka CoGe 22 6 0 21 Nov 2023
Leveraging Code to Improve In-context Learning for Semantic Parsing Ben Bogin Shivanshu Gupta Peter Clark Ashish Sabharwal 16 6 0 16 Nov 2023
Instruct Me More! Random Prompting for Visual In-Context Learning Jiahao Zhang Bowen Wang Liangzhi Li Yuta Nakashima Hajime Nagahara VLM 20 15 0 07 Nov 2023
The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks Kaiser Sun Adina Williams Dieuwke Hupkes CoGe 11 6 0 26 Oct 2023
Adapt and Decompose: Efficient Generalization of Text-to-SQL via Domain Adapted Least-To-Most Prompting Aseem Arora Shabbirhussain Bhaisaheb Harshit Nigam Manasi S. Patwardhan L. Vig Gautam M. Shroff 16 8 0 01 Aug 2023
Power-up! What Can Generative Models Do for Human Computation Workflows? Garrett Allen Gaole He U. Gadiraju 27 3 0 05 Jul 2023
Testing the General Deductive Reasoning Capacity of Large Language Models Using OOD Examples Abulhair Saparov Richard Yuanzhe Pang Vishakh Padmakumar Nitish Joshi Seyed Mehran Kazemi Najoung Kim He He ELM LRM 13 81 0 24 May 2023
How Do In-Context Examples Affect Compositional Generalization? Shengnan An Zeqi Lin Qiang Fu B. Chen Nanning Zheng Jian-Guang Lou Dongmei Zhang 16 49 0 08 May 2023
Neuro-symbolic Zero-Shot Code Cloning with Cross-Language Intermediate Representation Krishnam Hasija Shrishti Pradhan Manasi S. Patwardhan Raveendra Kumar Medicherla L. Vig Ravindra Naik 11 2 0 26 Apr 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 27 100 0 20 Mar 2023
Diverse Demonstrations Improve In-context Compositional Generalization Itay Levy Ben Bogin Jonathan Berant 16 128 0 13 Dec 2022
Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners Zhenhailong Wang Manling Li Ruochen Xu Luowei Zhou Jie Lei ... Chenguang Zhu Derek Hoiem Shih-Fu Chang Mohit Bansal Heng Ji MLLM VLM 167 134 0 22 May 2022
Inducing Transformer's Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks Yichen Jiang Mohit Bansal 90 25 0 30 Sep 2021
Constrained Language Models Yield Few-Shot Semantic Parsers Richard Shin C. H. Lin Sam Thomson Charles C. Chen Subhro Roy Emmanouil Antonios Platanios Adam Pauls Dan Klein J. Eisner Benjamin Van Durme 290 196 0 18 Apr 2021