Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2003.05161
Cited By
v1
v2 (latest)
A Benchmark for Systematic Generalization in Grounded Language Understanding
Neural Information Processing Systems (NeurIPS), 2020
11 March 2020
Laura Ruis
Jacob Andreas
Marco Baroni
Diane Bouchacourt
Brenden M. Lake
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"A Benchmark for Systematic Generalization in Grounded Language Understanding"
50 / 131 papers shown
Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
Weichen Liu
Qiyao Xue
Haoming Wang
Xiangyu Yin
Boyuan Yang
Wei Gao
149
4
0
14 Nov 2025
DecompSR: A dataset for decomposed analyses of compositional multihop spatial reasoning
Lachlan McPheat
Navdeep Kaur
Robert E Blackwell
Alessandra Russo
Anthony G Cohn
Pranava Madhyastha
ReLM
LRM
320
0
0
04 Nov 2025
Question Answering with LLMs and Learning from Answer Sets
Manuel Borroto
Katie Gallagher
Antonio Ielo
Irfan Kareem
Francesco Ricca
Alessandra Russo
LRM
142
3
0
20 Sep 2025
The Gold Medals in an Empty Room: Diagnosing Metalinguistic Reasoning in LLMs with Camlang
Fenghua Liu
Yulong Chen
Yixuan Liu
Zhujun Jin
Solomon Tsai
Ming Zhong
ReLM
LRM
249
1
0
30 Aug 2025
Characterizing Pattern Matching and Its Limits on Compositional Task Structures
Hoyeon Chang
Jinho Park
Hanseul Cho
Sohee Yang
Miyoung Ko
Hyeonbin Hwang
Seungpil Won
Dohaeng Lee
Youbin Ahn
Minjoon Seo
314
1
0
26 May 2025
Data Distributional Properties As Inductive Bias for Systematic Generalization
Computer Vision and Pattern Recognition (CVPR), 2025
Felipe del-Rio
Alain Raymond-Sáez
Daniel Florea
Rodrigo Toro Icarte
Julio Hurtado
Cristian B. Calderon
Á. Soto
AI4CE
529
2
0
27 Feb 2025
On the Fairness, Diversity and Reliability of Text-to-Image Generative Models
Jordan Vice
Naveed Akhtar
Leonid Sigal
Richard Hartley
Lin Wang
EGVM
428
0
0
21 Nov 2024
Quantifying artificial intelligence through algorithmic generalization
Nature Machine Intelligence (Nat. Mach. Intell.), 2024
Takuya Ito
Murray Campbell
L. Horesh
Tim Klinger
Parikshit Ram
ELM
502
0
0
08 Nov 2024
Learning to Ground Existentially Quantified Goals
International Conference on Principles of Knowledge Representation and Reasoning (KR), 2024
Martin Funkquist
Simon Ståhlberg
Hector Geffner
219
1
0
30 Sep 2024
On The Specialization of Neural Modules
International Conference on Learning Representations (ICLR), 2024
Devon Jarvis
Richard Klein
Benjamin Rosman
Andrew M. Saxe
382
19
0
23 Sep 2024
Baba Is AI: Break the Rules to Beat the Benchmark
Nathan Cloos
Meagan Jens
Michelangelo Naim
Yen-Ling Kuo
Ignacio Cases
Andrei Barbu
Christopher J. Cueva
VLM
296
9
0
18 Jul 2024
LLM-A*: Large Language Model Enhanced Incremental Heuristic Search on Path Planning
Silin Meng
Yiwei Wang
Cheng-Fu Yang
Nanyun Peng
Kai-Wei Chang
469
77
0
20 Jun 2024
Look Further Ahead: Testing the Limits of GPT-4 in Path Planning
Mohamed Aghzal
Erion Plaku
Ziyu Yao
ELM
581
12
0
17 Jun 2024
From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks
Jacob Russin
Sam Whitman McGrath
Danielle J. Williams
AI4CE
672
9
0
24 May 2024
Sequential Compositional Generalization in Multimodal Models
Semih Yagcioglu
Osman Batur .Ince
Aykut Erdem
Erkut Erdem
Desmond Elliott
Deniz Yuret
224
1
0
18 Apr 2024
Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models
Neural Information Processing Systems (NeurIPS), 2024
Wenshan Wu
Shaoguang Mao
Yadong Zhang
Yan Xia
Li Dong
Lei Cui
Furu Wei
LRM
466
76
0
04 Apr 2024
Skews in the Phenomenon Space Hinder Generalization in Text-to-Image Generation
Yingshan Chang
Yasi Zhang
Zhiyuan Fang
Yingnian Wu
Yonatan Bisk
Feng Gao
EGVM
310
10
0
25 Mar 2024
Compositional learning of functions in humans and machines
Yanli Zhou
Brenden M. Lake
Adina Williams
CoGe
311
2
0
18 Mar 2024
Specification Overfitting in Artificial Intelligence
Artificial Intelligence Review (Artif Intell Rev), 2024
Benjamin Roth
Pedro Henrique Luz de Araujo
Yuxi Xia
Saskia Kaltenbrunner
Christoph Korab
688
16
0
13 Mar 2024
On the generalization capacity of neural networks during generic multimodal reasoning
International Conference on Learning Representations (ICLR), 2024
Takuya Ito
Soham Dan
Mattia Rigotti
James Kozloski
Murray Campbell
LRM
303
4
0
26 Jan 2024
Compositional Generalization in Spoken Language Understanding
Avik Ray
Yilin Shen
Hongxia Jin
CoGe
313
1
0
25 Dec 2023
Is Feedback All You Need? Leveraging Natural Language Feedback in Goal-Conditioned Reinforcement Learning
Sabrina McCallum
Max Taylor-Davies
Stefano V. Albrecht
Alessandro Suglia
282
3
0
07 Dec 2023
Imagine the Unseen World: A Benchmark for Systematic Generalization in Visual World Models
Neural Information Processing Systems (NeurIPS), 2023
Yeongbin Kim
Gautam Singh
Junyeong Park
Çağlar Gülçehre
Sungjin Ahn
OCL
VLM
292
9
0
15 Nov 2023
Syntax-Guided Transformers: Elevating Compositional Generalization and Grounding in Multimodal Environments
Danial Kamali
Parisa Kordjamshidi
275
2
0
07 Nov 2023
MetaReVision: Meta-Learning with Retrieval for Visually Grounded Compositional Concept Acquisition
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Guangyue Xu
Parisa Kordjamshidi
Joyce Chai
214
2
0
02 Nov 2023
The Validity of Evaluation Results: Assessing Concurrence Across Compositionality Benchmarks
Conference on Computational Natural Language Learning (CoNLL), 2023
Kaiser Sun
Adina Williams
Dieuwke Hupkes
CoGe
279
10
0
26 Oct 2023
Targeted Image Data Augmentation Increases Basic Skills Captioning Robustness
IEEE Games Entertainment Media Conference (IEEE GEM), 2023
Valentin Barriere
Felipe del Rio
Andres Carvallo De Ferari
Carlos Aspillaga
Eugenio Herrera-Berg
Cristian Buc Calderon
DiffM
296
0
0
27 Sep 2023
D3: Data Diversity Design for Systematic Generalization in Visual Question Answering
Amir Rahimi
Vanessa D’Amario
Moyuru Yamada
Kentaro Takemoto
Tomotake Sasaki
Xavier Boix
199
2
0
15 Sep 2023
COLLIE: Systematic Construction of Constrained Text Generation Tasks
International Conference on Learning Representations (ICLR), 2023
Shunyu Yao
Howard Chen
Austin W. Hanjie
Runzhe Yang
Karthik Narasimhan
333
64
0
17 Jul 2023
Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Text
Annual Meeting of the Association for Computational Linguistics (ACL), 2023
Zhun Yang
Adam Ishay
Joohyung Lee
LRM
ELM
318
87
0
15 Jul 2023
Studying Generalization on Memory-Based Methods in Continual Learning
Felipe del-Rio
J. Hurtado
Cristian-Radu Buc
Alvaro Soto
Vincenzo Lomonaco
BDL
285
3
0
16 Jun 2023
Pento-DIARef: A Diagnostic Dataset for Learning the Incremental Algorithm for Referring Expression Generation from Examples
Conference of the European Chapter of the Association for Computational Linguistics (EACL), 2023
P. Sadler
David Schlangen
210
3
0
24 May 2023
Improved Compositional Generalization by Generating Demonstrations for Meta-Learning
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Sam Spilsbury
Alexander Ilin
483
1
0
22 May 2023
HICO-DET-SG and V-COCO-SG: New Data Splits for Evaluating the Systematic Generalization Performance of Human-Object Interaction Detection Models
Kenta Takemoto
Moyuru Yamada
Tomotake Sasaki
H. Akima
663
1
0
17 May 2023
Visual Referential Games Further the Emergence of Disentangled Representations
Kevin Denamganai
S. Missaoui
James Alfred Walker
OCL
CoGe
280
6
0
27 Apr 2023
ReCOGS: How Incidental Details of a Logical Form Overshadow an Evaluation of Semantic Interpretation
Transactions of the Association for Computational Linguistics (TACL), 2023
Zhengxuan Wu
Christopher D. Manning
Christopher Potts
315
28
0
24 Mar 2023
Does Deep Learning Learn to Abstract? A Systematic Probing Framework
International Conference on Learning Representations (ICLR), 2023
Shengnan An
Zeqi Lin
B. Chen
Qiang Fu
Nanning Zheng
Jian-Guang Lou
296
6
0
23 Feb 2023
MAQA: A Multimodal QA Benchmark for Negation
Judith Yue Li
Aren Jansen
Qingqing Huang
Joonseok Lee
Ravi Ganti
Dima Kuzmin
249
7
0
09 Jan 2023
CREPE: Can Vision-Language Foundation Models Reason Compositionally?
Computer Vision and Pattern Recognition (CVPR), 2022
Zixian Ma
Jerry Hong
Mustafa Omer Gul
Mona Gandhi
Irena Gao
Ranjay Krishna
CoGe
450
200
0
13 Dec 2022
A Short Survey of Systematic Generalization
Yuanpeng Li
AI4CE
452
1
0
22 Nov 2022
On the Complexity of Bayesian Generalization
International Conference on Machine Learning (ICML), 2022
Yuge Shi
Manjie Xu
John E. Hopcroft
Kun He
J. Tenenbaum
Song-Chun Zhu
Ying Nian Wu
Wenjuan Han
Yixin Zhu
414
6
0
20 Nov 2022
Logical Tasks for Measuring Extrapolation and Rule Comprehension
Ippei Fujisawa
Ryota Kanai
ELM
LRM
347
5
0
14 Nov 2022
When Can Transformers Ground and Compose: Insights from Compositional Generalization Benchmarks
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Ankur Sikarwar
Arkil Patel
Navin Goyal
ViT
335
11
0
23 Oct 2022
Counterfactual Recipe Generation: Exploring Compositional Generalization in a Realistic Scenario
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Xiao Liu
Yansong Feng
Jizhi Tang
ChenGang Hu
Dongyan Zhao
219
12
0
20 Oct 2022
Neural-Symbolic Recursive Machine for Systematic Generalization
International Conference on Learning Representations (ICLR), 2022
Qing Li
Yixin Zhu
Yitao Liang
Ying Nian Wu
Song-Chun Zhu
Siyuan Huang
NAI
402
15
0
04 Oct 2022
Compositional Semantic Parsing with Large Language Models
Andrew Drozdov
Nathanael Scharli
Ekin Akyuurek
Nathan Scales
Xinying Song
Xinyun Chen
Olivier Bousquet
Denny Zhou
ReLM
LRM
865
107
0
29 Sep 2022
Equivariant Transduction through Invariant Alignment
International Conference on Computational Linguistics (COLING), 2022
Jennifer C. White
Robert Bamler
281
5
0
22 Sep 2022
Improving Compositional Generalization in Math Word Problem Solving
Yunshi Lan
Lei Wang
Jingwu Jiang
Ee-Peng Lim
250
9
0
03 Sep 2022
Benchmarking Compositionality with Formal Languages
International Conference on Computational Linguistics (COLING), 2022
Josef Valvoda
Naomi Saphra
Jonathan Rawski
Adina Williams
Robert Bamler
NAI
CoGe
310
14
0
17 Aug 2022
The Neural Race Reduction: Dynamics of Abstraction in Gated Networks
International Conference on Machine Learning (ICML), 2022
Andrew M. Saxe
Shagun Sodhani
Sam Lewallen
AI4CE
231
50
0
21 Jul 2022
1
2
3
Next
Page 1 of 3
