LLMs and the Abstraction and Reasoning Corpus: Successes, Failures, and the Importance of Object-based Representations

26 May 2023

Pashootan Vaezipoor

Papers citing "LLMs and the Abstraction and Reasoning Corpus: Successes, Failures, and the Importance of Object-based Representations"

45 / 45 papers shown

Title
LLM Security: Vulnerabilities, Attacks, Defenses, and Countermeasures Francisco Aguilera-Martínez Fernando Berzal PILM 45 0 0 02 May 2025
Toward Generalizable Evaluation in the LLM Era: A Survey Beyond Benchmarks Yixin Cao Shibo Hong X. Li Jiahao Ying Yubo Ma ... Juanzi Li Aixin Sun Xuanjing Huang Tat-Seng Chua Yu Jiang ALM ELM 84 0 0 26 Apr 2025
Improving In-Context Learning with Reasoning Distillation Nafis Sadeq Xin Xu Zhouhang Xie Julian McAuley Byungkyu Kang Prarit Lamba Xiang Gao RALM ReLM LRM 33 0 0 14 Apr 2025
The Curse of CoT: On the Limitations of Chain-of-Thought in In-Context Learning T. Zheng Yixiang Chen Chengxi Li Chunyang Li Qing Zong Haochen Shi Baixuan Xu Y. Song Ginny Y. Wong Simon See LRM 25 0 0 07 Apr 2025
An Empirical Comparison of Cost Functions in Inductive Logic Programming Céline Hocquette Andrew Cropper 42 0 0 10 Mar 2025
LogiDynamics: Unraveling the Dynamics of Logical Inference in Large Language Model Reasoning Tianshi Zheng Jiayang Cheng Chunyang Li Haochen Shi Z. Wang Jiaxin Bai Y. Song Ginny Y. Wong Simon See LRM 46 2 0 16 Feb 2025
The Stochastic Parrot on LLM's Shoulder: A Summative Assessment of Physical Concept Understanding Mo Yu Lemao Liu J. Wu Tsz Ting Chung Shunchi Zhang JiangNan Li Dit-Yan Yeung Jie Zhou 77 1 0 13 Feb 2025
Abductive Symbolic Solver on Abstraction and Reasoning Corpus Mintaek Lim Seokki Lee Liyew Woletemaryam Abitew Sundong Kim 117 1 0 27 Nov 2024
Object-centric proto-symbolic behavioural reasoning from pixels R. S. V. Bergen Justus F. Hübotter Pablo Lanillos LM&Ro OCL 70 0 0 26 Nov 2024
Evidence of Cognitive Deficits andDevelopmental Advances in Generative AI: A Clock Drawing Test Analysis I. Galatzer-Levy Jed McGiffin David Munday Xin Liu Danny Karmon Ilia Labzovsky Rivka Moroshko Amir Zait Daniel J. McDuff 17 0 0 15 Oct 2024
MIRAGE: Evaluating and Explaining Inductive Reasoning Process in Language Models Jiachun Li Pengfei Cao Zhuoran Jin Yubo Chen Kang-Jun Liu Jun Zhao LRM ELM 32 4 0 12 Oct 2024
Mars: Situated Inductive Reasoning in an Open-World Environment Xiaojuan Tang Jiaqi Li Yitao Liang Song-chun Zhu Muhan Zhang Zilong Zheng LM&Ro LRM LLMAG 13 1 0 10 Oct 2024
System 2 Reasoning via Generality and Adaptation Sejin Kim Sundong Kim LRM AI4CE 60 0 0 10 Oct 2024
Tackling the Abstraction and Reasoning Corpus with Vision Transformers: the Importance of 2D Representation, Positions, and Objects Wenhao Li Yudong Xu Scott Sanner Elias Boutros Khalil ViT 14 2 0 08 Oct 2024
CAX: Cellular Automata Accelerated in JAX Maxence Faldor Antoine Cully 17 0 0 03 Oct 2024
Hypothesizing Missing Causal Variables with LLMs Ivaxi Sheth Sahar Abdelnabi Mario Fritz CML LRM 25 4 0 04 Sep 2024
Relational decomposition for program synthesis Céline Hocquette Andrew Cropper 26 4 0 22 Aug 2024
Inductive or Deductive? Rethinking the Fundamental Reasoning Abilities of LLMs Kewei Cheng Jingfeng Yang Haoming Jiang Zhengyang Wang Binxuan Huang ... Zheng Li Yifan Gao Xian Li Bing Yin Yizhou Sun ELM LRM 22 1 0 31 Jul 2024
ARCLE: The Abstraction and Reasoning Corpus Learning Environment for Reinforcement Learning Hosung Lee Sejin Kim Seungpil Lee Sanha Hwang Jihwan Lee Byung-Jun Lee Sundong Kim LRM 32 8 0 30 Jul 2024
Intelligence Analysis of Language Models Liane Galanti Ethan Baron LRM 14 1 0 20 Jul 2024
BEEAR: Embedding-based Adversarial Removal of Safety Backdoors in Instruction-tuned Language Models Yi Zeng Weiyu Sun Tran Ngoc Huynh Dawn Song Bo Li Ruoxi Jia AAML LLMSV 27 17 0 24 Jun 2024
What is the Visual Cognition Gap between Humans and Multimodal LLMs? Xu Cao Bolin Lai Wenqian Ye Yunsheng Ma Joerg Heintz Jintai Chen Jianguo Cao James M. Rehg 24 5 0 14 Jun 2024
Mistral-C2F: Coarse to Fine Actor for Analytical and Reasoning Enhancement in RLHF and Effective-Merged LLMs Chen Zheng Ke Sun Xun Zhou MoE 31 0 0 12 Jun 2024
HYSYNTH: Context-Free LLM Approximation for Guiding Program Synthesis Shraddha Barke Emmanuel Anaya Gonzalez Saketh Ram Kasibatla Taylor Berg-Kirkpatrick Nadia Polikarpova 33 0 0 24 May 2024
Program Synthesis using Inductive Logic Programming for the Abstraction and Reasoning Corpus Filipe Marinho Rocha Ines Dutra Vítor Santos Costa LRM 27 2 0 10 May 2024
Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus Seungpil Lee Woochang Sim Donghyeon Shin Sanha Hwang Wongyu Seo Jiwon Park Seokki Lee Sejin Kim Sundong Kim LRM 29 19 0 18 Mar 2024
Do Large Language Models Solve ARC Visual Analogies Like People Do? Gustaw Opielka Hannes Rosenbusch Veerle Vijverberg Claire E. Stevenson LRM 12 6 0 13 Mar 2024
Balancing Enhancement, Harmlessness, and General Capabilities: Enhancing Conversational LLMs with Direct RLHF Chen Zheng Ke Sun Hang Wu Chenguang Xi Xun Zhou 39 11 0 04 Mar 2024
Right for Right Reasons: Large Language Models for Verifiable Commonsense Knowledge Graph Question Answering Armin Toroghi Willis Guo Mohammad Mahdi Torabi pour Scott Sanner LRM 20 6 0 03 Mar 2024
CodeIt: Self-Improving Language Models with Prioritized Hindsight Replay Natasha Butt Blazej Manczak Auke Wiggers Corrado Rainone David W. Zhang Michaël Defferrard Taco S. Cohen ReLM LRM 46 17 0 07 Feb 2024
Efficient Causal Graph Discovery Using Large Language Models Thomas Jiralerspong Xiaoyin Chen Yash More Vedant Shah Yoshua Bengio CML 21 19 0 02 Feb 2024
Learning big logical rules by joining small rules Céline Hocquette Andreas Niskanen Rolf Morel Matti Jarvisalo Andrew Cropper 14 1 0 29 Jan 2024
Speak It Out: Solving Symbol-Related Problems with Symbol-to-Language Conversion for Language Models Yile Wang Sijie Cheng Zixin Sun Peng Li Yang Janet Liu ReLM LRM 4 4 0 22 Jan 2024
ICE-GRT: Instruction Context Enhancement by Generative Reinforcement based Transformers Chen Zheng Ke Sun Da Tang Yukun Ma Yuyu Zhang Chenguang Xi Xun Zhou LRM LLMAG 33 2 0 04 Jan 2024
Comparing Humans, GPT-4, and GPT-4V On Abstraction and Reasoning Tasks Melanie Mitchell Alessandro B. Palmarini A. Moskvichev LRM 9 49 0 14 Nov 2023
Examining the Potential and Pitfalls of ChatGPT in Science and Engineering Problem-Solving Karen D. Wang E. Burkholder Carl E. Wieman S. Salehi Nicholas Haber AI4CE ELM 22 33 0 12 Oct 2023
Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement Linlu Qiu Liwei Jiang Ximing Lu Melanie Sclar Valentina Pyatkin ... Bailin Wang Yoon Kim Yejin Choi Nouha Dziri Xiang Ren LRM ReLM 27 38 0 12 Oct 2023
Large Language Model (LLM) as a System of Multiple Expert Agents: An Approach to solve the Abstraction and Reasoning Corpus (ARC) Challenge J. Tan Mehul Motani LLMAG 21 8 0 08 Oct 2023
Hypothesis Search: Inductive Reasoning with Language Models Ruocheng Wang E. Zelikman Gabriel Poesia Yewen Pu Nick Haber Noah D. Goodman ReLM LRM 6 94 0 11 Sep 2023
Large Language Models as General Pattern Machines Suvir Mirchandani F. Xia Peter R. Florence Brian Ichter Danny Driess Montse Gonzalez Arenas Kanishka Rao Dorsa Sadigh Andy Zeng LLMAG 23 183 0 10 Jul 2023
Sparks of Artificial General Intelligence: Early experiments with GPT-4 Sébastien Bubeck Varun Chandrasekaran Ronen Eldan J. Gehrke Eric Horvitz ... Scott M. Lundberg Harsha Nori Hamid Palangi Marco Tulio Ribeiro Yi Zhang ELM AI4MH AI4CE ALM 197 2,953 0 22 Mar 2023
Abstract Visual Reasoning Enabled by Language Giacomo Camposampiero Loic Houmard Benjamin Estermann Joël Mathys Roger Wattenhofer LRM 26 12 0 07 Mar 2023
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 291 2,712 0 24 May 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 315 8,261 0 28 Jan 2022
Neural-guided, Bidirectional Program Search for Abstraction and Reasoning Simon Alford Anshul Gandhi Akshay Rangamani Andrzej Banburski Tony Wang Sylee Dandekar John Chin T. Poggio S. Chin LRM 99 21 0 22 Oct 2021