ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2305.18654
  4. Cited By
Faith and Fate: Limits of Transformers on Compositionality
v1v2v3 (latest)

Faith and Fate: Limits of Transformers on Compositionality

Neural Information Processing Systems (NeurIPS), 2023
29 May 2023
Nouha Dziri
Ximing Lu
Melanie Sclar
Xiang Lorraine Li
Liwei Jian
Bill Yuchen Lin
Peter West
Chandra Bhagavatula
Ronan Le Bras
Jena D. Hwang
Soumya Sanyal
Sean Welleck
Xiang Ren
Allyson Ettinger
Zaïd Harchaoui
Yejin Choi
    ReLMLRM
ArXiv (abs)PDFHTMLHuggingFace (7 upvotes)

Papers citing "Faith and Fate: Limits of Transformers on Compositionality"

50 / 328 papers shown
Title
Towards Consistent Long-Term Pose Generation
Towards Consistent Long-Term Pose Generation
Yayuan Li
Filippos Bellos
Jason J. Corso
155
0
0
24 Jul 2025
Adaptive Multi-Agent Reasoning via Automated Workflow Generation
Adaptive Multi-Agent Reasoning via Automated Workflow Generation
Humza Sami
Mubashir ul Islam
P. Gaillardon
V. Tenace
LLMAGLRM
118
0
0
18 Jul 2025
Cultural Bias in Large Language Models: Evaluating AI Agents through Moral Questionnaires
Cultural Bias in Large Language Models: Evaluating AI Agents through Moral Questionnaires
Simon Münker
ELM
171
6
0
14 Jul 2025
Comprehension Without Competence: Architectural Limits of LLMs in Symbolic Computation and Reasoning
Comprehension Without Competence: Architectural Limits of LLMs in Symbolic Computation and Reasoning
Zheng Zhang
LRM
176
1
0
14 Jul 2025
Scaling can lead to compositional generalization
Scaling can lead to compositional generalization
Florian Redhardt
Yassir Akram
Simon Schug
GNNCoGe
203
0
0
09 Jul 2025
Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning
Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning
Maggie Huan
Yuetai Li
Tuney Zheng
Xiaoyu Xu
Seungone Kim
Minxin Du
Radha Poovendran
Graham Neubig
Xiang Yue
LRMELM
163
43
0
01 Jul 2025
Discourse Heuristics For Paradoxically Moral Self-Correction
Discourse Heuristics For Paradoxically Moral Self-CorrectionConference on Empirical Methods in Natural Language Processing (EMNLP), 2025
Guangliang Liu
Zimo Qi
Xitong Zhang
K. Johnson
LRM
161
1
0
01 Jul 2025
LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs
LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs
Xiaoran Liu
Zhigeng Liu
Zengfeng Huang
Zengfeng Huang
Qipeng Guo
Ziwei He
Xipeng Qiu
403
17
0
17 Jun 2025
Distinct Computations Emerge From Compositional Curricula in In-Context Learning
Distinct Computations Emerge From Compositional Curricula in In-Context Learning
Jin Hwa Lee
Andrew Kyle Lampinen
Aaditya K. Singh
Andrew Saxe
172
1
0
16 Jun 2025
Improving Large Language Models with Concept-Aware Fine-Tuning
Improving Large Language Models with Concept-Aware Fine-Tuning
Michael K. Chen
Xikun Zhang
Jiaxing Huang
Dacheng Tao
257
1
0
09 Jun 2025
The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity
The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem ComplexityRobotics (RAS), 2025
Parshin Shojaee
Iman Mirzadeh
Keivan Alizadeh
Maxwell Horton
Samy Bengio
Mehrdad Farajtabar
LRM
266
215
0
07 Jun 2025
RELIC: Evaluating Compositional Instruction Following via Language Recognition
Jackson Petty
Michael Y. Hu
Wentao Wang
Shauli Ravfogel
William Merrill
Tal Linzen
202
2
0
05 Jun 2025
Around the World in 24 Hours: Probing LLM Knowledge of Time and Place
Around the World in 24 Hours: Probing LLM Knowledge of Time and PlaceAnnual Meeting of the Association for Computational Linguistics (ACL), 2025
Carolin Holtermann
Paul Röttger
Anne Lauscher
LRM
221
3
0
04 Jun 2025
Learning to Insert [PAUSE] Tokens for Better Reasoning
Learning to Insert [PAUSE] Tokens for Better ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL), 2025
Eunki Kim
Sangryul Kim
James Thorne
LRM
301
3
0
04 Jun 2025
Fodor and Pylyshyn's Legacy - Still No Human-like Systematic Compositionality in Neural Networks
Fodor and Pylyshyn's Legacy - Still No Human-like Systematic Compositionality in Neural Networks
Tim Woydt
Moritz Willig
Antonia Wüst
Lukas Helff
Wolfgang Stammer
Constantin Rothkopf
Kristian Kersting
190
2
0
02 Jun 2025
Beyond Exponential Decay: Rethinking Error Accumulation in Large Language Models
Beyond Exponential Decay: Rethinking Error Accumulation in Large Language Models
Mikhail L. Arbuzov
Alexey A. Shvets
Sisong Beir
237
1
0
30 May 2025
The Road to Generalizable Neuro-Symbolic Learning Should be Paved with Foundation Models
The Road to Generalizable Neuro-Symbolic Learning Should be Paved with Foundation Models
Adam Stein
Aaditya Naik
Neelay Velingker
Mayur Naik
Eric Wong
NAIAI4CE
199
2
0
30 May 2025
Scalable Complexity Control Facilitates Reasoning Ability of LLMs
Scalable Complexity Control Facilitates Reasoning Ability of LLMs
Liangkai Hang
Junjie Yao
Zhiwei Bai
Jiahao Huo
Yang Chen
...
Feiyu Xiong
Y. Zhang
Weinan E
Hongkang Yang
Zhi-hai Xu
LRM
201
2
0
29 May 2025
Stochastic Chameleons: Irrelevant Context Hallucinations Reveal Class-Based (Mis)Generalization in LLMs
Stochastic Chameleons: Irrelevant Context Hallucinations Reveal Class-Based (Mis)Generalization in LLMsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025
Ziling Cheng
Meng Cao
Marc-Antoine Rondeau
Jackie Chi Kit Cheung
LRM
286
1
0
28 May 2025
GIFARC: Synthetic Dataset for Leveraging Human-Intuitive Analogies to Elevate AI Reasoning
GIFARC: Synthetic Dataset for Leveraging Human-Intuitive Analogies to Elevate AI Reasoning
Woochang Sim
Hyunseok Ryu
Kyungmin Choi
Sungwon Han
Sundong Kim
239
0
0
27 May 2025
Learning Extrapolative Sequence Transformations from Markov Chains
Learning Extrapolative Sequence Transformations from Markov Chains
Sophia Hager
Aleem Khan
Andrew Wang
Nicholas Andrews
BDL
218
0
0
26 May 2025
Characterizing Pattern Matching and Its Limits on Compositional Task Structures
Characterizing Pattern Matching and Its Limits on Compositional Task Structures
Hoyeon Chang
Jinho Park
Hanseul Cho
Sohee Yang
Miyoung Ko
Hyeonbin Hwang
Seungpil Won
Dohaeng Lee
Youbin Ahn
Minjoon Seo
262
1
0
26 May 2025
Two Causally Related Needles in a Video Haystack
Two Causally Related Needles in a Video Haystack
Miaoyu Li
Qin Chao
Boyang Albert Li
CML
296
0
0
26 May 2025
The Quest for Efficient Reasoning: A Data-Centric Benchmark to CoT Distillation
The Quest for Efficient Reasoning: A Data-Centric Benchmark to CoT Distillation
Ruichen Zhang
Rana Muhammad Shahroz Khan
Zhen Tan
Dawei Li
Song Wang
Tianlong Chen
LRM
244
1
0
24 May 2025
Unraveling Misinformation Propagation in LLM Reasoning
Unraveling Misinformation Propagation in LLM Reasoning
Yiyang Feng
Yichen Wang
Shaobo Cui
Boi Faltings
Mina Lee
Jiawei Zhou
LRM
250
3
0
24 May 2025
Small Models, Smarter Learning: The Power of Joint Task Training
Small Models, Smarter Learning: The Power of Joint Task Training
C. Both
Benjamin Hoover
Hendrik Strobelt
Dmitry Krotov
Daniel Karl I. Weidele
Mauro Martino
Nima Dehmamy
206
0
0
23 May 2025
Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human States
Towards Dynamic Theory of Mind: Evaluating LLM Adaptation to Temporal Evolution of Human StatesAnnual Meeting of the Association for Computational Linguistics (ACL), 2025
Yang Xiao
Jiashuo Wang
Qiancheng Xu
Changhe Song
Chunpu Xu
Yi Cheng
Wenjie Li
Pengfei Liu
423
5
0
23 May 2025
Controlled Agentic Planning & Reasoning for Mechanism Synthesis
Controlled Agentic Planning & Reasoning for Mechanism Synthesis
Joao Pedro Gandarela
Thiago Rios
Stefan Menzel
André Freitas
LLMAGLRM
260
0
0
23 May 2025
Knot So Simple: A Minimalistic Environment for Spatial Reasoning
Knot So Simple: A Minimalistic Environment for Spatial Reasoning
Zizhao Chen
Yoav Artzi
LRM
435
0
0
23 May 2025
Advancing the Scientific Method with Large Language Models: From Hypothesis to Discovery
Advancing the Scientific Method with Large Language Models: From Hypothesis to Discovery
Yanbo Zhang
S. Khan
Adnan Mahmud
Huck Yang
Alexander Lavin
...
James A. Evans
Alan R. Bundy
Jannis Brugger
Jesper Tegner
Hector Zenil
LM&MA
389
5
0
22 May 2025
Bottlenecked Transformers: Periodic KV Cache Consolidation for Generalised Reasoning
Bottlenecked Transformers: Periodic KV Cache Consolidation for Generalised Reasoning
Adnan Oomerjee
Zafeirios Fountas
Haitham Bou-Ammar
Haitham Bou-Ammar
360
0
0
22 May 2025
MASLab: A Unified and Comprehensive Codebase for LLM-based Multi-Agent Systems
MASLab: A Unified and Comprehensive Codebase for LLM-based Multi-Agent Systems
Rui Ye
Keduan Huang
Qimin Wu
Yuzhu Cai
Tian Jin
...
Bo An
Yang Gao
Wenjun Wu
Lei Bai
Siheng Chen
LLMAG
408
7
0
22 May 2025
Self-GIVE: Associative Thinking from Limited Structured Knowledge for Enhanced Large Language Model Reasoning
Self-GIVE: Associative Thinking from Limited Structured Knowledge for Enhanced Large Language Model Reasoning
Jiashu He
Jinxuan Fan
Bowen Jiang
Ignacio Houine
Dan Roth
Alejandro Ribeiro
ReLMRALMLRM
306
9
0
21 May 2025
SATBench: Benchmarking LLMs' Logical Reasoning via Automated Puzzle Generation from SAT Formulas
SATBench: Benchmarking LLMs' Logical Reasoning via Automated Puzzle Generation from SAT Formulas
Anjiang Wei
Yuheng Wu
Yingjia Wan
Tarun Suresh
Huanmi Tan
Zhanke Zhou
Sanmi Koyejo
Ke Wang
Ke Wang
ReLMLRM
251
11
0
20 May 2025
A Minimum Description Length Approach to Regularization in Neural Networks
A Minimum Description Length Approach to Regularization in Neural Networks
Matan Abudy
Orr Well
Emmanuel Chemla
Roni Katzir
Nur Lan
259
2
0
19 May 2025
Systematic Generalization in Language Models Scales with Information Entropy
Systematic Generalization in Language Models Scales with Information EntropyAnnual Meeting of the Association for Computational Linguistics (ACL), 2025
Sondre Wold
Lucas Georges Gabriel Charpentier
Étienne Simon
414
0
0
19 May 2025
Questioning Representational Optimism in Deep Learning: The Fractured Entangled Representation Hypothesis
Questioning Representational Optimism in Deep Learning: The Fractured Entangled Representation Hypothesis
Akarsh Kumar
Jeff Clune
Joel Lehman
Kenneth O. Stanley
OOD
279
10
0
16 May 2025
Lost in Transmission: When and Why LLMs Fail to Reason Globally
Lost in Transmission: When and Why LLMs Fail to Reason Globally
Tobias Schnabel
Kiran Tomlinson
Adith Swaminathan
Jennifer Neville
LRM
647
2
0
13 May 2025
Insertion Language Models: Sequence Generation with Arbitrary-Position Insertions
Insertion Language Models: Sequence Generation with Arbitrary-Position Insertions
Dhruvesh Patel
Aishwarya Sahoo
Avinash Amballa
Tahira Naseem
Tim G. J. Rudner
Andrew McCallum
KELM
468
2
0
09 May 2025
Chain-of-Thought Tokens are Computer Program Variables
Chain-of-Thought Tokens are Computer Program Variables
Fangwei Zhu
Peiyi Wang
Zhifang Sui
LRM
319
1
0
08 May 2025
Recursive Decomposition with Dependencies for Generic Divide-and-Conquer Reasoning
Recursive Decomposition with Dependencies for Generic Divide-and-Conquer Reasoning
Sergio Hernández-Gutiérrez
Minttu Alakuijala
Alexander Nikitin
Pekka Marttinen
LRM
240
2
0
05 May 2025
A Theoretical Analysis of Compositional Generalization in Neural Networks: A Necessary and Sufficient Condition
A Theoretical Analysis of Compositional Generalization in Neural Networks: A Necessary and Sufficient Condition
Yuanpeng Li
CoGe
890
0
0
05 May 2025
Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
Vaishnavh Nagarajan
Chen Henry Wu
Charles Ding
Aditi Raghunathan
561
13
0
21 Apr 2025
Rethinking Reflection in Pre-Training
Rethinking Reflection in Pre-Training
Essential AI
Darsh J Shah
Peter Rushton
Somanshu Singla
Mohit Parmar
...
Philip Monk
Platon Mazarakis
Ritvik Kapila
Saurabh Srivastava
Tim Romanski
ReLMLRM
429
37
0
05 Apr 2025
Have Large Language Models Learned to Reason? A Characterization via 3-SAT Phase Transition
Have Large Language Models Learned to Reason? A Characterization via 3-SAT Phase Transition
Rishi Hazra
Gabriele Venturato
Pedro Zuidberg Dos Martires
Luc de Raedt
ReLMLRM
272
7
0
04 Apr 2025
On the Connection Between Diffusion Models and Molecular Dynamics
On the Connection Between Diffusion Models and Molecular Dynamics
Liam Harcombe
Timothy T. Duignan
DiffM
297
1
0
04 Apr 2025
Large Language and Reasoning Models are Shallow Disjunctive Reasoners
Large Language and Reasoning Models are Shallow Disjunctive ReasonersAnnual Meeting of the Association for Computational Linguistics (ACL), 2025
Irtaza Khalid
Amir Masoud Nourollah
Steven Schockaert
LRM
441
1
0
30 Mar 2025
The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction
The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Direction
Yihuai Hong
Dian Zhou
Meng Cao
Lei Yu
Zhijing Jin
LRM
439
12
0
29 Mar 2025
Negation: A Pink Elephant in the Large Language Models' Room?
Negation: A Pink Elephant in the Large Language Models' Room?
Tereza Vrabcová
Marek Kadlcík
Petr Sojka
Michal Štefánik
Michal Spiegel
455
2
0
28 Mar 2025
Landscape of Thoughts: Visualizing the Reasoning Process of Large Language Models
Landscape of Thoughts: Visualizing the Reasoning Process of Large Language Models
Zhanke Zhou
Zhaocheng Zhu
Xuan Li
Mikhail Galkin
Xiao Feng
Sanmi Koyejo
Jian Tang
Bo Han
LRM
417
11
0
28 Mar 2025
Previous
1234567
Next