Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans

14 October 2021

Papers citing "Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans"

3 / 3 papers shown

Title
Can Transformers Do Enumerative Geometry? Baran Hashemi Roderic G. Corominas Alessandro Giacchetto 14 2 0 27 Aug 2024
Transformers Generalize Linearly Jackson Petty Robert Frank AI4CE 181 12 0 24 Sep 2021
Can RNNs learn Recursive Nested Subject-Verb Agreements? Yair Lakretz T. Desbordes J. King Benoît Crabbé Maxime Oquab S. Dehaene 144 18 0 06 Jan 2021