Making Transformers Solve Compositional Tasks

Making Transformers Solve Compositional Tasks

9 August 2021

Santiago Ontañón

Joshua Ainslie

Zachary Kenneth Fisher

Papers citing "Making Transformers Solve Compositional Tasks"

6 / 56 papers shown

Title
LAGr: Labeling Aligned Graphs for Improving Systematic Generalization in Semantic Parsing Dora Jambor Dzmitry Bahdanau 97 9 0 14 Oct 2021
Iterative Decoding for Compositional Generalization in Transformers Luana Ruiz Joshua Ainslie Santiago Ontañón 17 6 0 08 Oct 2021
The Grammar-Learning Trajectories of Neural Language Models Leshem Choshen Guy Hacohen D. Weinshall Omri Abend 27 28 0 13 Sep 2021
The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers Róbert Csordás Kazuki Irie Jürgen Schmidhuber ViT 23 128 0 26 Aug 2021
Enhancing the Transformer Decoder with Transition-based Syntax Leshem Choshen Omri Abend 17 1 0 29 Jan 2021
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 251 2,012 0 28 Jul 2020