Inducing Systematicity in Transformers by Attending to Structurally
Quantized Embeddings

Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings

9 February 2024

Mohit Bansal

Papers citing "Inducing Systematicity in Transformers by Attending to Structurally Quantized Embeddings"

5 / 5 papers shown

Title
From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks Jacob Russin Sam Whitman McGrath Danielle J. Williams Lotem Elber-Dorozko AI4CE 59 2 0 24 May 2024
Compositional Generalization in Unsupervised Compositional Representation Learning: A Study on Disentanglement and Emergent Language Zhenlin Xu Marc Niethammer Colin Raffel CoGe OOD OCL DRL 39 38 0 02 Oct 2022
Inducing Transformer's Compositional Generalization Ability via Auxiliary Sequence Prediction Tasks Yichen Jiang Mohit Bansal 90 25 0 30 Sep 2021
On Compositional Generalization of Neural Machine Translation Yafu Li Yongjing Yin Yulong Chen Yue Zhang 145 44 0 31 May 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,735 0 24 Feb 2021