Enhancing the Transformer with Explicit Relational Encoding for Math
Problem Solving

Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving

15 October 2019

Roland Fernandez

Jürgen Schmidhuber

Papers citing "Enhancing the Transformer with Explicit Relational Encoding for Math Problem Solving"

16 / 16 papers shown

Title
From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks Jacob Russin Sam Whitman McGrath Danielle J. Williams Lotem Elber-Dorozko AI4CE 73 3 0 24 May 2024
Vector Symbolic Finite State Machines in Attractor Neural Networks Madison Cotteret Hugh Greatorex Martin Ziegler Elisabetta Chicca 39 6 0 02 Dec 2022
A Short Survey of Systematic Generalization Yuanpeng Li AI4CE 38 1 0 22 Nov 2022
Semantic Representations of Mathematical Expressions in a Continuous Vector Space Neeraj Gangwar N. Kani 16 1 0 08 Oct 2022
Structural Biases for Improving Transformers on Translation into Morphologically Rich Languages Paul Soulos Sudha Rao Caitlin Smith Eric Rosen Asli Celikyilmaz ... Coleman Haley Roland Fernandez Hamid Palangi Jianfeng Gao P. Smolensky 24 6 0 11 Aug 2022
Enhancing Neural Mathematical Reasoning by Abductive Combination with Symbolic Library Yang Hu Yang Yu AIMat AI4CE 8 4 0 28 Mar 2022
How much do language models copy from their training data? Evaluating linguistic novelty in text generation using RAVEN R. Thomas McCoy P. Smolensky Tal Linzen Jianfeng Gao Asli Celikyilmaz SyDa 25 119 0 18 Nov 2021
Generating Symbolic Reasoning Problems with Transformer GANs Jens U. Kreber Christopher Hahn AI4CE 30 6 0 19 Oct 2021
The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers Róbert Csordás Kazuki Irie Jürgen Schmidhuber ViT 30 128 0 26 Aug 2021
Going Beyond Linear Transformers with Recurrent Fast Weight Programmers Kazuki Irie Imanol Schlag Róbert Csordás Jürgen Schmidhuber 33 57 0 11 Jun 2021
Compositional Processing Emerges in Neural Networks Solving Math Problems Jacob Russin Roland Fernandez Hamid Palangi Eric Rosen Nebojsa Jojic P. Smolensky Jianfeng Gao 9 13 0 19 May 2021
Investigating the Limitations of Transformers with Simple Arithmetic Tasks Rodrigo Nogueira Zhiying Jiang Jimmy J. Li LRM 13 122 0 25 Feb 2021
Scaling Laws for Autoregressive Generative Modeling T. Henighan Jared Kaplan Mor Katz Mark Chen Christopher Hesse ... Nick Ryder Daniel M. Ziegler John Schulman Dario Amodei Sam McCandlish 27 405 0 28 Oct 2020
Hopfield Networks is All You Need Hubert Ramsauer Bernhard Schafl Johannes Lehner Philipp Seidl Michael Widrich ... David P. Kreil Michael K Kopp G. Klambauer Johannes Brandstetter Sepp Hochreiter 24 414 0 16 Jul 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 62 2,622 0 05 Jun 2020
The Next Decade in AI: Four Steps Towards Robust Artificial Intelligence G. Marcus VLM 32 353 0 14 Feb 2020