Teaching Autoregressive Language Models Complex Tasks By Demonstration

5 September 2021

Papers citing "Teaching Autoregressive Language Models Complex Tasks By Demonstration"

19 / 19 papers shown

Title
Your Context Is Not an Array: Unveiling Random Access Limitations in Transformers MohammadReza Ebrahimi Sunny Panchal Roland Memisevic 25 5 0 10 Aug 2024
The pitfalls of next-token prediction Gregor Bachmann Vaishnavh Nagarajan 22 57 0 11 Mar 2024
Automated Repair of Declarative Software Specifications in the Era of Large Language Models Md Rashedul Hasan Jiawei Li Iftekhar Ahmed Hamid Bagheri 17 2 0 19 Oct 2023
Empirical Investigation of Neural Symbolic Reasoning Strategies Yoichi Aoki Keito Kudo Tatsuki Kuribayashi Ana Brassard Masashi Yoshikawa Keisuke Sakaguchi Kentaro Inui 6 2 0 16 Feb 2023
ExaRanker: Explanation-Augmented Neural Ranker Fernando Ferraretto Thiago Laitz R. Lotufo Rodrigo Nogueira ELM LRM 20 7 0 25 Jan 2023
Dissociating language and thought in large language models Kyle Mahowald Anna A. Ivanova I. Blank Nancy Kanwisher J. Tenenbaum Evelina Fedorenko ELM ReLM 21 205 0 16 Jan 2023
UniMASK: Unified Inference in Sequential Decision Problems Micah Carroll Orr Paradise Jessy Lin Raluca Georgescu Mingfei Sun ... Stephanie Milani Katja Hofmann Matthew J. Hausknecht Anca Dragan Sam Devlin OffRL 11 21 0 20 Nov 2022
Metaphors We Learn By Roland Memisevic 11 0 0 11 Nov 2022
Learning to Reason With Relational Abstractions A. Nam Mengye Ren Chelsea Finn James L. McClelland ReLM LRM 16 4 0 06 Oct 2022
Induced Natural Language Rationales and Interleaved Markup Tokens Enable Extrapolation in Large Language Models M. Bueno Carlos Gemmel Jeffrey Stephen Dalton R. Lotufo Rodrigo Nogueira LRM 20 12 0 24 Aug 2022
Limitations of Language Models in Arithmetic and Symbolic Induction Jingu Qian Hong Wang Zekun Li Shiyang Li Xifeng Yan ReLM LRM 27 72 0 09 Aug 2022
Towards Flexible Inference in Sequential Decision Problems via Bidirectional Transformers Micah Carroll Jessy Lin Orr Paradise Raluca Georgescu Mingfei Sun ... Stephanie Milani Katja Hofmann Matthew J. Hausknecht Anca Dragan Sam Devlin OffRL 13 9 0 28 Apr 2022
Can language models learn from explanations in context? Andrew Kyle Lampinen Ishita Dasgupta Stephanie C. Y. Chan Kory Matthewson Michael Henry Tessler Antonia Creswell James L. McClelland Jane X. Wang Felix Hill LRM ReLM 11 282 0 05 Apr 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 315 8,261 0 28 Jan 2022
A Reinforcement Learning Environment for Mathematical Reasoning via Program Synthesis Joseph Palermo Johnny Ye Alok Singh AIMat 12 2 0 15 Jul 2021
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills Ori Yoran Alon Talmor Jonathan Berant ReLM LRM 172 53 0 15 Jul 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 278 3,784 0 18 Apr 2021
Symbolic Behaviour in Artificial Intelligence Adam Santoro Andrew Kyle Lampinen Kory W. Mathewson Timothy Lillicrap David Raposo 14 34 0 05 Feb 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 245 1,977 0 31 Dec 2020