Frustratingly Short Attention Spans in Neural Language Modeling

Frustratingly Short Attention Spans in Neural Language Modeling

15 February 2017

Tim Rocktaschel

Sebastian Riedel

Papers citing "Frustratingly Short Attention Spans in Neural Language Modeling"

15 / 15 papers shown

Title
Prompt-Aware Adapter: Towards Learning Adaptive Visual Tokens for Multimodal Large Language Models Yue Zhang Hehe Fan Yi Yang 48 3 0 24 May 2024
Lost in the Middle: How Language Models Use Long Contexts Nelson F. Liu Kevin Lin John Hewitt Ashwin Paranjape Michele Bevilacqua Fabio Petroni Percy Liang RALM 40 1,403 0 06 Jul 2023
A Survey on Aspect-Based Sentiment Classification Gianni Brauwers Flavius Frasincar LLMAG 36 109 0 27 Mar 2022
A General Survey on Attention Mechanisms in Deep Learning Gianni Brauwers Flavius Frasincar 31 296 0 27 Mar 2022
The Health Gym: Synthetic Health-Related Datasets for the Development of Reinforcement Learning Algorithms N. Kuo Mark Polizzotto S. Finfer Federico Garcia Anders Sönnerborg Maurizio Zazzi Michael Böhm Louisa R Jorm S. Barbieri OOD 35 28 0 12 Mar 2022
Embedding Graph Convolutional Networks in Recurrent Neural Networks for Predictive Monitoring Efrén Rama-Maneiro J. Vidal Manuel Lama GNN 14 15 0 17 Dec 2021
Hopfield Networks is All You Need Hubert Ramsauer Bernhard Schafl Johannes Lehner Philipp Seidl Michael Widrich ... David P. Kreil Michael K Kopp G. Klambauer Johannes Brandstetter Sepp Hochreiter 24 412 0 16 Jul 2020
Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks Yi Tay Aston Zhang Anh Tuan Luu J. Rao Shuai Zhang Shuohang Wang Jie Fu S. Hui 23 55 0 11 Jun 2019
Integrating Transformer and Paraphrase Rules for Sentence Simplification Sanqiang Zhao Rui Meng Daqing He Andi Saptono B. Parmanto 16 119 0 26 Oct 2018
Neural Machine Translation with Key-Value Memory-Augmented Attention Fandong Meng Zhaopeng Tu Yong Cheng Haiyang Wu Junjie Zhai Yuekui Yang Di Wang 21 20 0 29 Jun 2018
Modeling Past and Future for Neural Machine Translation Zaixiang Zheng Hao Zhou Shujian Huang Lili Mou Xinyu Dai Jiajun Chen Zhaopeng Tu 27 48 0 27 Nov 2017
Learning to Remember Translation History with a Continuous Cache Zhaopeng Tu Yang Liu Shuming Shi Tong Zhang CLL 35 179 0 26 Nov 2017
Linguistic Knowledge as Memory for Recurrent Neural Networks Bhuwan Dhingra Zhilin Yang William W. Cohen Ruslan Salakhutdinov RALM 27 37 0 07 Mar 2017
Reference-Aware Language Models Zichao Yang Phil Blunsom Chris Dyer Wang Ling 210 80 0 05 Nov 2016
Separating Answers from Queries for Neural Reading Comprehension Dirk Weissenborn GNN 24 21 0 12 Jul 2016