Episodic Memory in Lifelong Language Learning

3 June 2019

Cyprien de Masson dÁutume

Lingpeng Kong

Papers citing "Episodic Memory in Lifelong Language Learning"

50 / 169 papers shown

Title
Fine-tuned Language Models are Continual Learners Thomas Scialom Tuhin Chakrabarty Smaranda Muresan CLL LRM 145 117 0 24 May 2022
Enhancing Continual Learning with Global Prototypes: Counteracting Negative Representation Drift Xueying Bai Jinghuan Shang Yifan Sun Niranjan Balasubramanian CLL 30 1 0 24 May 2022
Cross-lingual Lifelong Learning Meryem M'hamdi Xiang Ren Jonathan May CLL 35 8 0 23 May 2022
RVAE-LAMOL: Residual Variational Autoencoder to Enhance Lifelong Language Learning Han Wang Ruiliu Fu Xuejun Zhang Jun Zhou CLL 18 4 0 22 May 2022
Meta Learning for Natural Language Processing: A Survey Hung-yi Lee Shang-Wen Li Ngoc Thang Vu 49 42 0 03 May 2022
Entropy-based Stability-Plasticity for Lifelong Learning Vladimir Araujo J. Hurtado Alvaro Soto Marie-Francine Moens CLL 21 15 0 18 Apr 2022
Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detection Minqian Liu Shiyu Chang Lifu Huang KELM CLL 22 29 0 15 Apr 2022
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 41 175 0 12 Apr 2022
Continual Learning Based on OOD Detection and Task Masking Gyuhak Kim Sepideh Esmaeilpour Changnan Xiao Bing-Quan Liu OODD CLL 22 17 0 17 Mar 2022
ConTinTin: Continual Learning from Task Instructions Wenpeng Yin Jia Li Caiming Xiong CLL 21 29 0 16 Mar 2022
ELLE: Efficient Lifelong Pre-training for Emerging Data Yujia Qin Jiajie Zhang Yankai Lin Zhiyuan Liu Peng Li Maosong Sun Jie Zhou 21 67 0 12 Mar 2022
Memory Efficient Continual Learning with Transformers B. Ermiş Giovanni Zappella Martin Wistuba Aditya Rawal Cédric Archambeau CLL 21 42 0 09 Mar 2022
Consistent Representation Learning for Continual Relation Extraction Kang Zhao Hua Xu Jian Yang Kai Gao CLL 23 50 0 05 Mar 2022
Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language Generation Zhuang Li Lizhen Qu Qiongkai Xu Tongtong Wu Tianyang Zhan Gholamreza Haffari CoGe UD DRL 41 4 0 27 Feb 2022
BERT WEAVER: Using WEight AVERaging to enable lifelong learning for transformer-based models in biomedical semantic search engines Lisa Langnickel Alexander Schulz Barbara Hammer Juliane Fluck CLL MedIm 14 3 0 21 Feb 2022
Relational Memory Augmented Language Models Qi Liu Dani Yogatama Phil Blunsom KELM RALM 61 32 0 24 Jan 2022
Continual Learning of Long Topic Sequences in Neural Information Retrieval Thomas Gerald Laure Soulier CLL 28 4 0 10 Jan 2022
Effective prevention of semantic drift as angular distance in memory-less continual deep neural networks Khouloud Saadi Muhammad Taimoor Khan CLL 9 0 0 16 Dec 2021
An Empirical Investigation of the Role of Pre-training in Lifelong Learning Sanket Vaibhav Mehta Darshan Patil Sarath Chandar Emma Strubell CLL 37 135 0 16 Dec 2021
Continuous learning of spiking networks trained with local rules D. Antonov K. Sviatov S. Sukhov 15 12 0 18 Nov 2021
Time Waits for No One! Analysis and Challenges of Temporal Misalignment Kelvin Luu Daniel Khashabi Suchin Gururangan Karishma Mandyam Noah A. Smith 22 85 0 14 Nov 2021
Kronecker Factorization for Preventing Catastrophic Forgetting in Large-scale Medical Entity Linking Denis Jered McInerney Luyang Kong Kristjan Arumae Byron C. Wallace Parminder Bhatia CLL 24 1 0 11 Nov 2021
Reminding the Incremental Language Model via Data-Free Self-Distillation Han Wang Ruiliu Fu Chengzhang Li Xuejun Zhang Jun Zhou Yonghong Yan CLL 19 3 0 17 Oct 2021
Lifelong Pretraining: Continually Adapting Language Models to Emerging Corpora Xisen Jin Dejiao Zhang Henghui Zhu Wei Xiao Shang-Wen Li Xiaokai Wei Andrew O. Arnold Xiang Ren KELM CLL 23 110 0 16 Oct 2021
Continual Learning on Noisy Data Streams via Self-Purified Replay C. Kim Jinseo Jeong Sang-chul Moon Gunhee Kim CLL 40 39 0 14 Oct 2021
LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5 Chengwei Qin Shafiq R. Joty CLL 178 98 0 14 Oct 2021
Towards Continual Knowledge Learning of Language Models Joel Jang Seonghyeon Ye Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Stanley Jungkyu Choi Minjoon Seo CLL KELM 224 150 0 07 Oct 2021
DualNet: Continual Learning, Fast and Slow Quang-Cuong Pham Chenghao Liu S. Hoi CLL 71 42 0 01 Oct 2021
Question Answering over Electronic Devices: A New Benchmark Dataset and a Multi-Task Learning based QA Framework Abhilash Nandy Soumya Sharma Shubham Maddhashiya K. Sachdeva Pawan Goyal Niloy Ganguly 22 16 0 13 Sep 2021
Prototype-Guided Memory Replay for Continual Learning Stella Ho Ming Liu Lan Du Longxiang Gao Yong Xiang CLL 8 30 0 28 Aug 2021
Representation Memorization for Fast Learning New Knowledge without Forgetting Fei Mi Tao R. Lin Boi Faltings CLL 11 0 0 28 Aug 2021
DEMix Layers: Disentangling Domains for Modular Language Modeling Suchin Gururangan Michael Lewis Ari Holtzman Noah A. Smith Luke Zettlemoyer KELM MoE 13 127 0 11 Aug 2021
Towards Continual Entity Learning in Language Models for Conversational Agents R. Gadde I. Bulyko KELM 14 1 0 30 Jul 2021
End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering Devendra Singh Sachan Siva Reddy William L. Hamilton Chris Dyer Dani Yogatama OOD RALM 29 160 0 09 Jun 2021
Meta-Learning with Variational Semantic Memory for Word Sense Disambiguation Yingjun Du Nithin Holla Xiantong Zhen Cees G. M. Snoek Ekaterina Shutova 22 9 0 05 Jun 2021
Lifelong Learning of Hate Speech Classification on Social Media Jing Qian Hong Wang Mai Elsherief Xifeng Yan CLL 11 23 0 05 Jun 2021
Smaller Is Better: An Analysis of Instance Quantity/Quality Trade-off in Rehearsal-based Continual Learning Francesco Pelosin A. Torsello 21 1 0 28 May 2021
DRILL: Dynamic Representations for Imbalanced Lifelong Learning Kyra Ahrens Fares Abawi S. Wermter CLL 11 7 0 18 May 2021
Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation for Few-shot Learning Xisen Jin Bill Yuchen Lin Mohammad Rostami Xiang Ren BDL CLL 20 42 0 18 Apr 2021
Dynamically Addressing Unseen Rumor via Continual Learning Nayeon Lee Andrea Madotto Yejin Bang Pascale Fung 14 2 0 18 Apr 2021
Continual Learning for Text Classification with Information Disentanglement Based Regularization Yufan Huang Yanzhe Zhang Jiaao Chen Xuezhi Wang Diyi Yang CLL 15 106 0 12 Apr 2021
Replay in Deep Learning: Current Approaches and Missing Biological Elements Tyler L. Hayes G. Krishnan M. Bazhenov H. Siegelmann T. Sejnowski Christopher Kanan CLL 31 129 0 01 Apr 2021
Lifelong Learning based Disease Diagnosis on Clinical Notes Zifeng Wang Yifan Yang Rui Wen Xi Chen Shao-Lun Huang Yefeng Zheng CLL 18 5 0 27 Feb 2021
Adaptive Semiparametric Language Models Dani Yogatama Cyprien de Masson dÁutume Lingpeng Kong KELM RALM 35 97 0 04 Feb 2021
Mind the Gap: Assessing Temporal Generalization in Neural Language Models Angeliki Lazaridou A. Kuncoro E. Gribovskaya Devang Agrawal Adam Liska ... Sebastian Ruder Dani Yogatama Kris Cao Susannah Young Phil Blunsom VLM 30 207 0 03 Feb 2021
Studying Catastrophic Forgetting in Neural Ranking Models Jesús Lovón-Melgarejo Laure Soulier K. Pinel-Sauvagnat L. Tamine CLL 36 13 0 18 Jan 2021
Curriculum-Meta Learning for Order-Robust Continual Relation Extraction Tongtong Wu Xuekai Li Yuan-Fang Li Reza Haffari Guilin Qi Yujin Zhu Guoqiang Xu CLL 29 67 0 06 Jan 2021
Continual Learning in Task-Oriented Dialogue Systems Andrea Madotto Zhaojiang Lin Zhenpeng Zhou Seungwhan Moon Paul A. Crook Bing-Quan Liu Zhou Yu Eunjoon Cho Zhiguang Wang CLL 19 127 0 31 Dec 2020
Verb Knowledge Injection for Multilingual Event Processing Olga Majewska Ivan Vulić Goran Glavavs E. Ponti Anna Korhonen 13 11 0 31 Dec 2020
Continual Lifelong Learning in Natural Language Processing: A Survey Magdalena Biesialska Katarzyna Biesialska Marta R. Costa-jussá KELM CLL 16 215 0 17 Dec 2020