Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism
of Language Models

Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models

16 May 2023

Xianpei Han

Papers citing "Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models"

9 / 9 papers shown

Title
Order-Robust Class Incremental Learning: Graph-Driven Dynamic Similarity Grouping Guannan Lai Yujie Li Xiangkun Wang Jingyang Zhang Tianrui Li Xin Yang CLL 54 2 0 27 Feb 2025
Revealing and Mitigating Over-Attention in Knowledge Editing Pinzheng Wang Zecheng Tang Keyan Zhou J. Li Qiaoming Zhu Hao Fei KELM 126 2 0 21 Feb 2025
How Much Can We Forget about Data Contamination? Sebastian Bordt Suraj Srinivas Valentyn Boreiko U. V. Luxburg 54 1 0 04 Oct 2024
Realistic Continual Learning Approach using Pre-trained Models Nadia Nasri Carlos Gutiérrez-Álvarez Sergio Lafuente-Arroyo Saturnino Maldonado-Bascón Roberto J. López-Sastre CLL 43 0 0 11 Apr 2024
Towards Continual Knowledge Learning of Language Models Joel Jang Seonghyeon Ye Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Stanley Jungkyu Choi Minjoon Seo CLL KELM 233 151 0 07 Oct 2021
Memorisation versus Generalisation in Pre-trained Language Models Michael Tänzer Sebastian Ruder Marek Rei 94 50 0 16 Apr 2021
Measuring and Improving Consistency in Pretrained Language Models Yanai Elazar Nora Kassner Shauli Ravfogel Abhilasha Ravichander Eduard H. Hovy Hinrich Schütze Yoav Goldberg HILM 272 347 0 01 Feb 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 290 1,833 0 14 Dec 2020
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 458 2,592 0 03 Sep 2019