Can BERT Refrain from Forgetting on Sequential Tasks? A Probing Study

Can BERT Refrain from Forgetting on Sequential Tasks? A Probing Study

International Conference on Learning Representations (ICLR), 2023

2 March 2023

Dongyan Zhao

ArXiv (abs)PDF HTML

Papers citing "Can BERT Refrain from Forgetting on Sequential Tasks? A Probing Study"

8 / 8 papers shown

Title
Revisiting Continual Semantic Segmentation with Pre-trained Vision Models Duzhen Zhang Yong Ren Wei Cong Junhao Zheng Qiaoyi Su ... Xuanle Zhao Ye Bai Feilong Chen Qi Tian Tielin Zhang CLL VLM 129 0 0 06 Aug 2025
Unlocking the Potential of Model Merging for Low-Resource Languages Mingxu Tao Chen Zhang Quzhe Huang Tianyao Ma Songfang Huang Dongyan Zhao Yansong Feng CLL MoMe 263 10 0 04 Jul 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 361 146 0 25 Apr 2024
Balancing the Causal Effects in Class-Incremental Learning Junhao Zheng Ruiyan Wang Chongzhi Zhang Hu Feng Qianli Ma CML CLL 282 1 0 15 Feb 2024
Can LLMs Learn New Concepts Incrementally without Forgetting? Junhao Zheng Shengjie Qiu Qianli Ma CLL 218 0 0 13 Feb 2024
What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement Xisen Jin Xiang Ren KELM CLL 293 8 0 02 Feb 2024
Learn or Recall? Revisiting Incremental Learning with Pre-trained Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Junhao Zheng Shengjie Qiu Qianli Ma 356 12 0 13 Dec 2023
Lawyer LLaMA Technical Report Quzhe Huang Mingxu Tao Chen Zhang Zhenwei An Cong Jiang Zhibin Chen Zirui Wu Yansong Feng ELM ALM AILaw 427 68 0 24 May 2023