On Continual Model Refinement in Out-of-Distribution Data Streams

4 May 2022

Robin Jia

Xiang Ren

Papers citing "On Continual Model Refinement in Out-of-Distribution Data Streams"

25 / 25 papers shown

Title
Gradient Localization Improves Lifelong Pretraining of Language Models Jared Fernandez Yonatan Bisk Emma Strubell KELM 31 1 0 07 Nov 2024
Novel-WD: Exploring acquisition of Novel World Knowledge in LLMs Using Prefix-Tuning Maxime Méloux Christophe Cerisara KELM CLL 24 0 0 30 Aug 2024
LEMoE: Advanced Mixture of Experts Adaptor for Lifelong Model Editing of Large Language Models Renzhi Wang Piji Li KELM CLL 37 7 0 28 Jun 2024
MoE-CT: A Novel Approach For Large Language Models Training With Resistance To Catastrophic Forgetting Tianhao Li Shangjie Li Binbin Xie Deyi Xiong Baosong Yang CLL 39 3 0 25 Jun 2024
Better Late Than Never: Formulating and Benchmarking Recommendation Editing Chengyu Lai Sheng Zhou Zhimeng Jiang Qiaoyu Tan Yuanchen Bei Jiawei Chen Ningyu Zhang Jiajun Bu OffRL KELM 33 0 0 06 Jun 2024
WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models Peng Wang Zexi Li Ningyu Zhang Ziwen Xu Yunzhi Yao Yong-jia Jiang Pengjun Xie Fei Huang Huajun Chen KELM CLL 45 20 0 23 May 2024
ChronosLex: Time-aware Incremental Training for Temporal Generalization of Legal Classification Tasks Santosh T.Y.S.S Tuan-Quang Vuong Matthias Grabmair AILaw CLL 53 4 0 23 May 2024
Continual Learning of Large Language Models: A Comprehensive Survey Haizhou Shi Zihao Xu Hengyi Wang Weiyi Qin Wenyuan Wang Yibin Wang Zifeng Wang Sayna Ebrahimi Hao Wang CLL KELM LRM 39 62 0 25 Apr 2024
Scalable Model Editing via Customized Expert Networks Zihan Yao Yu He Tianyu Qi Ming Li KELM 32 4 0 03 Apr 2024
Data-driven Discovery with Large Generative Models Bodhisattwa Prasad Majumder Harshit Surana Dhruv Agarwal Sanchaita Hazra Ashish Sabharwal Peter Clark 35 9 0 21 Feb 2024
What Will My Model Forget? Forecasting Forgotten Examples in Language Model Refinement Xisen Jin Xiang Ren KELM CLL 18 6 0 02 Feb 2024
MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRA Lang Yu Qin Chen Jie Zhou Liang He KELM 13 45 0 19 Dec 2023
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances Zihan Zhang Meng Fang Lingxi Chen Mohammad-Reza Namazi-Rad Jun Wang KELM 17 21 0 11 Oct 2023
Continual Learning for Out-of-Distribution Pedestrian Detection Mahdiyar Molahasani Ali Etemad Michael A. Greenspan OODD 18 3 0 26 Jun 2023
Estimating Semantic Similarity between In-Domain and Out-of-Domain Samples Rhitabrat Pokharel Ameeta Agrawal OODD 19 2 0 01 Jun 2023
Dynosaur: A Dynamic Growth Paradigm for Instruction-Tuning Data Curation Da Yin Xiao Liu Fan Yin Ming Zhong Hritik Bansal Jiawei Han Kai-Wei Chang ALM 34 37 0 23 May 2023
Lifelong Language Pretraining with Distribution-Specialized Experts Wuyang Chen Yan-Quan Zhou Nan Du Yanping Huang James Laudon Z. Chen Claire Cu KELM 13 47 0 20 May 2023
Robust Question Answering against Distribution Shifts with Test-Time Adaptation: An Empirical Study Hai Ye Yuyang Ding Juntao Li Hwee Tou Ng OOD TTA 21 9 0 09 Feb 2023
Wild-Time: A Benchmark of in-the-Wild Distribution Shift over Time Huaxiu Yao Caroline Choi Bochuan Cao Yoonho Lee Pang Wei Koh Chelsea Finn OOD 19 73 0 25 Nov 2022
Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors Thomas Hartvigsen S. Sankaranarayanan Hamid Palangi Yoon Kim Marzyeh Ghassemi KELM 14 143 0 20 Nov 2022
Fine-tuned Language Models are Continual Learners Thomas Scialom Tuhin Chakrabarty Smaranda Muresan CLL LRM 139 116 0 24 May 2022
Fast Model Editing at Scale E. Mitchell Charles Lin Antoine Bosselut Chelsea Finn Christopher D. Manning KELM 219 341 0 21 Oct 2021
Multitask Prompted Training Enables Zero-Shot Task Generalization Victor Sanh Albert Webson Colin Raffel Stephen H. Bach Lintang Sutawika ... T. Bers Stella Biderman Leo Gao Thomas Wolf Alexander M. Rush LRM 211 1,656 0 15 Oct 2021
Towards Continual Knowledge Learning of Language Models Joel Jang Seonghyeon Ye Sohee Yang Joongbo Shin Janghoon Han Gyeonghun Kim Stanley Jungkyu Choi Minjoon Seo CLL KELM 222 150 0 07 Oct 2021
CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP Qinyuan Ye Bill Yuchen Lin Xiang Ren 209 179 0 18 Apr 2021