More Than Catastrophic Forgetting: Integrating General Capabilities For
Domain-Specific LLMs

More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs

28 May 2024

Chengyuan Liu

Fubang Zhao

Changlong Sun

Papers citing "More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs"

9 / 9 papers shown

Title
Emotion-Qwen: Training Hybrid Experts for Unified Emotion and General Vision-Language Understanding Dawei Huang Qing Li Chuan Yan Zebang Cheng Y. Huang Xiang Li B. Li X. U. Wang Z. Lian Xiaojiang Peng 12 0 0 10 May 2025
Reassessing Layer Pruning in LLMs: New Insights and Methods Yao Lu Hao Cheng Yujie Fang Zeyu Wang Jiaheng Wei Dongwei Xu Qi Xuan Xiaoniu Yang Zhaowei Zhu 61 0 0 23 Nov 2024
Gold Panning in Vocabulary: An Adaptive Method for Vocabulary Expansion of Domain-Specific LLMs Chengyuan Liu Shihang Wang Lizhi Qing Kun Kuang Yangyang Kang Changlong Sun Fei Wu 21 0 0 02 Oct 2024
Enhancing Event Reasoning in Large Language Models through Instruction Fine-Tuning with Semantic Causal Graphs Mazal Bethany Emet Bethany Brandon Wherry Cho-Yu Chiang Nishant Vishwamitra Anthony Rios Peyman Najafirad LRM 29 0 0 30 Aug 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 63 1 0 30 Jul 2024
Orthogonal Subspace Learning for Language Model Continual Learning Xiao Wang Tianze Chen Qiming Ge Han Xia Rong Bao Rui Zheng Qi Zhang Tao Gui Xuanjing Huang CLL 110 85 0 22 Oct 2023
GLM-130B: An Open Bilingual Pre-trained Model Aohan Zeng Xiao Liu Zhengxiao Du Zihan Wang Hanyu Lai ... Jidong Zhai Wenguang Chen Peng-Zhen Zhang Yuxiao Dong Jie Tang BDL LRM 240 1,070 0 05 Oct 2022
LFPT5: A Unified Framework for Lifelong Few-shot Language Learning Based on Prompt Tuning of T5 Chengwei Qin Shafiq R. Joty CLL 150 96 0 14 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 275 3,784 0 18 Apr 2021