Mix-CPT: A Domain Adaptation Framework via Decoupling Knowledge Learning
and Format Alignment

Mix-CPT: A Domain Adaptation Framework via Decoupling Knowledge Learning and Format Alignment

15 July 2024

Papers citing "Mix-CPT: A Domain Adaptation Framework via Decoupling Knowledge Learning and Format Alignment"

10 / 10 papers shown

Title
LongReD: Mitigating Short-Text Degradation of Long-Context Large Language Models via Restoration Distillation Zican Dong Junyi Li Jinhao Jiang Mingyu Xu Wayne Xin Zhao B. Wang Weipeng Chen VLM 91 0 0 20 Feb 2025
Towards Effective and Efficient Continual Pre-training of Large Language Models Jie Chen Zhipeng Chen Jiapeng Wang Kun Zhou Yutao Zhu ... Rui Yan Zhewei Wei Di Hu Wenbing Huang Ji-Rong Wen KELM ALM CLL ELM LRM 30 4 0 26 Jul 2024
Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching Xiaoying Zhang Baolin Peng Ye Tian Jingyan Zhou Yipeng Zhang Haitao Mi H. Meng CLL KELM 62 5 0 10 Jun 2024
Fine-tuning Large Language Models with Sequential Instructions Hanxu Hu Simon Yu Pinzhen Chen E. Ponti ALM LRM 66 15 0 12 Mar 2024
Role Prompting Guided Domain Adaptation with General Capability Preserve for Large Language Models Rui Wang Fei Mi Yi Chen Boyang Xue Hongru Wang Qi Zhu Kam-Fai Wong Rui-Lan Xu CLL 25 6 0 05 Mar 2024
Preventing Catastrophic Forgetting in Continual Learning of New Natural Language Tasks Sudipta Kar Giuseppe Castellucci Simone Filice S. Malmasi Oleg Rokhlenko CLL KELM 46 6 0 22 Feb 2023
Fine-tuned Language Models are Continual Learners Thomas Scialom Tuhin Chakrabarty Smaranda Muresan CLL LRM 134 116 0 24 May 2022
Self-Consistency Improves Chain of Thought Reasoning in Language Models Xuezhi Wang Jason W. Wei Dale Schuurmans Quoc Le Ed H. Chi Sharan Narang Aakanksha Chowdhery Denny Zhou ReLM BDL LRM AI4CE 297 3,163 0 21 Mar 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Jason W. Wei Xuezhi Wang Dale Schuurmans Maarten Bosma Brian Ichter F. Xia Ed H. Chi Quoc Le Denny Zhou LM&Ro LRM AI4CE ReLM 315 8,261 0 28 Jan 2022