Preserving Knowledge in Large Language Model with Model-Agnostic
Self-Decompression

Preserving Knowledge in Large Language Model with Model-Agnostic Self-Decompression

17 June 2024

Jianwei Yin

Papers citing "Preserving Knowledge in Large Language Model with Model-Agnostic Self-Decompression"

6 / 6 papers shown

Title
LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement Nicholas Lee Thanakul Wattanawong Sehoon Kim K. Mangalam Sheng Shen Gopala Anumanchipalli Michael W. Mahoney Kurt Keutzer A. Gholami 58 12 0 22 Mar 2024
Towards Optimal Learning of Language Models Yuxian Gu Li Dong Y. Hao Qingxiu Dong Minlie Huang Furu Wei 33 7 0 27 Feb 2024
Catastrophic Forgetting in Deep Learning: A Comprehensive Taxonomy Everton L. Aleixo J. Colonna Marco Cristo Everlandio Fernandes CLL 37 28 0 16 Dec 2023
Orthogonal Subspace Learning for Language Model Continual Learning Xiao Wang Tianze Chen Qiming Ge Han Xia Rong Bao Rui Zheng Qi Zhang Tao Gui Xuanjing Huang CLL 110 85 0 22 Oct 2023
Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes Lokesh Nagalapatti Chun-Liang Li Chih-Kuan Yeh Hootan Nakhost Yasuhisa Fujii Alexander Ratner Ranjay Krishna Chen-Yu Lee Tomas Pfister ALM 198 283 0 03 May 2023
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering Pan Lu Swaroop Mishra Tony Xia Liang Qiu Kai-Wei Chang Song-Chun Zhu Oyvind Tafjord Peter Clark A. Kalyan ELM ReLM LRM 198 1,089 0 20 Sep 2022