Can a student Large Language Model perform as well as it's teacher?

3 October 2023

Papers citing "Can a student Large Language Model perform as well as it's teacher?"

3 / 3 papers shown

Title
Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models Junjie Yang Junhao Song Xudong Han Ziqian Bi Tianyang Wang ... Yujie Zhang Qian Niu Benji Peng Keyu Chen Ming Liu VLM 47 0 0 18 Apr 2025
Does Synthetic Data Make Large Language Models More Efficient? Sia Gholami Marwan Omar 33 12 0 11 Oct 2023
Can pruning make Large Language Models more efficient? Sia Gholami Marwan Omar 28 12 0 06 Oct 2023