Efficient Knowledge Distillation: Empowering Small Language Models with Teacher Model Insights

19 September 2024

Mohamad Ballout

Gunther Heidemann

Papers citing "Efficient Knowledge Distillation: Empowering Small Language Models with Teacher Model Insights"

1 / 1 papers shown

Title
Honey, I Shrunk the Language Model: Impact of Knowledge Distillation Methods on Performance and Explainability Daniel Hendriks Philipp Spitzer Niklas Kühl G. Satzger 27 1 0 22 Apr 2025