Papers citing 'Estimating and Maximizing Mutual Information for Knowledge Distillation'

Title
Information-Theoretic Criteria for Knowledge Distillation in Multimodal Learning Rongrong Xie Yizhou Xu Guido Sanguinetti 92 0 0 15 Oct 2025
The Hidden Link Between RLHF and Contrastive Learning Xufei Lv Kehai Chen Haoyuan Sun X. Bai Min Zhang Houde Liu Kehai Chen 142 2 0 27 Jun 2025
Bayes Conditional Distribution Estimation for Knowledge Distillation Based on Conditional Mutual InformationInternational Conference on Learning Representations (ICLR), 2024 Linfeng Ye Shayan Mohajer Hamidi Renhao Tan En-Hui Yang VLM 241 21 0 16 Jan 2024
Teacher-Student Architecture for Knowledge Distillation: A Survey Chengming Hu Xuan Li Danyang Liu Haolun Wu Xi Chen Ju Wang Xue Liu 232 38 0 08 Aug 2023
Contrastive Representation DistillationInternational Conference on Learning Representations (ICLR), 2019 Yonglong Tian Dilip Krishnan Phillip Isola 1.1K 1,197 0 23 Oct 2019