v1v2 (latest)

Multi-level Knowledge Distillation via Knowledge Alignment and Correlation

1 December 2020

Hongxin Hu

Papers citing "Multi-level Knowledge Distillation via Knowledge Alignment and Correlation"

5 / 5 papers shown

Preview-based Category Contrastive Learning for Knowledge Distillation

Muhe Ding

Pengda Qin

Liqiang Nie

304

18 Oct 2024

Adapt Your Teacher: Improving Knowledge Distillation for Exemplar-free Continual Learning

Filip Szatkowski

Mateusz Pyla

Marcin Przewiȩźlikowski

Sebastian Cygert

Bartlomiej Twardowski

Tomasz Trzciñski

CLL

431

18 Aug 2023

Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language ModelConference on Empirical Methods in Natural Language Processing (EMNLP), 2022

Hongxin Hu

273

02 Nov 2022

Unsupervised Learning of Visual Features by Contrasting Cluster Assignments

1.4K

4,836

17 Jun 2020

Contrastive Representation DistillationInternational Conference on Learning Representations (ICLR), 2019

Yonglong Tian

Dilip Krishnan

Phillip Isola

1.6K

1,272

23 Oct 2019