Simple Distillation Baselines for Improving Small Self-supervised Models

Simple Distillation Baselines for Improving Small Self-supervised Models

21 June 2021

Jindong Gu

Wei Liu

ArXiv (abs)PDF HTML Github (14★)

Papers citing "Simple Distillation Baselines for Improving Small Self-supervised Models"

6 / 6 papers shown

Title
Relational Self-supervised Distillation with Compact Descriptors for Image Copy Detection Juntae Kim Sungwon Woo Jongho Nang 520 1 0 28 May 2024
Explainability and Robustness of Deep Visual Classification Models Jindong Gu AAML 224 2 0 03 Jan 2023
Improving Label-Deficient Keyword Spotting Through Self-Supervised Pretraining H. S. Bovbjerg Zheng-Hua Tan VLM 182 5 0 04 Oct 2022
Slimmable Networks for Contrastive Self-supervised LearningInternational Journal of Computer Vision (IJCV), 2022 Shuai Zhao Xiaohan Wang Linchao Zhu Yi Yang 173 4 0 30 Sep 2022
On the Efficacy of Small Self-Supervised Contrastive Models without Distillation SignalsAAAI Conference on Artificial Intelligence (AAAI), 2021 Haizhou Shi Youcai Zhang Siliang Tang Wenjie Zhu Yaqian Li Yandong Guo Yueting Zhuang SyDa 220 16 0 30 Jul 2021
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments Mathilde Caron Ishan Misra Julien Mairal Priya Goyal Piotr Bojanowski Armand Joulin OCL SSL 1.2K 4,632 0 17 Jun 2020