Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?

22 May 2023

Zheng Li

Yuxuan Li

Penghai Zhao

Renjie Song

Xiang Li

Jian Yang

ArXiv PDF HTML

Papers citing "Is Synthetic Data From Diffusion Models Ready for Knowledge Distillation?"

22 / 22 papers shown

Title
Feature Alignment and Representation Transfer in Knowledge Distillation for Large Language Models Junjie Yang Junhao Song Xudong Han Ziqian Bi Tianyang Wang ... Y. Zhang Qian Niu Benji Peng Keyu Chen Ming Liu VLM 40 0 0 18 Apr 2025
D-Feat Occlusions: Diffusion Features for Robustness to Partial Visual Occlusions in Object Recognition Rupayan Mallick Sibo Dong Nataniel Ruiz Sarah Adel Bargal DiffM 42 0 0 08 Apr 2025
Data-free Knowledge Distillation with Diffusion Models Xiaohua Qi Renda Li Long Peng Q. Ling Jun Yu Ziyi Chen Peng Chang Mei Han Jing Xiao 44 0 0 01 Apr 2025
GenMix: Effective Data Augmentation with Generative Diffusion Model Image Editing Khawar Islam M. Zaheer Arif Mahmood Karthik Nandakumar Naveed Akhtar DiffM 72 2 0 03 Dec 2024
ODGEN: Domain-specific Object Detection Data Generation with Diffusion Models Jingyuan Zhu Shiyu Li Yuxuan Liu Ping-Chia Huang Jiulong Shan Huimin Ma Jian Yuan 21 3 0 24 May 2024
Zero-Shot Distillation for Image Encoders: How to Make Effective Use of Synthetic Data Niclas Popp J. H. Metzen Matthias Hein VLM 27 1 0 25 Apr 2024
DiffuseMix: Label-Preserving Data Augmentation with Diffusion Models Khawar Islam Muhammad Zaigham Zaheer Arif Mahmood Karthik Nandakumar DiffM 35 26 0 05 Apr 2024
GenView: Enhancing View Quality with Pretrained Generative Model for Self-Supervised Learning Xiaojie Li Yibo Yang Xiangtai Li Jianlong Wu Yue Yu Bernard Ghanem Min Zhang SSL 32 6 0 18 Mar 2024
Rethinking cluster-conditioned diffusion models Nikolas Adaloglou Tim Kaiser Félix D. P. Michels M. Kollmann VLM 29 3 0 01 Mar 2024
DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Control Yuru Jia Lukas Hoyer Shengyu Huang Tianfu Wang Luc Van Gool Konrad Schindler Anton Obukhov DiffM 28 17 0 05 Dec 2023
ToddlerDiffusion: Flash Interpretable Controllable Diffusion Model Eslam Mohamed Bakr Liangbing Zhao Vincent Tao Hu Matthieu Cord Patrick Pérez Mohamed Elhoseiny 14 0 0 24 Nov 2023
Diffusion Model as Representation Learner Xingyi Yang Xinchao Wang DiffM 25 52 0 21 Aug 2023
Federated Generative Learning with Foundation Models Jie M. Zhang Xiaohua Qi Bo-Lu Zhao FedML 29 21 0 28 Jun 2023
On the Design Fundamentals of Diffusion Models: A Survey Ziyi Chang G. Koulieris Hubert P. H. Shum DiffM 27 50 0 07 Jun 2023
Privacy Distillation: Reducing Re-identification Risk of Multimodal Diffusion Models Virginia Fernandez Pedro Sanchez W. H. Pinaya Grzegorz Jacenków Sotirios A. Tsaftaris Jorge Cardoso 21 17 0 02 Jun 2023
Switchable Online Knowledge Distillation Biao Qian Yang Wang Hongzhi Yin Richang Hong Meng Wang 56 37 0 12 Sep 2022
ViTKD: Practical Guidelines for ViT feature knowledge distillation Zhendong Yang Zhe Li Ailing Zeng Zexian Li Chun Yuan Yu Li 81 42 0 06 Sep 2022
Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing? Keshigeyan Chandrasegaran Ngoc-Trung Tran Yunqing Zhao Ngai-man Cheung 75 41 0 29 Jun 2022
RePaint: Inpainting using Denoising Diffusion Probabilistic Models Andreas Lugmayr Martin Danelljan Andrés Romero F. I. F. Richard Yu Radu Timofte Luc Van Gool DiffM 203 1,330 0 24 Jan 2022
Learning Sparse Masks for Diffusion-based Image Inpainting Tobias Alt Pascal Peter Joachim Weickert DiffM 13 13 0 06 Oct 2021
Distilling Knowledge via Knowledge Review Pengguang Chen Shu-Lin Liu Hengshuang Zhao Jiaya Jia 147 416 0 19 Apr 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,735 0 24 Feb 2021