Masked Generative Distillation

3 May 2022

Papers citing "Masked Generative Distillation"

25 / 75 papers shown

Title
Student-friendly Knowledge Distillation Mengyang Yuan Bo Lang Fengnan Quan 10 17 0 18 May 2023
Avatar Knowledge Distillation: Self-ensemble Teacher Paradigm with Uncertainty Yuan Zhang Weihua Chen Yichen Lu Tao Huang Xiuyu Sun Jian Cao 50 8 0 04 May 2023
LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillation Song Wang Wentong Li Wenyu Liu Xiaolu Liu Jianke Zhu 20 17 0 22 Apr 2023
Towards Efficient Task-Driven Model Reprogramming with Foundation Models Shoukai Xu Jiangchao Yao Ran Luo Shuhai Zhang Zihao Lian Mingkui Tan Bo Han Yaowei Wang 19 6 0 05 Apr 2023
A Simple and Generic Framework for Feature Distillation via Channel-wise Transformation Ziwei Liu Yongtao Wang Xiaojie Chu 19 5 0 23 Mar 2023
From Knowledge Distillation to Self-Knowledge Distillation: A Unified Approach with Normalized Loss and Customized Soft Labels Zhendong Yang Ailing Zeng Zhe Li Tianke Zhang Chun Yuan Yu Li 11 70 0 23 Mar 2023
Object-Aware Distillation Pyramid for Open-Vocabulary Object Detection Luting Wang Yi Liu Penghui Du Zihan Ding Yue Liao Qiaosong Qi Biaolong Chen Si Liu ObjD VLM 68 61 0 10 Mar 2023
UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers Dachuan Shi Chaofan Tao Ying Jin Zhendong Yang Chun Yuan Jiaqi Wang VLM ViT 18 37 0 31 Jan 2023
AMD: Adaptive Masked Distillation for Object Detection Guang-hong Yang Yin Tang Jun Li Jianhua Xu Xili Wan 17 6 0 31 Jan 2023
Aerial Image Object Detection With Vision Transformer Detector (ViTDet) Liya Wang A. Tien 27 6 0 28 Jan 2023
Discriminator-Cooperated Feature Map Distillation for GAN Compression Tie Hu Mingbao Lin Lizhou You Fei Chao Rongrong Ji 18 5 0 29 Dec 2022
DAMO-YOLO : A Report on Real-Time Object Detection Design Xianzhe Xu Yiqi Jiang Weihua Chen Yi-Li Huang Yuanhang Zhang Xiuyu Sun ObjD 19 156 0 23 Nov 2022
D $^3$ ETR: Decoder Distillation for Detection Transformer Xiaokang Chen Jiahui Chen Y. Liu Gang Zeng 32 16 0 17 Nov 2022
DETRDistill: A Universal Knowledge Distillation Framework for DETR-families Jiahao Chang Shuo Wang Guangkai Xu Zehui Chen Chenhongyi Yang Fengshang Zhao 19 29 0 17 Nov 2022
BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection Zehui Chen Zhenyu Li Shiquan Zhang Liangji Fang Qinhong Jiang Feng Zhao 32 60 0 17 Nov 2022
Knowledge Distillation for Detection Transformer with Consistent Distillation Points Sampling Yu Wang Xin Li Shengzhao Wen Fu-En Yang Wanping Zhang Gang Zhang Haocheng Feng Junyu Han Errui Ding 37 5 0 15 Nov 2022
Towards Sustainable Self-supervised Learning Shanghua Gao Pan Zhou Mingg-Ming Cheng Shuicheng Yan CLL 25 7 0 20 Oct 2022
Exploring Inconsistent Knowledge Distillation for Object Detection with Data Augmentation Jiawei Liang Siyuan Liang Aishan Liu Ke Ma Jingzhi Li Xiaochun Cao VLM 43 15 0 20 Sep 2022
ViTKD: Practical Guidelines for ViT feature knowledge distillation Zhendong Yang Zhe Li Ailing Zeng Zexian Li Chun Yuan Yu Li 84 42 0 06 Sep 2022
Rethinking Knowledge Distillation via Cross-Entropy Zhendong Yang Zhe Li Yuan Gong Tianke Zhang Shanshan Lao Chun Yuan Yu Li 25 14 0 22 Aug 2022
Task-Balanced Distillation for Object Detection Ruining Tang Zhen-yu Liu Yangguang Li Yiguo Song Hui Liu Qide Wang Jing Shao Guifang Duan Jianrong Tan 19 20 0 05 Aug 2022
FlowNAS: Neural Architecture Search for Optical Flow Estimation Zhiwei Lin Tingting Liang Taihong Xiao Yongtao Wang Zhi Tang Ming-Hsuan Yang 11 0 0 04 Jul 2022
TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation R. Liu Kailun Yang Alina Roitberg Jiaming Zhang Kunyu Peng Huayao Liu Yaonan Wang Rainer Stiefelhagen ViT 34 35 0 27 Feb 2022
Distilling Knowledge via Knowledge Review Pengguang Chen Shu-Lin Liu Hengshuang Zhao Jiaya Jia 147 416 0 19 Apr 2021
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 948 20,214 0 17 Apr 2017