AMD: Automatic Multi-step Distillation of Large-scale Vision Models

AMD: Automatic Multi-step Distillation of Large-scale Vision Models

5 July 2024

Raghuveer M. Rao

Lifu Huang

Papers citing "AMD: Automatic Multi-step Distillation of Large-scale Vision Models"

7 / 7 papers shown

Title
Facing the Elephant in the Room: Visual Prompt Tuning or Full Finetuning? Cheng Han Qifan Wang Yiming Cui Wenguan Wang Lifu Huang Siyuan Qi Dongfang Liu VLM 44 19 0 23 Jan 2024
NORM: Knowledge Distillation via N-to-One Representation Matching Xiaolong Liu Lujun Li Chao Li Anbang Yao 39 66 0 23 May 2023
DepGraph: Towards Any Structural Pruning Gongfan Fang Xinyin Ma Mingli Song Michael Bi Mi Xinchao Wang GNN 79 245 0 30 Jan 2023
Visual Recognition with Deep Nearest Centroids Wenguan Wang Cheng Han Tianfei Zhou Dongfang Liu 49 89 0 15 Sep 2022
ViTKD: Practical Guidelines for ViT feature knowledge distillation Zhendong Yang Zhe Li Ailing Zeng Zexian Li Chun Yuan Yu Li 81 42 0 06 Sep 2022
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 948 20,214 0 17 Apr 2017
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 279 39,083 0 01 Sep 2014