Cosine Similarity Knowledge Distillation for Individual Class Information Transfer

24 November 2023

Papers citing "Cosine Similarity Knowledge Distillation for Individual Class Information Transfer"

7 / 7 papers shown

Title
Neuropsychology of AI: Relationship Between Activation Proximity and Categorical Proximity Within Neural Categories of Synthetic Cognition Michael Pichat Enola Campoli William Pogrund Jourdan Wilson Michael Veillet-Guillem Anton Melkozerov Paloma Pichat Armanouche Gasparian Samuel Demarchi Judicael Poumay NAI 32 3 0 08 Oct 2024
OTOv3: Automatic Architecture-Agnostic Neural Network Training and Compression from Structured Pruning to Erasing Operators Tianyi Chen Tianyu Ding Zhihui Zhu Zeyu Chen HsiangTao Wu Ilya Zharkov Luming Liang 11 3 0 15 Dec 2023
OTOV2: Automatic, Generic, User-Friendly Tianyi Chen Luming Liang Tian Ding Zhihui Zhu Ilya Zharkov VLM MQ 33 30 0 13 Mar 2023
Asymmetric Temperature Scaling Makes Larger Networks Teach Well Again Xin-Chun Li Wenxuan Fan Shaoming Song Yinchuan Li Bingshuai Li Yunfeng Shao De-Chuan Zhan 21 29 0 10 Oct 2022
Distilling Knowledge via Knowledge Review Pengguang Chen Shu-Lin Liu Hengshuang Zhao Jiaya Jia 147 416 0 19 Apr 2021
Collaborative Distillation for Ultra-Resolution Universal Style Transfer Huan Wang Yijun Li Yuehai Wang Haoji Hu Ming-Hsuan Yang 107 98 0 18 Mar 2020
ImageNet Large Scale Visual Recognition Challenge Olga Russakovsky Jia Deng Hao Su J. Krause S. Satheesh ... A. Karpathy A. Khosla Michael S. Bernstein Alexander C. Berg Li Fei-Fei VLM ObjD 279 39,083 0 01 Sep 2014