Deep geometric knowledge distillation with graphs

Deep geometric knowledge distillation with graphs

8 November 2019

Carlos Lassance

Myriam Bontonou

Vincent Gripon

Jian Tang

Papers citing "Deep geometric knowledge distillation with graphs"

15 / 15 papers shown

Title
Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework Junxian Li Bin Shi Erfei Cui Hua Wei Qinghua Zheng 41 0 0 02 Mar 2024
Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation Chengming Hu Haolun Wu Xuan Li Chen-li Ma Xi Chen Jun Yan Boyu Wang Xue Liu 27 3 0 22 Dec 2023
Teacher-Student Architecture for Knowledge Distillation: A Survey Chengming Hu Xuan Li Danyang Liu Haolun Wu Xi Chen Ju Wang Xue Liu 21 16 0 08 Aug 2023
Frameless Graph Knowledge Distillation Dai Shi Zhiqi Shao Yi Guo Junbin Gao 32 4 0 13 Jul 2023
Extracting Low-/High- Frequency Knowledge from Graph Neural Networks and Injecting it into MLPs: An Effective GNN-to-MLP Distillation Framework Lirong Wu Haitao Lin Yufei Huang Tianyu Fan Stan Z. Li 13 29 0 18 May 2023
Graph-based Knowledge Distillation: A survey and experimental evaluation Jing Liu Tongya Zheng Guanzheng Zhang Qinfen Hao 29 8 0 27 Feb 2023
The Geometry of Self-supervised Learning Models and its Impact on Transfer Learning Romain Cosentino Sarath Shekkizhar Mahdi Soltanolkotabi A. Avestimehr Antonio Ortega SSL 51 7 0 18 Sep 2022
Graph Neural Networks in IoT: A Survey Guimin Dong Mingyue Tang Zhiyuan Wang Jiechao Gao Sikun Guo Lihua Cai Robert Gutierrez Brad Campbell Laura E. Barnes M. Boukhechba GNN AI4CE 34 96 0 29 Mar 2022
Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation Sumanth Chennupati Mohammad Mahdi Kamani Zhongwei Cheng Lin Chen 19 4 0 19 Oct 2021
Channel redundancy and overlap in convolutional neural networks with channel-wise NNK graphs David Bonet Antonio Ortega Javier Ruiz-Hidalgo Sarath Shekkizhar GNN 31 7 0 18 Oct 2021
Graphs as Tools to Improve Deep Learning Methods Carlos Lassance Myriam Bontonou Mounia Hamidouche Bastien Pasdeloup Lucas Drumetz Vincent Gripon GNN AI4CE AAML 39 0 0 08 Oct 2021
DnS: Distill-and-Select for Efficient and Accurate Video Indexing and Retrieval Giorgos Kordopatis-Zilos Christos Tzelepis Symeon Papadopoulos I. Kompatsiaris Ioannis Patras 22 33 0 24 Jun 2021
Rethinking Weight Decay For Efficient Neural Network Pruning Hugo Tessier Vincent Gripon Mathieu Léonardon M. Arzel T. Hannagan David Bertrand 26 25 0 20 Nov 2020
Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher Guangda Ji Zhanxing Zhu 53 42 0 20 Oct 2020
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016