v1v2 (latest)

Graph-based Knowledge Distillation by Multi-head Attention Network

4 July 2019

Papers citing "Graph-based Knowledge Distillation by Multi-head Attention Network"

40 / 40 papers shown

Title
On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning Pengfei Fang Yongchun Qin H. Xue CLL 125 0 0 15 Dec 2024
PRG: Prompt-Based Distillation Without Annotation via Proxy Relational Graph Yijin Xu Jialun Liu Hualiang Wei Wenhui Li 77 0 0 22 Aug 2024
A Survey on Symbolic Knowledge Distillation of Large Language Models Kamal Acharya Alvaro Velasquez Haoze Song SyDa 74 7 0 12 Jul 2024
Low-Resolution Chest X-ray Classification via Knowledge Distillation and Multi-task Learning Yasmeena Akhter Rishabh Ranjan Richa Singh Mayank Vatsa 66 0 0 22 May 2024
A Comprehensive Review of Knowledge Distillation in Computer Vision Sheikh Musa Kaleem Tufail Rouf Gousia Habib Tausifa Jan Saleem Brejesh Lall VLM 66 13 0 01 Apr 2024
Teaching MLP More Graph Information: A Three-stage Multitask Knowledge Distillation Framework Junxian Li Bin Shi Erfei Cui Hua Wei Qinghua Zheng 92 0 0 02 Mar 2024
Classifying Nodes in Graphs without GNNs Daniel Winter Niv Cohen Yedid Hoshen 238 2 0 08 Feb 2024
Education distillation:getting student models to learn in shcools Ling Feng Danyang Li Tianhao Wu Xuliang Duan Xuliang Duan FedML 51 0 0 23 Nov 2023
One-stage Modality Distillation for Incomplete Multimodal Learning Shicai Wei Yang Luo Chunbo Luo 73 0 0 15 Sep 2023
Common Knowledge Learning for Generating Transferable Adversarial Examples Rui Yang Yuanfang Guo Junfu Wang Jiantao Zhou Yun-an Wang AAML 46 0 0 01 Jul 2023
Categories of Response-Based, Feature-Based, and Relation-Based Knowledge Distillation Chuanguang Yang Xinqiang Yu Zhulin An Yongjun Xu VLM OffRL 191 26 0 19 Jun 2023
Graph-based Knowledge Distillation: A survey and experimental evaluation Jing Liu Tongya Zheng Guanzheng Zhang Qinfen Hao 67 8 0 27 Feb 2023
Multimodal learning with graphs Yasha Ektefaie George Dasoulas Ayush Noori Maha Farhat Marinka Zitnik 143 92 0 07 Sep 2022
NOSMOG: Learning Noise-robust and Structure-aware MLPs on Graphs Yijun Tian Chuxu Zhang Zhichun Guo Xiangliang Zhang Nitesh Chawla 107 14 0 22 Aug 2022
Convolutional Fine-Grained Classification with Self-Supervised Target Relation Regularization Kang Liu Ke Chen Kui Jia 89 28 0 03 Aug 2022
Black-box Few-shot Knowledge Distillation Dang Nguyen Sunil R. Gupta Kien Do Svetha Venkatesh 81 17 0 25 Jul 2022
A Survey on AI Sustainability: Emerging Trends on Learning Algorithms and Research Challenges Zhenghua Chen Min-man Wu Alvin Chan Xiaoli Li Yew-Soon Ong 51 7 0 08 May 2022
DistPro: Searching A Fast Knowledge Distillation Process via Meta Optimization XueQing Deng Dawei Sun Shawn D. Newsam Peng Wang 60 9 0 12 Apr 2022
Graph Neural Networks in IoT: A Survey Guimin Dong Mingyue Tang Zhiyuan Wang Jiechao Gao Sikun Guo Lihua Cai Robert Gutierrez Brad Campbell Laura E. Barnes M. Boukhechba GNN AI4CE 93 107 0 29 Mar 2022
Learning Affordance Grounding from Exocentric Images Hongcheng Luo Wei Zhai Jing Zhang Yang Cao Dacheng Tao 91 67 0 18 Mar 2022
Graph Flow: Cross-layer Graph Flow Distillation for Dual Efficient Medical Image Segmentation Wen Zou Muyi Sun 81 18 0 16 Mar 2022
Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AI Jiangchao Yao Shengyu Zhang Yang Yao Feng Wang Jianxin Ma ... Kun Kuang Chao-Xiang Wu Leilei Gan Jingren Zhou Hongxia Yang 158 103 0 11 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 203 84 0 08 Nov 2021
Distilling Object Detectors with Feature Richness Zhixing Du Rui Zhang Ming-Fang Chang Xishan Zhang Shaoli Liu Tianshi Chen Yunji Chen ObjD 97 76 0 01 Nov 2021
Graphs as Tools to Improve Deep Learning Methods Carlos Lassance Myriam Bontonou Mounia Hamidouche Bastien Pasdeloup Lucas Drumetz Vincent Gripon GNN AI4CE AAML 87 0 0 08 Oct 2021
Partial to Whole Knowledge Distillation: Progressive Distilling Decomposed Knowledge Boosts Student Better Xuanyang Zhang Xinming Zhang Jian Sun 59 1 0 26 Sep 2021
Distilling Holistic Knowledge with Graph Neural Networks Sheng Zhou Yucheng Wang Defang Chen Jiawei Chen Xin Eric Wang Can Wang Jiajun Bu 78 57 0 12 Aug 2021
Semi-Supervised Domain Generalizable Person Re-Identification Lingxiao He Wu Liu Jian Liang Kecheng Zheng Xingyu Liao Peng Cheng Tao Mei OOD 73 17 0 11 Aug 2021
Compacting Deep Neural Networks for Internet of Things: Methods and Applications Ke Zhang Hanbo Ying Hongning Dai Lin Li Yuangyuang Peng Keyi Guo Hongfang Yu 84 39 0 20 Mar 2021
Binary Graph Neural Networks Mehdi Bahri Gaétan Bahl Stefanos Zafeiriou GNN AI4CE 78 54 0 31 Dec 2020
Representing Deep Neural Networks Latent Space Geometries with Graphs Carlos Lassance Vincent Gripon Antonio Ortega AI4CE 58 15 0 14 Nov 2020
EGAD: Evolving Graph Representation Learning with Self-Attention and Knowledge Distillation for Live Video Streaming Events Stefanos Antaris Dimitrios Rafailidis Sarunas Girdzijauskas 56 5 0 11 Nov 2020
Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher Guangda Ji Zhanxing Zhu 102 44 0 20 Oct 2020
Collaborative Distillation in the Parameter and Spectrum Domains for Video Action Recognition Haisheng Su Jing Su Dongliang Wang Weihao Gan Wei Wu Mengmeng Wang Junjie Yan Yu Qiao 49 7 0 15 Sep 2020
Matching Guided Distillation Kaiyu Yue Jiangfan Deng Feng Zhou 53 50 0 23 Aug 2020
Interactive Knowledge Distillation Shipeng Fu Zhen Li Jun Xu Ming-Ming Cheng Gwanggil Jeon Xiaomin Yang 58 6 0 03 Jul 2020
Knowledge Distillation: A Survey Jianping Gou B. Yu Stephen J. Maybank Dacheng Tao VLM 285 3,016 0 09 Jun 2020
Role-Wise Data Augmentation for Knowledge Distillation Jie Fu Xue Geng Zhijian Duan Bohan Zhuang Xingdi Yuan Adam Trischler Jie Lin C. Pal Hao Dong 72 15 0 19 Apr 2020
Structure-Level Knowledge Distillation For Multilingual Sequence Labeling Xinyu Wang Yong Jiang Nguyen Bach Tao Wang Fei Huang Kewei Tu 96 36 0 08 Apr 2020
Bypass Enhancement RGB Stream Model for Pedestrian Action Recognition of Autonomous Vehicles Dong Cao Lisha Xu 50 2 0 15 Aug 2019