Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data

30 June 2021

Lichao Sun

Papers citing "Local-Global Knowledge Distillation in Heterogeneous Federated Learning with Non-IID Data"

28 / 28 papers shown

Title
Learning Critically: Selective Self Distillation in Federated Learning on Non-IID Data Yuting He Yiqiang Chen Xiaodong Yang H. Yu Yi-Hua Huang Yang Gu FedML 55 20 0 20 Apr 2025
Provably Near-Optimal Federated Ensemble Distillation with Negligible Overhead Won-Jun Jang Hyeon-Seo Park Si-Hyeon Lee FedML 166 0 0 10 Feb 2025
Non-IID data in Federated Learning: A Survey with Taxonomy, Metrics, Methods, Frameworks and Future Directions Daniel Gutiérrez David Solans Mikko A. Heikkilä A. Vitaletti Nicolas Kourtellis Aris Anagnostopoulos I. Chatzigiannakis OOD 101 0 0 19 Nov 2024
Tailored Federated Learning: Leveraging Direction Regulation & Knowledge Distillation Huidong Tang Chen Li Huachong Yu Sayaka Kamei Yasuhiko Morimoto FedML 23 0 0 29 Sep 2024
Federated Learning with Label-Masking Distillation Jianghu Lu Shikun Li Kexin Bao Pengju Wang Zhenxing Qian Shiming Ge FedML 37 10 0 20 Sep 2024
FedQUIT: On-Device Federated Unlearning via a Quasi-Competent Virtual Teacher Alessio Mora Lorenzo Valerio Paolo Bellavista A. Passarella FedML MU 44 2 0 14 Aug 2024
FedSiKD: Clients Similarity and Knowledge Distillation: Addressing Non-i.i.d. and Constraints in Federated Learning Yousef Alsenani Rahul Mishra Khaled R. Ahmed Atta Ur Rahman FedML 28 1 0 14 Feb 2024
Relaxed Contrastive Learning for Federated Learning Seonguk Seo Jinkyu Kim Geeho Kim Bohyung Han FedML 42 8 0 10 Jan 2024
FedSDD: Scalable and Diversity-enhanced Distillation for Model Aggregation in Federated Learning Ho Man Kwan Shenghui Song FedML 17 2 0 28 Dec 2023
FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning Pengchao Han Xingyan Shi Jianwei Huang FedML 28 3 0 28 Nov 2023
UNIDEAL: Curriculum Knowledge Distillation Federated Learning Yuwen Yang Chang Liu Xun Cai Suizhi Huang Hongtao Lu Yue Ding FedML 42 8 0 16 Sep 2023
Heterogeneous Federated Learning via Personalized Generative Networks Zahra Taghiyarrenani Abdallah S. Abdallah Sławomir Nowaczyk Sepideh Pashami FedML 28 0 0 25 Aug 2023
Rethinking Client Drift in Federated Learning: A Logit Perspective Yu-bao Yan Chun-Mei Feng Senior Member Ieee Wangmeng Zuo Senior Member Ieee Mang Ye Mong Goh Ping Li Rick Siow Lei Zhu F. I. C. L. Philip Chen FedML 36 8 0 20 Aug 2023
Teacher-Student Architecture for Knowledge Distillation: A Survey Chengming Hu Xuan Li Danyang Liu Haolun Wu Xi Chen Ju Wang Xue Liu 21 16 0 08 Aug 2023
Federated Learning on Non-iid Data via Local and Global Distillation Xiaolin Zheng Senci Ying Fei Zheng Jianwei Yin Longfei Zheng Chaochao Chen Fengqin Dong FedML 35 6 0 26 Jun 2023
FedTrip: A Resource-Efficient Federated Learning Method with Triplet Regularization Xujing Li Min Liu Sheng Sun Yuwei Wang Hui Jiang Xue Jiang 13 4 0 12 Apr 2023
Re-Weighted Softmax Cross-Entropy to Control Forgetting in Federated Learning G. Legate Lucas Page-Caccia Eugene Belilovsky FedML 26 10 0 11 Apr 2023
GradMA: A Gradient-Memory-based Accelerated Federated Learning with Alleviated Catastrophic Forgetting Kangyang Luo Xiang Li Yunshi Lan Ming Gao FedML 31 32 0 28 Feb 2023
FedICT: Federated Multi-task Distillation for Multi-access Edge Computing Zhiyuan Wu Sheng Sun Yuwei Wang Min Liu Quyang Pan Xue Jiang Bo Gao 35 31 0 01 Jan 2023
Knowledge Distillation for Federated Learning: a Practical Guide Alessio Mora Irene Tenison Paolo Bellavista Irina Rish FedML 22 17 0 09 Nov 2022
Domain Discrepancy Aware Distillation for Model Aggregation in Federated Learning Shangchao Su Bin Li Xiangyang Xue FedML 26 1 0 04 Oct 2022
Towards Efficient Communications in Federated Learning: A Contemporary Survey Zihao Zhao Yuzhu Mao Yang Liu Linqi Song Ouyang Ye Xinlei Chen Wenbo Ding FedML 51 59 0 02 Aug 2022
Handling Data Heterogeneity in Federated Learning via Knowledge Distillation and Fusion Xu Zhou Xinyu Lei Cong Yang Yichun Shi Xiao Zhang Jin-Yang Shi FedML 25 0 0 23 Jul 2022
Multi-Level Branched Regularization for Federated Learning Jinkyu Kim Geeho Kim Bohyung Han FedML 17 53 0 14 Jul 2022
FedDKD: Federated Learning with Decentralized Knowledge Distillation Xinjia Li Boyu Chen Wenlian Lu FedML 11 17 0 02 May 2022
Exploring the Distributed Knowledge Congruence in Proxy-data-free Federated Distillation Zhiyuan Wu Sheng Sun Yuwei Wang Min Liu Quyang Pan Junbo Zhang Zeju Li Qing Liu FedML 21 24 0 14 Apr 2022
Aggregation Delayed Federated Learning Ye Xue Diego Klabjan Yuan Luo FedML OOD 18 5 0 17 Aug 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 184 411 0 14 Jul 2021