Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning

17 March 2022

Lin Zhang

Li Shen

Liang Ding

Papers citing "Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning"

30 / 130 papers shown

Title
GradMA: A Gradient-Memory-based Accelerated Federated Learning with Alleviated Catastrophic Forgetting Kangyang Luo Xiang Li Yunshi Lan Ming Gao FedML 23 31 0 28 Feb 2023
FedABC: Targeting Fair Competition in Personalized Federated Learning Dui Wang Li Shen Yong Luo Han Hu Kehua Su Yonggang Wen Dacheng Tao FedML 11 9 0 15 Feb 2023
PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees Chulin Xie De-An Huang Wen-Hsuan Chu Daguang Xu Chaowei Xiao Bo-wen Li Anima Anandkumar FedML 8 10 0 13 Feb 2023
Revisiting Personalized Federated Learning: Robustness Against Backdoor Attacks Zeyu Qin Liuyi Yao Daoyuan Chen Yaliang Li Bolin Ding Minhao Cheng FedML 23 25 0 03 Feb 2023
Federated Learning over Coupled Graphs Runze Lei P. Wang Junzhou Zhao Lin Lan Jing Tao Chao Deng Junlan Feng Xidian Wang Xiaohong Guan FedML 11 14 0 26 Jan 2023
The Best of Both Worlds: Accurate Global and Personalized Models through Federated Learning with Data-Free Hyper-Knowledge Distillation Huancheng Chen Johnny J. Wang H. Vikalo FedML 13 35 0 21 Jan 2023
FedSSC: Shared Supervised-Contrastive Federated Learning Sirui Hu Ling Feng Xiaohan Yang Yongchao Chen FedML 22 4 0 14 Jan 2023
DYNAFED: Tackling Client Data Heterogeneity with Global Dynamics Renjie Pi Weizhong Zhang Yueqi Xie Jiahui Gao Xiaoyu Wang Sunghun Kim Qifeng Chen DD 37 26 0 20 Nov 2022
FedSiam-DA: Dual-aggregated Federated Learning via Siamese Network under Non-IID Data Ming Yang Yanhan Wang Xin Wang Zhenyong Zhang Xiaoming Wu Peng Cheng FedML 18 1 0 17 Nov 2022
FedCL: Federated Multi-Phase Curriculum Learning to Synchronously Correlate User Heterogeneity Mingjie Wang Jianxiong Guo Weijia Jia 19 6 0 14 Nov 2022
One-Time Model Adaptation to Heterogeneous Clients: An Intra-Client and Inter-Image Attention Design Yikai Yan Chaoyue Niu Fan Wu Qinya Li Shaojie Tang Chengfei Lyu Guihai Chen 11 0 0 11 Nov 2022
Knowledge Distillation for Federated Learning: a Practical Guide Alessio Mora Irene Tenison Paolo Bellavista Irina Rish FedML 19 17 0 09 Nov 2022
FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregation Ming Hu Peiheng Zhou Zhihao Yue Zhiwei Ling Yihao Huang Anran Li Yang Liu Xiang Lian Mingsong Chen FedML 16 14 0 15 Oct 2022
FedFM: Anchor-based Feature Matching for Data Heterogeneity in Federated Learning Rui Ye Zhenyang Ni Chenxin Xu Jianyu Wang Siheng Chen Yonina C. Eldar FedML 19 31 0 14 Oct 2022
Meta Knowledge Condensation for Federated Learning Ping Liu Xin Yu Joey Tianyi Zhou DD FedML 25 28 0 29 Sep 2022
Federated Learning from Pre-Trained Models: A Contrastive Learning Approach Yue Tan Guodong Long Jie Ma Lu Liu Tianyi Zhou Jing Jiang FedML 26 168 0 21 Sep 2022
Towards Efficient Communications in Federated Learning: A Contemporary Survey Zihao Zhao Yuzhu Mao Yang Liu Linqi Song Ouyang Ye Xinlei Chen Wenbo Ding FedML 43 59 0 02 Aug 2022
Reducing Training Time in Cross-Silo Federated Learning using Multigraph Topology Tuong Khanh Long Do Binh X. Nguyen Vuong Pham Toan V. Tran Erman Tjiputra Quang-Dieu Tran A. Nguyen FedML AI4CE 23 3 0 20 Jul 2022
DisPFL: Towards Communication-Efficient Personalized Federated Learning via Decentralized Sparse Training Rong Dai Li Shen Fengxiang He Xinmei Tian Dacheng Tao FedML 11 111 0 01 Jun 2022
FRAug: Tackling Federated Learning with Non-IID Features via Representation Augmentation Haokun Chen A. Frikha Denis Krompass Jindong Gu Volker Tresp OOD 25 24 0 30 May 2022
Parameter-Efficient and Student-Friendly Knowledge Distillation Jun Rao Xv Meng Liang Ding Shuhan Qi Dacheng Tao 18 46 0 28 May 2022
FedEntropy: Efficient Device Grouping for Federated Learning Using Maximum Entropy Judgment Zhiwei Ling Zhihao Yue Jun Xia Ming Hu Ting Wang Mingsong Chen FedML 12 8 0 24 May 2022
CDKT-FL: Cross-Device Knowledge Transfer using Proxy Dataset in Federated Learning Huy Q. Le Minh N. H. Nguyen Shashi Raj Pandey Chaoning Zhang C. Hong FedML 26 10 0 04 Apr 2022
Trusted AI in Multi-agent Systems: An Overview of Privacy and Security for Distributed Learning Chuan Ma Jun Li Kang Wei Bo Liu Ming Ding Long Yuan Zhu Han H. Vincent Poor 39 42 0 18 Feb 2022
Compare Where It Matters: Using Layer-Wise Regularization To Improve Federated Learning on Heterogeneous Data Ha Min Son M. Kim T. Chung FedML 8 9 0 01 Dec 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 173 411 0 14 Jul 2021
Preservation of the Global Knowledge by Not-True Distillation in Federated Learning Gihun Lee Minchan Jeong Yongjin Shin Sangmin Bae Se-Young Yun FedML 20 115 0 06 Jun 2021
Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning Shaoxiong Ji Yue Tan Teemu Saravirta Zhiqin Yang Yixin Liu Lauri Vasankari Shirui Pan Guodong Long A. Walid FedML 21 76 0 25 Feb 2021
Performance Optimization for Federated Person Re-identification via Benchmark Analysis Weiming Zhuang Yonggang Wen Xuesen Zhang Xin Gan Daiying Yin Dongzhan Zhou Shuai Zhang Shuai Yi FedML 76 95 0 26 Aug 2020
FedML: A Research Library and Benchmark for Federated Machine Learning Chaoyang He Songze Li Jinhyun So Xiao Zeng Mi Zhang ... Yang Liu Ramesh Raskar Qiang Yang M. Annavaram Salman Avestimehr FedML 162 564 0 27 Jul 2020