Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning

17 March 2022

Lin Zhang

Li Shen

Liang Ding

Papers citing "Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning"

50 / 130 papers shown

Title
FedSDD: Scalable and Diversity-enhanced Distillation for Model Aggregation in Federated Learning Ho Man Kwan Shenghui Song FedML 17 2 0 28 Dec 2023
Federated Learning via Input-Output Collaborative Distillation Xuan Gong Shanglin Li Yuxiang Bao Barry Yao Yawen Huang Ziyan Wu Baochang Zhang Yefeng Zheng David Doermann FedML 8 6 0 22 Dec 2023
Model-Heterogeneous Federated Learning for Internet of Things: Enabling Technologies and Future Directions Boyu Fan Siyang Jiang Xiang Su Pan Hui 12 3 0 19 Dec 2023
Dynamic Heterogeneous Federated Learning with Multi-Level Prototypes Shunxin Guo Hongsong Wang Xin Geng FedML 21 7 0 15 Dec 2023
CLIP-guided Federated Learning on Heterogeneous and Long-Tailed Data Jiangming Shi Shanshan Zheng Xiangbo Yin Yang Lu Yuan Xie Yanyun Qu VLM FedML 35 10 0 14 Dec 2023
Feature Norm Regularized Federated Learning: Transforming Skewed Distributions into Global Insights Ke Hu Weidong Qiu Peng Tang 22 0 0 12 Dec 2023
Exploiting Label Skews in Federated Learning with Model Concatenation Yiqun Diao Q. Li Bingsheng He FedML 22 16 0 11 Dec 2023
Fake It Till Make It: Federated Learning with Consensus-Oriented Generation Rui Ye Yaxin Du Zhenyang Ni Siheng Chen Yanfeng Wang FedML 28 5 0 10 Dec 2023
Towards Fast and Stable Federated Learning: Confronting Heterogeneity via Knowledge Anchor Jinqian Chen Jihua Zhu Qinghai Zheng 38 3 0 05 Dec 2023
FedAL: Black-Box Federated Knowledge Distillation Enabled by Adversarial Learning Pengchao Han Xingyan Shi Jianwei Huang FedML 28 3 0 28 Nov 2023
Eliminating Domain Bias for Federated Learning in Representation Space Jianqing Zhang Yang Hua Jian Cao Hao Wang Tao Song Zhengui Xue Ruhui Ma Haibing Guan FedML 71 33 0 25 Nov 2023
Task-Distributionally Robust Data-Free Meta-Learning Zixuan Hu Li Shen Zhenyi Wang Yongxian Wei Baoyuan Wu Chun Yuan Dacheng Tao OOD 20 0 0 23 Nov 2023
Concept Matching: Clustering-based Federated Continual Learning Xiaopeng Jiang Marcello Restelli FedML 24 0 0 12 Nov 2023
Federated Learning with Manifold Regularization and Normalized Update Reaggregation Xuming An Li Shen Han Hu Yong Luo FedML 36 4 0 10 Nov 2023
PRIOR: Personalized Prior for Reactivating the Information Overlooked in Federated Learning Mingjia Shi Yuhao Zhou Kai Wang Huaizheng Zhang Shudong Huang Qing Ye Jiangcheng Lv 21 9 0 13 Oct 2023
Federated Class-Incremental Learning with Prompting Jiale Liu Yu-Wei Zhan Chong-Yu Zhang Xin Luo Zhen-Duo Chen Yinwei Wei CLL FedML 21 2 0 13 Oct 2023
FedFed: Feature Distillation against Data Heterogeneity in Federated Learning Zhiqin Yang Yonggang Zhang Yuxiang Zheng Xinmei Tian Hao Peng Tongliang Liu Bo Han FedML 30 61 0 08 Oct 2023
Heterogeneous Federated Learning Using Knowledge Codistillation Jared Lichtarge Ehsan Amid Shankar Kumar Tien-Ju Yang Rohan Anil Rajiv Mathews FedML 26 0 0 04 Oct 2023
Towards Stable Backdoor Purification through Feature Shift Tuning Rui Min Zeyu Qin Li Shen Minhao Cheng AAML 33 20 0 03 Oct 2023
Deep Model Fusion: A Survey Weishi Li Yong Peng Miao Zhang Liang Ding Han Hu Li Shen FedML MoMe 28 51 0 27 Sep 2023
DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning Kangyang Luo Shuai Wang Y. Fu Xiang Li Yunshi Lan Minghui Gao FedML 16 23 0 24 Sep 2023
FedCiR: Client-Invariant Representation Learning for Federated Non-IID Features Zijian Li Zehong Lin Jiawei Shao Yuyi Mao Jun Zhang OOD 27 10 0 30 Aug 2023
Efficient Model Personalization in Federated Learning via Client-Specific Prompt Generation Fu-En Yang Chien-Yi Wang Yu-Chiang Frank Wang VLM FedML 17 58 0 29 Aug 2023
FedSOL: Stabilized Orthogonal Learning with Proximal Restrictions in Federated Learning Gihun Lee Minchan Jeong Sangmook Kim Jaehoon Oh Se-Young Yun FedML 24 8 0 24 Aug 2023
Feature Matching Data Synthesis for Non-IID Federated Learning Zijian Li Yuchang Sun Jiawei Shao Yuyi Mao Jessie Hui Wang Jun Zhang 26 19 0 09 Aug 2023
Teacher-Student Architecture for Knowledge Distillation: A Survey Chengming Hu Xuan Li Danyang Liu Haolun Wu Xi Chen Ju Wang Xue Liu 16 16 0 08 Aug 2023
Cross-Silo Prototypical Calibration for Federated Learning with Non-IID Data Zhuang Qi Lei Meng Zitan Chen Han Hu Hui Lin Xiangxu Meng FedML 13 18 0 07 Aug 2023
EdgeConvEns: Convolutional Ensemble Learning for Edge Intelligence Ilkay Sikdokur Inci M. Baytas A. Yurdakul FedML 12 0 0 25 Jul 2023
Mitigating Cross-client GANs-based Attack in Federated Learning Hong Huang Xinyu Lei Tao Xiang AAML 45 1 0 25 Jul 2023
A Survey of What to Share in Federated Learning: Perspectives on Model Utility, Privacy Leakage, and Communication Efficiency Jiawei Shao Zijian Li Wenqiang Sun Tailin Zhou Yuchang Sun Lumin Liu Zehong Lin Yuyi Mao Jun Zhang FedML 26 22 0 20 Jul 2023
Heterogeneous Federated Learning: State-of-the-art and Research Challenges Mang Ye Xiuwen Fang Bo Du PongChi Yuen Dacheng Tao FedML AAML 29 244 0 20 Jul 2023
Towards Open Federated Learning Platforms: Survey and Vision from Technical and Legal Perspectives Moming Duan Qinbin Li Linshan Jiang Bingsheng He FedML 26 4 0 05 Jul 2023
An Efficient Virtual Data Generation Method for Reducing Communication in Federated Learning Cheng Yang Xue Yang Dongxian Wu Xiaohu Tang FedML 19 0 0 21 Jun 2023
Confidence-based federated distillation for vision-based lane-centering Yitao Chen Dawei Chen Haoxin Wang Kyungtae Han Mingbi Zhao FedML 13 3 0 05 Jun 2023
Revisiting Data-Free Knowledge Distillation with Poisoned Teachers Junyuan Hong Yi Zeng Shuyang Yu Lingjuan Lyu R. Jia Jiayu Zhou AAML 11 8 0 04 Jun 2023
GPT-FL: Generative Pre-trained Model-Assisted Federated Learning Tuo Zhang Tiantian Feng Samiul Alam Dimitrios Dimitriadis Sunwoo Lee Mi Zhang Shrikanth S. Narayanan Salman Avestimehr FedML 13 27 0 03 Jun 2023
Federated Domain Generalization: A Survey Ying Li Xingwei Wang Rongfei Zeng Praveen Kumar Donta Ilir Murturi Min Huang Schahram Dustdar OOD FedML AI4CE 34 29 0 02 Jun 2023
FedDisco: Federated Learning with Discrepancy-Aware Collaboration Rui Ye Mingkai Xu Jianyu Wang Chenxin Xu Siheng Chen Yanfeng Wang FedML 35 61 0 30 May 2023
Learning to Learn from APIs: Black-Box Data-Free Meta-Learning Zixuan Hu Li Shen Zhenyi Wang Baoyuan Wu Chun Yuan Dacheng Tao 47 7 0 28 May 2023
Dynamic Regularized Sharpness Aware Minimization in Federated Learning: Approaching Global Consistency and Smooth Landscape Yan Sun Li Shen Shi-Yong Chen Liang Ding Dacheng Tao FedML 27 33 0 19 May 2023
MrTF: Model Refinery for Transductive Federated Learning Xin-Chun Li Yang Yang De-Chuan Zhan 22 3 0 07 May 2023
Efficient Federated Learning with Enhanced Privacy via Lottery Ticket Pruning in Edge Computing Yi Shi Kang Wei Li Shen Jun Li Xueqian Wang Bo Yuan Song Guo 33 5 0 02 May 2023
Towards the Flatter Landscape and Better Generalization in Federated Learning under Client-level Differential Privacy Yi Shi Kang Wei Li Shen Yingqi Liu Xueqian Wang Bo Yuan Dacheng Tao FedML 28 2 0 01 May 2023
Fair Federated Medical Image Segmentation via Client Contribution Estimation Meirui Jiang H. Roth Wenqi Li Dong Yang Can Zhao V. Nath Daguang Xu Qianming Dou Ziyue Xu FedML 15 47 0 29 Mar 2023
Make Landscape Flatter in Differentially Private Federated Learning Yi Shi Yingqi Liu Kang Wei Li Shen Xueqian Wang Dacheng Tao FedML 17 54 0 20 Mar 2023
Architecture, Dataset and Model-Scale Agnostic Data-free Meta-Learning Zixuan Hu Li Shen Zhenyi Wang Tongliang Liu Chun Yuan Dacheng Tao 47 4 0 20 Mar 2023
Data-Free Sketch-Based Image Retrieval Abhra Chaudhuri A. Bhunia Yi-Zhe Song Anjan Dutta 40 7 0 14 Mar 2023
Stabilizing and Improving Federated Learning with Non-IID Data and Client Dropout Jian Xu Mei Yang Wenbo Ding Shao-Lun Huang FedML 12 3 0 11 Mar 2023
Reducing Non-IID Effects in Federated Autonomous Driving with Contrastive Divergence Loss Tuong Khanh Long Do Binh X. Nguyen Hien Nguyen Erman Tjiputra Quang-Dieu Tran Te-Chuan Chiu A. Nguyen 25 0 0 11 Mar 2023
FedACK: Federated Adversarial Contrastive Knowledge Distillation for Cross-Lingual and Cross-Model Social Bot Detection Yingguang Yang Renyu Yang Hao Peng Yangyang Li Tong Li Yong Liao Pengyuan Zhou FedML 29 28 0 10 Mar 2023