Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning

17 March 2022

Lin Zhang

Li Shen

Liang Ding

Papers citing "Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning"

50 / 130 papers shown

Title
Corrected with the Latest Version: Make Robust Asynchronous Federated Learning Possible Chaoyi Lu Yiding Sun Pengbo Li Zhichuan Yang FedML 34 0 0 05 Apr 2025
Adversarial Curriculum Graph-Free Knowledge Distillation for Graph Neural Networks Yuang Jia Xiaojuan Shan Jun-Xiong Xia Guancheng Wan Y. Zhang Wenke Huang Mang Ye Stan Z. Li 45 0 0 01 Apr 2025
Enabling Weak Client Participation via On-device Knowledge Distillation in Heterogenous Federated Learning Jihyun Lim Junhyuk Jo Tuo Zhang Salman Avestimehr Sunwoo Lee FedML 51 0 0 14 Mar 2025
You Are Your Own Best Teacher: Achieving Centralized-level Performance in Federated Learning under Heterogeneous and Long-tailed Data Shanshan Yan Zexi Li Chao-Xiang Wu Meng Pang Yang Lu Yan Yan Hanzi Wang FedML 61 0 0 10 Mar 2025
Federated Learning for Diffusion Models Zihao Peng Xijun Wang Shengbo Chen Hong Rao Cong Shen DiffM FedML 53 0 0 09 Mar 2025
Data-Free Black-Box Federated Learning via Zeroth-Order Gradient Estimation Xinge Ma Jin Wang Xuejie Zhang FedML 70 0 0 08 Mar 2025
Probabilistic Federated Prompt-Tuning with Non-IID and Imbalanced Data Pei-Yau Weng Minh Hoang Lam M. Nguyen My T. Thai Tsui-Wei Weng T. Hoang FedML 71 2 0 27 Feb 2025
FedBM: Stealing Knowledge from Pre-trained Language Models for Heterogeneous Federated Learning Meilu Zhu Qiushi Yang Zhifan Gao Yixuan Yuan Jun Liu FedML 49 0 0 24 Feb 2025
FedMHO: Heterogeneous One-Shot Federated Learning Towards Resource-Constrained Edge Devices Dezhong Yao Yuexin Shi Tongtong Liu Zhiqiang Xu 59 1 0 12 Feb 2025
Federated Class-Incremental Learning: A Hybrid Approach Using Latent Exemplars and Data-Free Techniques to Address Local and Global Forgetting M. Nori Il Kim Guanghui CLL 60 1 0 26 Jan 2025
FedSA: A Unified Representation Learning via Semantic Anchors for Prototype-based Federated Learning Yanbing Zhou Xiangmou Qu Chenlong You Jiyang Zhou Jingyue Tang Xin Zheng Chunmao Cai Yingbo Wu FedML 50 1 0 09 Jan 2025
Non-IID data in Federated Learning: A Survey with Taxonomy, Metrics, Methods, Frameworks and Future Directions Daniel Gutiérrez David Solans Mikko A. Heikkilä A. Vitaletti Nicolas Kourtellis Aris Anagnostopoulos I. Chatzigiannakis OOD 84 3 0 19 Nov 2024
Federated Black-Box Adaptation for Semantic Segmentation Jay N. Paranjape S. Sikder S. Vedula Vishal M. Patel FedML 27 0 0 31 Oct 2024
Local Superior Soups: A Catalyst for Model Merging in Cross-Silo Federated Learning Minghui Chen Meirui Jiang Xin Zhang Qi Dou Zehua Wang Xiaoxiao Li MoMe FedML 40 2 0 31 Oct 2024
A Unified Solution to Diverse Heterogeneities in One-shot Federated Learning Jun Bai Yiliao Song Di Wu Atul Sajjanhar Yong Xiang Wei Zhou Xiaohui Tao Yan Li Y. Li FedML 53 0 0 28 Oct 2024
HYDRA-FL: Hybrid Knowledge Distillation for Robust and Accurate Federated Learning M. A. Khan Yasra Chandio Fatima M. Anwar AAML 16 0 0 30 Sep 2024
Federated Learning with Label-Masking Distillation Jianghu Lu Shikun Li Kexin Bao Pengju Wang Zhenxing Qian Shiming Ge FedML 37 10 0 20 Sep 2024
Few-Shot Class-Incremental Learning with Non-IID Decentralized Data Cuiwei Liu Siang Xu Huaijun Qiu Jing Zhang Zhi Liu Liang Zhao CLL 32 0 0 18 Sep 2024
DFDG: Data-Free Dual-Generator Adversarial Distillation for One-Shot Federated Learning Kangyang Luo Shuai Wang Y. Fu Renrong Shao Xiang Li Yunshi Lan Ming Gao Jinlong Shu FedML 23 2 0 12 Sep 2024
Privacy-Preserving Federated Learning with Consistency via Knowledge Distillation Using Conditional Generator Kangyang Luo Shuai Wang Xiang Li Yunshi Lan Ming Gao Jinlong Shu FedML 25 1 0 11 Sep 2024
FedBrain-Distill: Communication-Efficient Federated Brain Tumor Classification Using Ensemble Knowledge Distillation on Non-IID Data Rasoul Jafari Gohari Laya Aliahmadipour Ezat Valipour FedML 26 0 0 09 Sep 2024
DynamicFL: Federated Learning with Dynamic Communication Resource Allocation Qi Le Enmao Diao Xinran Wang Vahid Tarokh Jie Ding Ali Anwar FedML 24 1 0 08 Sep 2024
Addressing Skewed Heterogeneity via Federated Prototype Rectification with Personalization Shunxin Guo Hongsong Wang Shuxia Lin Zhiqiang Kou Xin Geng FedML 33 1 0 15 Aug 2024
FIARSE: Model-Heterogeneous Federated Learning via Importance-Aware Submodel Extraction Feijie Wu Xingchen Wang Yaqing Wang Tianci Liu Lu Su Jing Gao FedML 43 3 0 28 Jul 2024
Dataset Size Recovery from LoRA Weights Mohammad Salama Jonathan Kahana Eliahu Horwitz Yedid Hoshen 28 5 0 27 Jun 2024
Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutions Laiqiao Qin Tianqing Zhu Wanlei Zhou Philip S. Yu 38 5 0 16 Jun 2024
Exploring the Practicality of Federated Learning: A Survey Towards the Communication Perspective Khiem H. Le Nhan Luong-Ha Manh Nguyen-Duc Danh Le-Phuoc Cuong D. Do Kok-Seng Wong FedML 29 1 0 30 May 2024
Cross-Training with Multi-View Knowledge Fusion for Heterogenous Federated Learning Zhuang Qi Lei Meng Weihao He Ruohan Zhang Yu Wang Xin Qi Xiangxu Meng FedML 33 4 0 30 May 2024
Analytic Federated Learning Huiping Zhuang Run He Kai Tong Di Fang Han Sun Haoran Li Tianyi Chen Ziqian Zeng FedML 36 3 0 25 May 2024
Federated Online Adaptation for Deep Stereo Matteo Poggi Fabio Tosi FedML 31 9 0 23 May 2024
Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors Chun-Yin Huang Kartik Srinivas Xin Zhang Xiaoxiao Li DD 48 6 0 19 May 2024
Advances in Robust Federated Learning: A Survey with Heterogeneity Considerations Chuan Chen Tianchi Liao Xiaojun Deng Zihou Wu Sheng Huang Zibin Zheng FedML 36 1 0 16 May 2024
FeDeRA:Efficient Fine-tuning of Language Models in Federated Learning Leveraging Weight Decomposition Yuxuan Yan Qianqian Yang Shunpu Tang Zhiguo Shi 27 13 0 29 Apr 2024
An Aggregation-Free Federated Learning for Tackling Data Heterogeneity Yuan Wang Huazhu Fu Renuga Kanagavelu Qingsong Wei Yong Liu Rick Siow Mong Goh FedML 18 29 0 29 Apr 2024
Sentence-Level or Token-Level? A Comprehensive Study on Knowledge Distillation Jingxuan Wei Linzhuang Sun Yichong Leng Xu Tan Bihui Yu Ruifeng Guo 41 3 0 23 Apr 2024
FedTAD: Topology-aware Data-free Knowledge Distillation for Subgraph Federated Learning Yinlin Zhu Xunkai Li Zhengyu Wu Di Wu Miao Hu Ronghua Li FedML 24 5 0 22 Apr 2024
FedMeS: Personalized Federated Continual Learning Leveraging Local Memory Jingru Xie Chenqi Zhu Songze Li FedML CLL 32 0 0 19 Apr 2024
Weight Copy and Low-Rank Adaptation for Few-Shot Distillation of Vision Transformers Diana-Nicoleta Grigore Mariana-Iuliana Georgescu J. A. Justo T. Johansen Andreea-Iuliana Ionescu Radu Tudor Ionescu 26 0 0 14 Apr 2024
FedDistill: Global Model Distillation for Local Model De-Biasing in Non-IID Federated Learning Changlin Song Divya Saxena Jiannong Cao Yuqing Zhao FedML 34 3 0 14 Apr 2024
Federated Distillation: A Survey Lin Li Jianping Gou Baosheng Yu Lan Du Zhang Yiand Dacheng Tao DD FedML 51 4 0 02 Apr 2024
An Upload-Efficient Scheme for Transferring Knowledge From a Server-Side Pre-trained Generator to Clients in Heterogeneous Federated Learning Jianqing Zhang Yang Janet Liu Yang Hua Jian Cao 70 11 0 23 Mar 2024
Towards Efficient Replay in Federated Incremental Learning Yichen Li Qunwei Li Haozhao Wang Ruixuan Li Leon Wenliang Zhong Guannan Zhang 37 13 0 09 Mar 2024
FedUV: Uniformity and Variance for Heterogeneous Federated Learning Ha Min Son M. Kim Tai-Myung Chung Chao Huang Xin Liu FedML 41 3 0 27 Feb 2024
CoDream: Exchanging dreams instead of models for federated aggregation with heterogeneous models Abhishek Singh Gauri Gupta Ritvik Kapila Yichuan Shi Alex Dang Sheshank Shankar Mohammed Ehab Ramesh Raskar FedML 38 0 0 25 Feb 2024
Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boosting Rong Dai Yonggang Zhang Ang Li Tongliang Liu Xun Yang Bo Han FedML 74 12 0 23 Feb 2024
DFML: Decentralized Federated Mutual Learning Yasser H. Khalil A. Estiri Mahdi Beitollahi Nader Asadi S. Hemati Xu Li Guojun Zhang Xi Chen 11 1 0 02 Feb 2024
EchoPFL: Asynchronous Personalized Federated Learning on Mobile Devices with On-Demand Staleness Control Xiaocheng Li Si-ren Liu Zimu Zhou Bin Guo Yuan Xu Zhiwen Yu 29 0 0 29 Jan 2024
Security and Privacy Issues and Solutions in Federated Learning for Digital Healthcare Hyejun Jeong Tai-Myung Chung FedML 13 1 0 16 Jan 2024
FedRFQ: Prototype-Based Federated Learning with Reduced Redundancy, Minimal Failure, and Enhanced Quality Biwei Yan Hongliang Zhang Minghui Xu Dongxiao Yu Xiuzhen Cheng 34 5 0 15 Jan 2024
FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heterogeneity in Federated Learning Jianqing Zhang Yang Janet Liu Yang Hua Jian Cao FedML 57 37 0 06 Jan 2024