FedKD: Communication Efficient Federated Learning via Knowledge Distillation

30 August 2021

Xing Xie

Papers citing "FedKD: Communication Efficient Federated Learning via Knowledge Distillation"

50 / 137 papers shown

Title
Privacy Preserving Machine Learning Model Personalization through Federated Personalized Learning Md. Tanzib Hosain Asif Zaman Md. Shahriar Sajid Shadman Sakeeb Khan Shanjida Akter 45 0 0 03 May 2025
Clustering-Based Evolutionary Federated Multiobjective Optimization and Learning Chengui Xiao Songbai Liu FedML 72 0 0 29 Apr 2025
Soft-Label Caching and Sharpening for Communication-Efficient Federated Distillation Kitsuya Azuma Takayuki Nishio Yuichi Kitagawa Wakako Nakano Takahito Tanimura FedML 70 0 0 28 Apr 2025
Privacy-Preserving Federated Embedding Learning for Localized Retrieval-Augmented Generation Qianren Mao Qili Zhang Hanwen Hao Zhentao Han Runhua Xu ... Bo Li Y. Song Jin Dong Jianxin Li Philip S. Yu 71 1 0 27 Apr 2025
FedX: Adaptive Model Decomposition and Quantization for IoT Federated Learning Phung Lai Xiaopeng Jiang Hai Phan Cristian Borcea K. Tran An M. Chen Vijaya Datta Mayyuri Ruoming Jin FedML MQ 61 0 0 17 Apr 2025
Federated Prototype Graph Learning Zhengyu Wu Xunkai Li Y. X. Zhu R. Li Guoren Wang Chenghu Zhou FedML 43 0 0 13 Apr 2025
Federated Learning for Medical Image Classification: A Comprehensive Benchmark Zhekai Zhou Guibo Luo Mingzhi Chen Zhenyu Weng Yuesheng Zhu FedML 26 0 0 07 Apr 2025
Unlocking the Value of Decentralized Data: A Federated Dual Learning Approach for Model Aggregation Junyi Zhu Ruicong Yao Taha Ceritli Savas Ozkan Matthew B. Blaschko Eunchung Noh Jeongwon Min Cho Jung Min Mete Ozay FedML 103 0 0 26 Mar 2025
FedSKD: Aggregation-free Model-heterogeneous Federated Learning using Multi-dimensional Similarity Knowledge Distillation Ziqiao Weng Weidong (Tom) Cai Bo Zhou 51 0 0 23 Mar 2025
Fed-NDIF: A Noise-Embedded Federated Diffusion Model For Low-Count Whole-Body PET Denoising Yinchi Zhou Huidong Xie Menghua Xia Qiong Liu Bo Zhou ... Biao Li Axel Rominger Kuangyu Shi Nicha C. Dvorneka Chi Liu FedML MedIm 48 0 0 20 Mar 2025
Enhancing Visual Representation with Textual Semantics: Textual Semantics-Powered Prototypes for Heterogeneous Federated Learning Xinghao Wu Jianwei Niu Xuefeng Liu Guogang Zhu Jiayuan Zhang Shaojie Tang 53 0 0 16 Mar 2025
Layer-wise Update Aggregation with Recycling for Communication-Efficient Federated Learning Jisoo Kim Sungmin Kang Sunwoo Lee FedML 47 0 0 14 Mar 2025
A Multi-Modal Federated Learning Framework for Remote Sensing Image Classification Barış Büyüktaş Gencer Sumbul Begum Demir 47 1 0 13 Mar 2025
FedPalm: A General Federated Learning Framework for Closed- and Open-Set Palmprint Verification Ziyuan Yang Yingyu Chen Chengrui Gao Andrew Beng Jin Teoh Bob Zhang Yi Zhang FedML 48 0 0 05 Mar 2025
Patient-Level Anatomy Meets Scanning-Level Physics: Personalized Federated Low-Dose CT Denoising Empowered by Large Language Model Ziyuan Yang Yingyu Chen Z. Wang Hongming Shan Yang Chen Yi Zhang 39 1 0 02 Mar 2025
FedORGP: Guiding Heterogeneous Federated Learning with Orthogonality Regularization on Global Prototypes Fucheng Guo Zeyu Luan Qing Li Dan Zhao Yong-jia Jiang FedML 50 0 0 22 Feb 2025
FedMHO: Heterogeneous One-Shot Federated Learning Towards Resource-Constrained Edge Devices Dezhong Yao Yuexin Shi Tongtong Liu Zhiqiang Xu 64 1 0 12 Feb 2025
FedAGHN: Personalized Federated Learning with Attentive Graph HyperNetworks Jiarui Song Yunheng Shen Chengbin Hou Pengyu Wang Jinbao Wang Ke Tang Hairong Lv FedML 44 1 0 24 Jan 2025
FedSA: A Unified Representation Learning via Semantic Anchors for Prototype-based Federated Learning Yanbing Zhou Xiangmou Qu Chenlong You Jiyang Zhou Jingyue Tang Xin Zheng Chunmao Cai Yingbo Wu FedML 50 1 0 09 Jan 2025
Federated Fine-Tuning of LLMs: Framework Comparison and Research Directions Na Yan Yang Su Yansha Deng Robert Schober FedML 72 0 0 08 Jan 2025
Explainable Semantic Federated Learning Enabled Industrial Edge Network for Fire Surveillance Li Dong Yubo Peng Feibo Jiang Kezhi Wang Kun Yang 36 0 0 31 Dec 2024
Seamless Detection: Unifying Salient Object Detection and Camouflaged Object Detection Yi Liu Chengxin Li Xiaohui Dong Lei Li Dingwen Zhang Shoukun Xu J. Han 68 0 0 22 Dec 2024
ProFe: Communication-Efficient Decentralized Federated Learning via Distillation and Prototypes Pedro Miguel Sánchez Sánchez Enrique Tomás Martínez Beltrán Miguel Fernández Llamas Gérome Bovet Gregorio Martínez Pérez Alberto Huertas Celdrán FedML 77 0 0 15 Dec 2024
Modality Alignment Meets Federated Broadcasting Yuting Ma Shengeng Tang Xiaohua Xu Lechao Cheng 68 1 0 24 Nov 2024
FedMoE-DA: Federated Mixture of Experts via Domain Aware Fine-grained Aggregation Ziwei Zhan Wenkuan Zhao Yuanqing Li Weijie Liu Xiaoxi Zhang Chee Wei Tan Chuan Wu Deke Guo Xu Chen MoE 40 1 0 04 Nov 2024
FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients Han Liang Ziwei Zhan Weijie Liu Xiaoxi Zhang Chee Wei Tan Xu Chen FedML 28 0 0 04 Nov 2024
FedPAE: Peer-Adaptive Ensemble Learning for Asynchronous and Model-Heterogeneous Federated Learning Brianna Mueller W. Street Stephen Seung-Yeob Baek Qihang Lin Jingyi Yang Yankun Huang 31 0 0 17 Oct 2024
Cyber Attacks Prevention Towards Prosumer-based EV Charging Stations: An Edge-assisted Federated Prototype Knowledge Distillation Approach Luyao Zou Quang Hieu Vo Kitae Kim Huy Q. Le Chu Myaet Thwal Chaoning Zhang Choong Seon Hong 32 1 0 17 Oct 2024
Edge AI Collaborative Learning: Bayesian Approaches to Uncertainty Estimation Gleb I. Radchenko Victoria Andrea Fill 26 0 0 11 Oct 2024
Adaptive Guidance for Local Training in Heterogeneous Federated Learning Jianqing Zhang Yang Janet Liu Yang Hua Jian Cao Qiang Yang FedML 32 0 0 09 Oct 2024
Personalized Federated Learning for Generative AI-Assisted Semantic Communications Yubo Peng Feibo Jiang Li Dong Kezhi Wang Kun Yang 39 2 0 03 Oct 2024
FedNE: Surrogate-Assisted Federated Neighbor Embedding for Dimensionality Reduction Ziwei Li Xiaoqi Wang Hong-You Chen Han-Wei Shen Wei-Lun Chao FedML 32 0 0 17 Sep 2024
FedBrain-Distill: Communication-Efficient Federated Brain Tumor Classification Using Ensemble Knowledge Distillation on Non-IID Data Rasoul Jafari Gohari Laya Aliahmadipour Ezat Valipour FedML 31 0 0 09 Sep 2024
FedMCP: Parameter-Efficient Federated Learning with Model-Contrastive Personalization Qianyi Zhao Chen Qu Cen Chen Mingyuan Fan Yanhao Wang 24 1 0 28 Aug 2024
Parameter-Efficient Transfer Learning under Federated Learning for Automatic Speech Recognition Xuan Kan Yonghui Xiao Tien-Ju Yang Nanxin Chen Rajiv Mathews FedML 21 0 0 19 Aug 2024
MetaWearS: A Shortcut in Wearable Systems Lifecycle with Only a Few Shots Alireza Amirshahi Maedeh H.Toosi Siamak Mohammadi Stefano Albini Pasquale Davide Schiavone G. Ansaloni A. Aminifar David Atienza 26 0 0 04 Aug 2024
CELLM: An Efficient Communication in Large Language Models Training for Federated Learning Raja Vavekanand Kira Sam 45 0 0 30 Jul 2024
Peak-Controlled Logits Poisoning Attack in Federated Distillation Yuhan Tang Aoxu Zhang Zhiyuan Wu Bo Gao Tian Wen Yuwei Wang Sheng Sun FedML AAML 43 0 0 25 Jul 2024
Federated Knowledge Transfer Fine-tuning Large Server Model with Resource-Constrained IoT Clients Shaoyuan Chen Linlin You Rui Liu Shuo Yu A. Abdelmoniem 64 0 0 07 Jul 2024
Communication-Efficient Federated Knowledge Graph Embedding with Entity-Wise Top-K Sparsification Xiaoxiong Zhang Zhiwei Zeng Xin Zhou Dusit Niyato Zhiqi Shen FedML 31 1 0 19 Jun 2024
Knowledge Distillation in Federated Learning: a Survey on Long Lasting Challenges and New Solutions Laiqiao Qin Tianqing Zhu Wanlei Zhou Philip S. Yu 40 5 0 16 Jun 2024
FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning Jiaxing Qi Zhongzhi Luan Shaohan Huang Carol J. Fung Hailong Yang Depei Qian 32 12 0 12 Jun 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs Charlie Hou Akshat Shrivastava Hongyuan Zhan Rylan Conway Trang Le Adithya Sagar Giulia Fanti Daniel Lazar 28 8 0 05 Jun 2024
Federated Model Heterogeneous Matryoshka Representation Learning Liping Yi Han Yu Chao Ren Gang Wang Xiaoguang Liu Xiaoxiao Li FedML 43 8 0 01 Jun 2024
Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Models Shengchao Chen Guodong Long Jing Jiang Chengqi Zhang 48 4 0 24 May 2024
FedCache 2.0: Exploiting the Potential of Distilled Data in Knowledge Cache-driven Federated Learning Quyang Pan Sheng Sun Zhiyuan Wu Yuwei Wang Min Liu Bo Gao FedML 58 1 0 22 May 2024
Overcoming Data and Model Heterogeneities in Decentralized Federated Learning via Synthetic Anchors Chun-Yin Huang Kartik Srinivas Xin Zhang Xiaoxiao Li DD 50 6 0 19 May 2024
Open Challenges and Opportunities in Federated Foundation Models Towards Biomedical Healthcare Xingyu Li Lu Peng Yuping Wang Weihua Zhang AI4CE MedIm LM&MA 71 5 0 10 May 2024
Gradient-Congruity Guided Federated Sparse Training Chris Xing Tian Yibing Liu Haoliang Li Ray C.C. Cheung Shiqi Wang FedML 28 1 0 02 May 2024
Communication-Efficient Training Workload Balancing for Decentralized Multi-Agent Learning Seyed Mahmoud Sajjadi Mohammadabadi Lei Yang Feng Yan Junshan Zhang 26 5 0 01 May 2024