Federated Learning with Matched Averaging

International Conference on Learning Representations (ICLR), 2020

15 February 2020

Hongyi Wang

Mikhail Yurochkin

Yuekai Sun

Dimitris Papailiopoulos

Y. Khazaeni

FedML

ArXiv (abs)PDF HTML HuggingFace (2 upvotes)

Papers citing "Federated Learning with Matched Averaging"

50 / 546 papers shown

Title
Continual Learning for End-to-End ASR by Averaging Domain Experts Peter William VanHarn Plantinga Jaekwon Yoo C. Dhir CLL MoMe 118 1 0 12 May 2023
Divide-and-Conquer the NAS puzzle in Resource Constrained Federated Learning SystemsNeural Networks (Neural Netw.), 2023 Yeshwanth Venkatesha Youngeun Kim Hyoungseob Park Priyadarshini Panda FedML 82 6 0 11 May 2023
Blockchained Federated Learning for Internet of Things: A Comprehensive SurveyACM Computing Surveys (ACM Comput. Surv.), 2023 Yanna Jiang Baihe Ma Xu Wang Ping Yu Guangsheng Yu Zhe Wang Weiquan Ni R. Liu AI4CE 128 38 0 08 May 2023
ZipIt! Merging Models from Different Tasks without TrainingInternational Conference on Learning Representations (ICLR), 2023 George Stoica Daniel Bolya J. Bjorner Pratik Ramesh Taylor N. Hearn Judy Hoffman VLM MoMe 322 152 0 04 May 2023
Cuttlefish: Low-Rank Model Training without All the TuningConference on Machine Learning and Systems (MLSys), 2023 Hongyi Wang Saurabh Agarwal Pongsakorn U-chupala Yoshiki Tanaka Eric P. Xing Dimitris Papailiopoulos OffRL 234 26 0 04 May 2023
FedAVO: Improving Communication Efficiency in Federated Learning with African Vultures OptimizerAnnual International Computer Software and Applications Conference (COMPSAC), 2023 Md Zarif Hossain Ahmed Imteaj FedML 231 7 0 02 May 2023
Personalized Federated Learning under Mixture of DistributionsInternational Conference on Machine Learning (ICML), 2023 Yue Wu Shuaicheng Zhang Wenchao Yu Yanchi Liu Quanquan Gu Dawei Zhou Haifeng Chen Wei Cheng FedML 169 59 0 01 May 2023
FCA: Taming Long-tailed Federated Medical Image Classification by Classifier Anchoring Jeffry Wicaksana Zengqiang Yan Kwang-Ting Cheng FedML 184 5 0 01 May 2023
Multi-Task Structural Learning using Local Task Similarity induced Neuron Creation and RemovalInternational Conference on Machine Learning (ICML), 2023 Naresh Gurulingan Bahram Zonooz Elahe Arani 123 2 0 30 Apr 2023
Bayesian Federated Learning: A Survey LongBing Cao Hui Chen Xuhui Fan João Gama Yew-Soon Ong Vipin Kumar FedML 199 31 0 26 Apr 2023
Expand-and-Cluster: Parameter Recovery of Neural NetworksInternational Conference on Machine Learning (ICML), 2023 Flavio Martinelli Berfin Simsek W. Gerstner Johanni Brea 336 10 0 25 Apr 2023
FedTrip: A Resource-Efficient Federated Learning Method with Triplet RegularizationIEEE International Parallel and Distributed Processing Symposium (IPDPS), 2023 Xujing Li Min Liu Sheng Sun Yuwei Wang Hui Jiang Xue Jiang 127 6 0 12 Apr 2023
Federated Learning with Classifier Shift for Class Imbalance Yunheng Shen Haoxiang Wang Hairong Lv FedML 158 5 0 11 Apr 2023
Federated Incremental Semantic SegmentationComputer Vision and Pattern Recognition (CVPR), 2023 Jiahua Dong Duzhen Zhang Yang Cong Wei Cong Henghui Ding Dengxin Dai FedML 145 55 0 10 Apr 2023
PopulAtion Parameter Averaging (PAPA) Alexia Jolicoeur-Martineau Emy Gervais Kilian Fatras Yan Zhang Damien Scieur MoMe 366 24 0 06 Apr 2023
Neural Collapse Inspired Federated Learning with Non-iid Data Chenxi Huang Liang Xie Jianlong Wu Wenxiao Wang Binbin Lin Xiaofei He FedML 199 5 0 27 Mar 2023
A Generalized Look at Federated Learning: Survey and Perspectives Taki Hasan Rafi Faiza Anan Noor Tahmid Hussain Dong-Kyu Chae Zhaohui Yang OOD FedML 112 1 0 26 Mar 2023
Identification of Negative Transfers in Multitask Learning Using Surrogate Models Dongyue Li Huy Le Nguyen Hongyang R. Zhang 167 15 0 25 Mar 2023
Re-thinking Federated Active Learning based on Inter-class DiversityComputer Vision and Pattern Recognition (CVPR), 2023 Sangmook Kim Sangmin Bae Hwanjun Song Se-Young Yun FedML 181 21 0 22 Mar 2023
Making Batch Normalization Great in Federated Deep Learning Shitian Zhao Hong-You Chen Wei-Lun Chao FedML 282 12 0 12 Mar 2023
Communication Trade-offs in Federated Learning of Spiking Neural Networks Soumi Chaki David Weinberg Ayça Özçelikkale FedML 161 2 0 27 Feb 2023
FedPDC:Federated Learning for Public Dataset Correction Yu-quan Zhang Yongquan Zhang FedML 73 0 0 24 Feb 2023
Personalized Decentralized Federated Learning with Knowledge Distillation Eunjeong Jeong Marios Kountouris FedML 134 25 0 23 Feb 2023
FedIL: Federated Incremental Learning from Decentralized Unlabeled Data with Convergence Analysis Nan Yang Dong Yuan Charles Z. Liu Yong Deng Wei Bao FedML 140 5 0 23 Feb 2023
FedABC: Targeting Fair Competition in Personalized Federated LearningAAAI Conference on Artificial Intelligence (AAAI), 2023 Dui Wang Li Shen Yong Luo Han Hu Kehua Su Yonggang Wen Dacheng Tao FedML 120 11 0 15 Feb 2023
Revisiting Weighted Aggregation in Federated Learning with Neural NetworksInternational Conference on Machine Learning (ICML), 2023 Zexi Li Tao Lin Xinyi Shang Chao-Xiang Wu FedML 219 92 0 14 Feb 2023
Principled Federated Domain Adaptation: Gradient Projection and Auto-WeightingInternational Conference on Learning Representations (ICLR), 2023 Enyi Jiang Yibo Jacky Zhang Oluwasanmi Koyejo FedML 174 10 0 10 Feb 2023
Federated Minimax Optimization with Client Heterogeneity Pranay Sharma Rohan Panda Gauri Joshi FedML 201 10 0 08 Feb 2023
Federated Learning as Variational Inference: A Scalable Expectation Propagation ApproachInternational Conference on Learning Representations (ICLR), 2023 Han Guo P. Greengard Hongyi Wang Andrew Gelman Yoon Kim Eric P. Xing FedML 132 23 0 08 Feb 2023
Topology-aware Federated Learning in Edge Computing: A Comprehensive SurveyACM Computing Surveys (ACM Comput. Surv.), 2023 Jiajun Wu Steve Drew Fan Dong Zhuangdi Zhu Jiayu Zhou FedML 208 81 0 06 Feb 2023
No One Left Behind: Real-World Federated Class-Incremental LearningIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023 Jiahua Dong Hongliu Li Yang Cong Gan Sun Yulun Zhang Dengxin Dai FedML CLL 233 67 0 02 Feb 2023
Equivariant Architectures for Learning in Deep Weight SpacesInternational Conference on Machine Learning (ICML), 2023 Aviv Navon Aviv Shamsian Idan Achituve Ethan Fetaya Gal Chechik Haggai Maron 226 83 0 30 Jan 2023
FedRC: Tackling Diverse Distribution Shifts Challenge in Federated Learning by Robust ClusteringInternational Conference on Machine Learning (ICML), 2023 Yongxin Guo Xiaoying Tang Tao Lin OOD FedML 212 17 0 29 Jan 2023
SuperFedNAS: Cost-Efficient Federated Neural Architecture Search for On-Device InferenceEuropean Conference on Computer Vision (ECCV), 2023 Alind Khare A. Agrawal Aditya Annavajjala Rohit Das Myungjin Lee Hugo Latapie Alexey Tumanov FedML 130 2 0 26 Jan 2023
When to Trust Aggregated Gradients: Addressing Negative Client Sampling in Federated Learning Wenkai Yang Yankai Lin Guangxiang Zhao Peng Li Jie Zhou Xu Sun FedML 63 2 0 25 Jan 2023
Accelerating Fair Federated Learning: Adaptive Federated AdamIEEE Transactions on Machine Learning in Communications and Networking (IEEE TMLCN), 2023 Li Ju Tianru Zhang Salman Toor Andreas Hellander FedML 62 26 0 23 Jan 2023
The Best of Both Worlds: Accurate Global and Personalized Models through Federated Learning with Data-Free Hyper-Knowledge DistillationInternational Conference on Learning Representations (ICLR), 2023 Huancheng Chen Johnny J. Wang H. Vikalo FedML 153 51 0 21 Jan 2023
AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge DevicesIEEE Conference on Computer Communications (IEEE INFOCOM), 2023 Peichun Li Guoliang Cheng Xumin Huang Jiawen Kang Rong Yu Yuan Wu Miao Pan FedML 184 26 0 08 Jan 2023
Federated Learning for Data StreamsInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023 Othmane Marfoq Giovanni Neglia Laetitia Kameni Richard Vidal FedML 152 18 0 04 Jan 2023
Recent Advances on Federated Learning: A Systematic SurveyNeurocomputing (Neurocomputing), 2023 Bingyan Liu Nuoyan Lv Yuanchun Guo Yawen Li FedML 196 135 0 03 Jan 2023
Navigating Alignment for Non-identical Client Class Sets: A Label Name-Anchored Federated Learning FrameworkKnowledge Discovery and Data Mining (KDD), 2023 Jiayun Zhang Xiyuan Zhang Xinyang Zhang Dezhi Hong Rajesh K. Gupta Jingbo Shang FedML 162 8 0 01 Jan 2023
Re-basin via implicit Sinkhorn differentiationComputer Vision and Pattern Recognition (CVPR), 2022 F. Guerrero-Peña H. R. Medeiros Thomas Dubail Masih Aminbeidokhti Mohammadhadi Shateri M. Pedersoli MoMe 178 56 0 22 Dec 2022
Dataless Knowledge Fusion by Merging Weights of Language ModelsInternational Conference on Learning Representations (ICLR), 2022 Xisen Jin Xiang Ren Daniel Preoţiuc-Pietro Pengxiang Cheng FedML MoMe 229 307 0 19 Dec 2022
FedTADBench: Federated Time-Series Anomaly Detection Benchmark Fanxing Liu Cheng Zeng Le Zhang Yingjie Zhou Qing Mu Yanru Zhang Ling Zhang Ce Zhu OOD FedML AI4TS 169 13 0 19 Dec 2022
SplitGP: Achieving Both Generalization and Personalization in Federated LearningIEEE Conference on Computer Communications (INFOCOM), 2022 Dong-Jun Han Do-Yeon Kim Minseok Choi Christopher G. Brinton Jaekyun Moon FedML 129 43 0 16 Dec 2022
FedSkip: Combatting Statistical Heterogeneity with Federated Skip AggregationIndustrial Conference on Data Mining (IDM), 2022 Ziqing Fan Yanfeng Wang Jiangchao Yao Lingjuan Lyu Ya Zhang Qinghua Tian FedML 108 25 0 14 Dec 2022
GTFLAT: Game Theory Based Add-On For Empowering Federated Learning Aggregation Techniques Hamidreza Mahini H. Mousavi Masoud Daneshtalab FedML 103 0 0 08 Dec 2022
Federated Learning for Inference at Anytime and Anywhere Zicheng Liu Da Li Javier Fernandez-Marques Stefanos Laskaridis Yan Gao Łukasz Dudziak Stan Z. Li S. Hu Timothy M. Hospedales FedML 129 6 0 08 Dec 2022
FedALA: Adaptive Local Aggregation for Personalized Federated LearningAAAI Conference on Artificial Intelligence (AAAI), 2022 Jianqing Zhang Yang Hua Hao Wang Tao Song Zhengui Xue Ruhui Ma Haibing Guan FedML 243 331 0 02 Dec 2022
Generative Data Augmentation for Non-IID Problem in Decentralized Clinical Machine LearningInternational Conference on Data Intelligence and Security (ICDIS), 2022 Zirui Wang Shaoming Duan Chengyue Wu Wenhao Lin Xin-Xiang Zha Peiyi Han Chuanyi Liu MedIm 140 6 0 02 Dec 2022