v1v2 (latest)

Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms

Neural Information Processing Systems (NeurIPS), 2019

4 June 2019

Papers citing "Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms"

43 / 43 papers shown

Title
Watermark Robustness and Radioactivity May Be at Odds in Federated Learning Leixu Huang Zedian Shao Teodora Baluta WaLM 137 0 0 19 Oct 2025
Lions and Muons: Optimization via Stochastic Frank-Wolfe Maria-Eleni Sfyraki Jun-Kun Wang 570 14 0 04 Jun 2025
FedBAT: Communication-Efficient Federated Learning via Learnable BinarizationInternational Conference on Machine Learning (ICML), 2024 Shiwei Li Wenchao Xu Haozhao Wang Xing Tang Tianzhe Xiao Shijie Xu Weihong Luo Yuhua Li Xiuqiang He Ruixuan Li FedML 165 10 0 06 Aug 2024
Efficient Sign-Based Optimization: Accelerating Convergence via Variance Reduction Wei Jiang Sifan Yang Wenhao Yang Lijun Zhang 233 9 0 01 Jun 2024
FedEGG: Federated Learning with Explicit Global Guidance Kun Zhai Yifeng Gao Jiabo He Difan Zou Guangnan Ye Yu-Gang Jiang Yu-Gang Jiang FedML 157 0 0 18 Apr 2024
Aggressive or Imperceptible, or Both: Network Pruning Assisted Hybrid Byzantines in Federated Learning Emre Ozfatura Kerem Ozfatura Alptekin Kupcu Deniz Gunduz AAML 154 0 0 09 Apr 2024
How to Privately Tune Hyperparameters in Federated Learning? Insights from a Benchmark Study Natalija Mitic Apostolos Pyrgelis Sinem Sav FedML 269 2 0 25 Feb 2024
TernaryVote: Differentially Private, Communication Efficient, and Byzantine Resilient Distributed Optimization on Heterogeneous Data Richeng Jin Yujie Gu Kai Yue Xiaofan He Zhaoyang Zhang Huaiyu Dai FedML 230 1 0 16 Feb 2024
SignSGD with Federated Defense: Harnessing Adversarial Attacks through Gradient Sign Decoding Chanho Park Namyoon Lee FedML AAML 160 4 0 02 Feb 2024
Attacking Byzantine Robust Aggregation in High Dimensions Sarthak Choudhary Aashish Kolluri Prateek Saxena AAML 162 3 0 22 Dec 2023
Convergence of Sign-based Random Reshuffling Algorithms for Nonconvex Optimization Zhen Qin Zhishuai Liu Pan Xu 239 3 0 24 Oct 2023
SignSVRG: fixing SignSGD via variance reduction Evgenii Chzhen S. Schechtman 180 5 0 22 May 2023
Magnitude Matters: Fixing SIGNSGD Through Magnitude-Aware Sparsification in the Presence of Data Heterogeneity Richeng Jin Xiaofan He C. Zhong Zhaoyang Zhang Tony Q.S. Quek H. Dai FedML 130 2 0 19 Feb 2023
Breaking the Communication-Privacy-Accuracy Tradeoff with $f$ -Differential PrivacyNeural Information Processing Systems (NeurIPS), 2023 Richeng Jin Z. Su C. Zhong Zhaoyang Zhang Tony Q.S. Quek H. Dai FedML 241 3 0 19 Feb 2023
$z$ -SignFedAvg: A Unified Stochastic Sign-based Compression for Federated LearningAAAI Conference on Artificial Intelligence (AAAI), 2023 Zhiwei Tang Yanmeng Wang Tsung-Hui Chang FedML 218 21 0 06 Feb 2023
Recent Advances on Federated Learning: A Systematic SurveyNeurocomputing (Neurocomputing), 2023 Bingyan Liu Nuoyan Lv Yuanchun Guo Yawen Li FedML 220 145 0 03 Jan 2023
Dim-Krum: Backdoor-Resistant Federated Learning for NLP with Dimension-wise Krum-Based AggregationConference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Zhiyuan Zhang Qi Su Xu Sun FedML 123 18 0 13 Oct 2022
FedGraph: an Aggregation Method from Graph Perspective Zhifang Deng Xiaohong Huang Dandan Li Xueguang Yuan FedML 117 0 0 06 Oct 2022
Distributed Non-Convex Optimization with One-Bit Compressors on Heterogeneous Data: Efficient and Resilient Algorithms Ming Xiang Lili Su FedML 146 5 0 03 Oct 2022
A Secure Federated Learning Framework for Residential Short Term Load ForecastingIEEE Transactions on Smart Grid (IEEE Trans. Smart Grid), 2022 Muhammad Akbar Husnoo A. Anwar N. Hosseinzadeh S. Islam A. N. Mahmood R. Doss 198 46 0 29 Sep 2022
Auto-FedRL: Federated Hyperparameter Optimization for Multi-institutional Medical Image SegmentationEuropean Conference on Computer Vision (ECCV), 2022 Pengfei Guo Dong Yang Ali Hatamizadeh An Xu Ziyue Xu ... F. Patella Elvira Stellato G. Carrafiello Vishal M. Patel H. Roth OOD FedML 199 37 0 12 Mar 2022
Maximizing Communication Efficiency for Large-scale Training via 0/1 AdamInternational Conference on Learning Representations (ICLR), 2022 Yucheng Lu Conglong Li Minjia Zhang Christopher De Sa Yuxiong He OffRL AI4CE 290 22 0 12 Feb 2022
Stability Based Generalization Bounds for Exponential Family Langevin DynamicsInternational Conference on Machine Learning (ICML), 2022 A. Banerjee Tiancong Chen Xinyan Li Yingxue Zhou 254 9 0 09 Jan 2022
SparseFed: Mitigating Model Poisoning Attacks in Federated Learning with Sparsification Ashwinee Panda Saeed Mahloujifar A. Bhagoji Supriyo Chakraborty Prateek Mittal FedML AAML 184 107 0 12 Dec 2021
Sharp Bounds for Federated Averaging (Local SGD) and Continuous Perspective Margalit Glasgow Honglin Yuan Tengyu Ma FedML 183 48 0 05 Nov 2021
Federated Learning via Plurality Vote Kai Yue Richeng Jin Chau-Wai Wong H. Dai FedML 185 10 0 06 Oct 2021
Byzantine-Robust Federated Learning via Credibility Assessment on Non-IID Data Kun Zhai Qiang Ren Junli Wang Chungang Yan 104 14 0 06 Sep 2021
Personalised Federated Learning: A Combinational Approach Sone Kyaw Pye Han Yu FedML 129 6 0 22 Aug 2021
DP-SIGNSGD: When Efficiency Meets Privacy and RobustnessIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2021 Lingjuan Lyu FedML AAML 107 23 0 11 May 2021
Auto-FedAvg: Learnable Federated Averaging for Multi-Institutional Medical Image Segmentation Yingda Xia Dong Yang Wenqi Li Andriy Myronenko Daguang Xu ... Elvira Stellato G. Carrafiello A. Ierardi Alan Yuille H. Roth OOD FedML 165 53 0 20 Apr 2021
Robust Federated Learning with Attack-Adaptive Aggregation Ching Pui Wan Qifeng Chen OOD FedML 124 34 0 10 Feb 2021
Regularization in network optimization via trimmed stochastic gradient descent with noisy labelIEEE Access (IEEE Access), 2020 Kensuke Nakamura Bong-Soo Sohn Kyoung-Jae Won Byung-Woo Hong NoLa 152 2 0 21 Dec 2020
Learning from History for Byzantine Robust OptimizationInternational Conference on Machine Learning (ICML), 2020 Sai Praneeth Karimireddy Lie He Martin Jaggi FedML AAML 312 218 0 18 Dec 2020
Byzantine Resilient Distributed Multi-Task LearningNeural Information Processing Systems (NeurIPS), 2020 Jiani Li W. Abbas X. Koutsoukos 133 9 0 25 Oct 2020
A Systematic Literature Review on Federated Machine Learning: From A Software Engineering Perspective Sin Kit Lo Qinghua Lu Chen Wang Hye-Young Paik Liming Zhu FedML 583 88 0 22 Jul 2020
Communication Efficient Federated Learning with Energy Awareness over Wireless NetworksIEEE Transactions on Wireless Communications (TWC), 2020 Richeng Jin Xiaofan He H. Dai 196 27 0 15 Apr 2020
Towards Federated Learning With Byzantine-Robust Client WeightingApplied Sciences (Appl. Sci.), 2020 Amit Portnoy Yoav Tirosh Danny Hendler FedML 87 12 0 10 Apr 2020
Policy-Based Federated Learning Kleomenis Katevas Eugene Bagdasaryan J. Waterman Mohamad Mounir Safadieh Eleanor Birrell Hamed Haddadi D. Estrin 117 0 0 14 Mar 2020
Stochastic-Sign SGD for Federated Learning with Theoretical GuaranteesIEEE Transactions on Neural Networks and Learning Systems (IEEE TNNLS), 2020 Richeng Jin Yufan Huang Xiaofan He H. Dai Tianfu Wu FedML 223 65 0 25 Feb 2020
Salvaging Federated Learning by Local Adaptation Tao Yu Eugene Bagdasaryan Vitaly Shmatikov FedML 221 298 0 12 Feb 2020
Abnormal Client Behavior Detection in Federated Learning Suyi Li Yong Cheng Yang Liu Wei Wang Tianjian Chen AAML 118 152 0 22 Oct 2019
BRIDGE: Byzantine-resilient Decentralized Gradient DescentIEEE Transactions on Signal and Information Processing over Networks (TSIPN), 2019 Cheng Fang Zhixiong Yang W. Bajwa 221 113 0 21 Aug 2019
How To Backdoor Federated LearningInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2018 Eugene Bagdasaryan Andreas Veit Yiqing Hua D. Estrin Vitaly Shmatikov SILM FedML 457 2,212 0 02 Jul 2018