DRACO: Byzantine-resilient Distributed Training via Redundant Gradients

27 March 2018

Lingjiao Chen

Hongyi Wang

Zachary B. Charles

Dimitris Papailiopoulos

ArXiv PDF HTML

Papers citing "DRACO: Byzantine-resilient Distributed Training via Redundant Gradients"

40 / 40 papers shown

Title
A Learning-Based Attack Framework to Break SOTA Poisoning Defenses in Federated Learning Yuxin Yang Qiang Li Chenfei Nie Yuan Hong Meng Pang Binghui Wang AAML FedML 42 1 0 21 Jul 2024
A Mirror Descent-Based Algorithm for Corruption-Tolerant Distributed Gradient Descent Shuche Wang Vincent Y. F. Tan FedML OOD 49 1 0 19 Jul 2024
Asynchronous Byzantine Federated Learning Bart Cox Abele Malan Lydia Y. Chen Jérémie Decouchant 50 1 0 03 Jun 2024
Communication Compression for Byzantine Robust Learning: New Efficient Algorithms and Improved Rates Ahmad Rammal Kaja Gruntkowska Nikita Fedin Eduard A. Gorbunov Peter Richtárik 45 5 0 15 Oct 2023
On the Optimal Batch Size for Byzantine-Robust Distributed Learning Yi-Rui Yang Chang-Wei Shi Wu-Jun Li FedML AAML 24 0 0 23 May 2023
Vers: fully distributed Coded Computing System with Distributed Encoding Nastaran Abadi Khooshemehr M. Maddah-ali FedML 27 2 0 12 Apr 2023
FedCut: A Spectral Analysis Framework for Reliable Detection of Byzantine Colluders Hanlin Gu Lixin Fan Xingxing Tang Qiang Yang AAML FedML 22 1 0 24 Nov 2022
Impact of Redundancy on Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 34 2 0 16 Nov 2022
Robust Distributed Learning Against Both Distributional Shifts and Byzantine Attacks Guanqiang Zhou Ping Xu Yue Wang Zhi Tian OOD FedML 33 4 0 29 Oct 2022
Secure Distributed Optimization Under Gradient Attacks Shuhua Yu S. Kar 32 13 0 28 Oct 2022
Enhanced Security and Privacy via Fragmented Federated Learning N. Jebreel J. Domingo-Ferrer Alberto Blanco-Justicia David Sánchez FedML 33 26 0 13 Jul 2022
Byzantine-Robust Federated Learning with Optimal Statistical Rates and Privacy Guarantees Banghua Zhu Lun Wang Qi Pang Shuai Wang Jiantao Jiao D. Song Michael I. Jordan FedML 98 30 0 24 May 2022
Over-The-Air Federated Learning under Byzantine Attacks Houssem Sifaou Geoffrey Ye Li OOD FedML 35 7 0 05 May 2022
Byzantine Fault Tolerance in Distributed Machine Learning : a Survey Djamila Bouhata Hamouma Moumen Moumen Hamouma Ahcène Bounceur AI4CE 27 7 0 05 May 2022
Distributed Statistical Min-Max Learning in the Presence of Byzantine Agents Arman Adibi A. Mitra George J. Pappas Hamed Hassani 21 3 0 07 Apr 2022
FedComm: Federated Learning as a Medium for Covert Communication Dorjan Hitaj Giulio Pagnotta Briland Hitaj Fernando Perez-Cruz L. Mancini FedML 32 10 0 21 Jan 2022
ARFED: Attack-Resistant Federated averaging based on outlier elimination Ece Isik Polat Gorkem Polat Altan Koçyiğit AAML FedML 41 10 0 08 Nov 2021
Solon: Communication-efficient Byzantine-resilient Distributed Training via Redundant Gradients Lingjiao Chen Leshang Chen Hongyi Wang S. Davidson Yan Sun FedML 37 1 0 04 Oct 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 187 412 0 14 Jul 2021
Secure Distributed Training at Scale Eduard A. Gorbunov Alexander Borzunov Michael Diskin Max Ryabinin FedML 21 15 0 21 Jun 2021
A Survey on Fault-tolerance in Distributed Optimization and Machine Learning Shuo Liu AI4CE OOD 50 13 0 16 Jun 2021
SPECTRE: Defending Against Backdoor Attacks Using Robust Statistics J. Hayase Weihao Kong Raghav Somani Sewoong Oh AAML 24 149 0 22 Apr 2021
Differential Privacy and Byzantine Resilience in SGD: Do They Add Up? R. Guerraoui Nirupam Gupta Rafael Pinot Sébastien Rouault John Stephan 33 30 0 16 Feb 2021
DiPSeN: Differentially Private Self-normalizing Neural Networks For Adversarial Robustness in Federated Learning Olakunle Ibitoye M. O. Shafiq Ashraf Matrawy FedML 28 18 0 08 Jan 2021
Learning from History for Byzantine Robust Optimization Sai Praneeth Karimireddy Lie He Martin Jaggi FedML AAML 30 173 0 18 Dec 2020
Privacy and Robustness in Federated Learning: Attacks and Defenses Lingjuan Lyu Han Yu Xingjun Ma Chen Chen Lichao Sun Jun Zhao Qiang Yang Philip S. Yu FedML 183 355 0 07 Dec 2020
FAT: Federated Adversarial Training Giulio Zizzo Ambrish Rawat M. Sinn Beat Buesser FedML 33 43 0 03 Dec 2020
CPR: Understanding and Improving Failure Tolerant Training for Deep Learning Recommendation with Partial Recovery Kiwan Maeng Shivam Bharuka Isabel Gao M. C. Jeffrey V. Saraph ... Caroline Trippel Jiyan Yang Michael G. Rabbat Brandon Lucia Carole-Jean Wu OffRL 24 31 0 05 Nov 2020
ByzShield: An Efficient and Robust System for Distributed Training Konstantinos Konstantinidis A. Ramamoorthy AAML FedML 27 11 0 10 Oct 2020
Collaborative Learning in the Jungle (Decentralized, Byzantine, Heterogeneous, Asynchronous and Nonconvex Learning) El-Mahdi El-Mhamdi Sadegh Farhadkhani R. Guerraoui Arsany Guirguis L. Hoang Sébastien Rouault FedML 18 63 0 03 Aug 2020
Buffered Asynchronous SGD for Byzantine Learning Yi-Rui Yang Wu-Jun Li FedML 29 5 0 02 Mar 2020
Stochastic-Sign SGD for Federated Learning with Theoretical Guarantees Richeng Jin Yufan Huang Xiaofan He H. Dai Tianfu Wu FedML 22 63 0 25 Feb 2020
Robust Aggregation for Federated Learning Krishna Pillutla Sham Kakade Zaïd Harchaoui FedML 37 629 0 31 Dec 2019
Federated Variance-Reduced Stochastic Gradient Descent with Robustness to Byzantine Attacks Zhaoxian Wu Qing Ling Tianyi Chen G. Giannakis FedML AAML 32 181 0 29 Dec 2019
Randomized Reactive Redundancy for Byzantine Fault-Tolerance in Parallelized Learning Nirupam Gupta Nitin H. Vaidya FedML 38 8 0 19 Dec 2019
Byzantine-Robust Federated Machine Learning through Adaptive Model Averaging Luis Muñoz-González Kenneth T. Co Emil C. Lupu FedML 24 180 0 11 Sep 2019
DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation Shashank Rajput Hongyi Wang Zachary B. Charles Dimitris Papailiopoulos FedML 6 131 0 29 Jul 2019
Defending Against Saddle Point Attack in Byzantine-Robust Distributed Learning Dong Yin Yudong Chen Kannan Ramchandran Peter L. Bartlett FedML 29 97 0 14 Jun 2018
Lagrange Coded Computing: Optimal Design for Resiliency, Security and Privacy Qian-long Yu Songze Li Netanel Raviv Seyed Mohammadreza Mousavi Kalan Jinhyun So A. Avestimehr 19 381 0 04 Jun 2018
Convolutional Neural Networks for Sentence Classification Yoon Kim AILaw VLM 255 13,368 0 25 Aug 2014