MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling

23 May 2019

Papers citing "MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling"

27 / 27 papers shown

Title
Communication Optimization for Decentralized Learning atop Bandwidth-limited Edge Networks Tingyang Sun Tuan Nguyen Ting He 35 0 0 16 Apr 2025
Scalable Decentralized Learning with Teleportation Yuki Takezawa Sebastian U. Stich 56 1 0 25 Jan 2025
FedPeWS: Personalized Warmup via Subnetworks for Enhanced Heterogeneous Federated Learning Nurbek Tastan Samuel Horváth Martin Takáč Karthik Nandakumar FedML 57 0 0 03 Oct 2024
Visualizationary: Automating Design Feedback for Visualization Designers using LLMs Sungbok Shin Sanghyun Hong Niklas Elmqvist 24 0 0 19 Sep 2024
Beyond Exponential Graph: Communication-Efficient Topologies for Decentralized Learning via Finite-time Convergence Yuki Takezawa Ryoma Sato Han Bao Kenta Niwa M. Yamada 31 9 0 19 May 2023
Beyond spectral gap (extended): The role of the topology in decentralized learning Thijs Vogels Hadrien Hendrikx Martin Jaggi 16 3 0 05 Jan 2023
RCD-SGD: Resource-Constrained Distributed SGD in Heterogeneous Environment via Submodular Partitioning Haoze He Parijat Dube 13 1 0 02 Nov 2022
Secure Distributed Optimization Under Gradient Attacks Shuhua Yu S. Kar 22 13 0 28 Oct 2022
CANIFE: Crafting Canaries for Empirical Privacy Measurement in Federated Learning Samuel Maddock Alexandre Sablayrolles Pierre Stock FedML 12 22 0 06 Oct 2022
Semi-Decentralized Federated Learning with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 34 32 0 23 May 2022
Robust Federated Learning with Connectivity Failures: A Semi-Decentralized Framework with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 40 8 0 24 Feb 2022
Exponential Graph is Provably Efficient for Decentralized Deep Training Bicheng Ying Kun Yuan Yiming Chen Hanbin Hu Pan Pan W. Yin FedML 36 83 0 26 Oct 2021
Learning, Computing, and Trustworthiness in Intelligent IoT Environments: Performance-Energy Tradeoffs B. Soret L. Nguyen J. Seeger Arne Bröring Chaouki Ben Issaid S. Samarakoon Anis El Gabli V. Kulkarni M. Bennis P. Popovski 23 13 0 04 Oct 2021
FedChain: Chained Algorithms for Near-Optimal Communication Cost in Federated Learning Charlie Hou K. K. Thekumparampil Giulia Fanti Sewoong Oh FedML 30 14 0 16 Aug 2021
From Distributed Machine Learning to Federated Learning: A Survey Ji Liu Jizhou Huang Yang Zhou Xuhong Li Shilei Ji Haoyi Xiong Dejing Dou FedML OOD 44 243 0 29 Apr 2021
Consensus Control for Decentralized Deep Learning Lingjing Kong Tao R. Lin Anastasia Koloskova Martin Jaggi Sebastian U. Stich 19 75 0 09 Feb 2021
Federated Learning over Wireless Device-to-Device Networks: Algorithms and Convergence Analysis Hong Xing Osvaldo Simeone Suzhi Bi 39 92 0 29 Jan 2021
Throughput-Optimal Topology Design for Cross-Silo Federated Learning Othmane Marfoq Chuan Xu Giovanni Neglia Richard Vidal FedML 62 85 0 23 Oct 2020
FedAT: A High-Performance and Communication-Efficient Federated Learning System with Asynchronous Tiers Zheng Chai Yujing Chen Ali Anwar Liang Zhao Yue Cheng Huzefa Rangwala FedML 8 121 0 12 Oct 2020
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization Jianyu Wang Qinghua Liu Hao Liang Gauri Joshi H. Vincent Poor MoMe FedML 14 1,295 0 15 Jul 2020
DS-Sync: Addressing Network Bottlenecks with Divide-and-Shuffle Synchronization for Distributed DNN Training Weiyan Wang Cengguang Zhang Liu Yang Kai Chen Kun Tan 16 12 0 07 Jul 2020
Federated Learning with Compression: Unified Analysis and Sharp Guarantees Farzin Haddadpour Mohammad Mahdi Kamani Aryan Mokhtari M. Mahdavi FedML 23 271 0 02 Jul 2020
Optimal Complexity in Decentralized Training Yucheng Lu Christopher De Sa 25 71 0 15 Jun 2020
rTop-k: A Statistical Estimation Approach to Distributed SGD L. P. Barnes Huseyin A. Inan Berivan Isik Ayfer Özgür 19 65 0 21 May 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 39 491 0 23 Mar 2020
Communication-Efficient Local Decentralized SGD Methods Xiang Li Wenhao Yang Shusen Wang Zhihua Zhang 16 53 0 21 Oct 2019
Slow and Stale Gradients Can Win the Race: Error-Runtime Trade-offs in Distributed SGD Sanghamitra Dutta Gauri Joshi Soumyadip Ghosh Parijat Dube P. Nagpurkar 10 193 0 03 Mar 2018