Communication-Computation Efficient Gradient Coding

9 February 2018

Papers citing "Communication-Computation Efficient Gradient Coding"

50 / 75 papers shown

Title
Fundamental Limits of Hierarchical Secure Aggregation with Cyclic User Association Xiang Zhang Zhou Li Kai Wan Hua Sun Mingyue Ji Giuseppe Caire 450 9 0 06 Mar 2025
Design and Optimization of Hierarchical Gradient Coding for Distributed Learning at Edge Devices Weiheng Tang Jingyi Li Lin Chen Xu Chen 238 4 0 16 Jun 2024
Approximate Gradient Coding for Privacy-Flexible Federated Learning with Non-IID DataEuropean Signal Processing Conference (EUSIPCO), 2024 Okko Makkonen Sampo Niemelä Camilla Hollanti Serge Kas Hanna 170 0 0 04 Apr 2024
Iterative Sketching for Secure Coded RegressionIEEE Journal on Selected Areas in Information Theory (JSAIT), 2023 Neophytos Charalambides Hessam Mahdavifar Mert Pilanci Alfred Hero 212 3 0 08 Aug 2023
Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles Le‐Yu Chen Yaohua Ma J.N. Zhang 418 9 0 26 Jun 2023
Fast and Straggler-Tolerant Distributed SGD with Reduced Computation LoadInternational Symposium on Information Theory (ISIT), 2023 Maximilian Egger Serge Kas Hanna Rawad Bitar FedML 169 1 0 17 Apr 2023
Recent Advances on Federated Learning: A Systematic SurveyNeurocomputing (Neurocomputing), 2023 Bingyan Liu Nuoyan Lv Yuanchun Guo Yawen Li FedML 224 148 0 03 Jan 2023
Sequential Gradient Coding For Straggler MitigationInternational Conference on Learning Representations (ICLR), 2022 M. Krishnan Mohammadreza Ebrahimi Ashish Khisti 195 1 0 24 Nov 2022
Adaptive Stochastic Gradient Descent for Fast and Communication-Efficient Distributed Learning Serge Kas Hanna Rawad Bitar Parimal Parag Venkateswara Dasari S. E. Rouayheb 207 4 0 04 Aug 2022
Optimization-based Block Coordinate Gradient Coding for Mitigating Partial Stragglers in Distributed LearningIEEE Transactions on Signal Processing (IEEE Trans. Signal Process.), 2022 Qi Wang Ying Cui Chenglin Li Junni Zou H. Xiong 287 4 0 06 Jun 2022
Stream Iterative Distributed Coded Computing for Learning Applications in Heterogeneous SystemsIEEE Conference on Computer Communications (INFOCOM), 2022 H. Esfahanizadeh Alejandro Cohen Muriel Médard 231 7 0 27 Apr 2022
Efficient Convex Optimization Requires Superlinear MemoryAnnual Conference Computational Learning Theory (COLT), 2022 A. Marsden Willie Neiswanger Aaron Sidford Gregory Valiant 180 16 0 29 Mar 2022
Cost-Efficient Distributed Learning via Combinatorial Multi-Armed Bandits Maximilian Egger Rawad Bitar Antonia Wachter-Zeh Deniz Gunduz FedML 284 1 0 16 Feb 2022
Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient DescentInternational Conference on Machine Learning (ICML), 2022 Pedro Soto Ilia Ilmer Haibin Guan Jun Li 186 3 0 31 Jan 2022
Orthonormal Sketches for Secure Coded RegressionInternational Symposium on Information Theory (ISIT), 2022 Neophytos Charalambides Hessam Mahdavifar Mert Pilanci Alfred Hero 196 9 0 21 Jan 2022
Adaptive Worker Grouping For Communication-Efficient and Straggler-Tolerant Distributed SGDInternational Symposium on Information Theory (ISIT), 2022 Feng Zhu Jingjing Zhang Osvaldo Simeone Xin Eric Wang 135 0 0 12 Jan 2022
DSAG: A mixed synchronous-asynchronous iterative method for straggler-resilient learningIEEE Transactions on Communications (IEEE Trans. Commun.), 2021 A. Severinson E. Rosnes S. E. Rouayheb Alexandre Graell i Amat 175 2 0 27 Nov 2021
Finite-Time Consensus Learning for Decentralized Optimization with Nonlinear Gossiping Junya Chen Sijia Wang Lawrence Carin Chenyang Tao 116 3 0 04 Nov 2021
Solon: Communication-efficient Byzantine-resilient Distributed Training via Redundant Gradients Lingjiao Chen Leshang Chen Hongyi Wang S. Davidson Guang Cheng FedML 210 1 0 04 Oct 2021
ApproxIFER: A Model-Agnostic Approach to Resilient and Robust Prediction Serving Systems M. Soleymani Ramy E. Ali Hessam Mahdavifar A. Avestimehr 175 9 0 20 Sep 2021
Optimization-based Block Coordinate Gradient Coding Qi Wang Ying Cui Chenglin Li Junni Zou H. Xiong 214 2 0 18 Sep 2021
A New Design Framework for Heterogeneous Uncoded Storage Elastic ComputingInternational Symposium on Modeling and Optimization in Mobile, Ad-Hoc and Wireless Networks (WiOpt), 2021 Mingyue Ji Xiang Zhang Kai Wan 171 6 0 20 Jul 2021
A Practical Algorithm Design and Evaluation for Heterogeneous Elastic Computing with StragglersGlobal Communications Conference (GLOBECOM), 2021 Nicholas Woolsey Joerg Kliewer Rong-Rong Chen Mingyue Ji 156 9 0 18 Jul 2021
Coded Gradient Aggregation: A Tradeoff Between Communication Costs at Edge Nodes and at Helper NodesInternational Symposium on Information Theory (ISIT), 2021 B. Sasidharan Anoop Thomas 128 9 0 06 May 2021
1-bit LAMB: Communication Efficient Large-Scale Large-Batch Training with LAMB's Convergence SpeedInternational Conference on High Performance Computing (HiPC), 2021 Conglong Li A. A. Awan Hanlin Tang Samyam Rajbhandari Yuxiong He 367 34 0 13 Apr 2021
Distributed Learning Systems with First-order Methods Ji Liu Ce Zhang 149 46 0 12 Apr 2021
Joint Optimization of Communications and Federated Learning Over the AirIEEE Transactions on Wireless Communications (IEEE TWC), 2021 Xin-Yue Fan Yue Wang Yan Huo Z. Tian FedML 188 66 0 08 Apr 2021
Optimal Communication-Computation Trade-Off in Heterogeneous Gradient CodingIEEE Journal on Selected Areas in Information Theory (JSAIT), 2021 Tayyebeh Jahani-Nezhad M. Maddah-ali 169 11 0 02 Mar 2021
Gradient Coding with Dynamic Clustering for Straggler-Tolerant Distributed LearningIEEE Transactions on Communications (IEEE Trans. Commun.), 2021 Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 148 17 0 01 Mar 2021
On Gradient Coding with Partial RecoveryInternational Symposium on Information Theory (ISIT), 2021 Sahasrajit Sarmasarkar V. Lalitha Nikhil Karamchandani 218 9 0 19 Feb 2021
Communication-Efficient Distributed Optimization with Quantized PreconditionersInternational Conference on Machine Learning (ICML), 2021 Foivos Alimisis Peter Davies Dan Alistarh 199 17 0 14 Feb 2021
1-bit Adam: Communication Efficient Large-Scale Training with Adam's Convergence SpeedInternational Conference on Machine Learning (ICML), 2021 Hanlin Tang Shaoduo Gan A. A. Awan Samyam Rajbhandari Conglong Li Xiangru Lian Ji Liu Ce Zhang Yuxiong He AI4CE 263 97 0 04 Feb 2021
Coded Computing for Low-Latency Federated Learning over Wireless Edge NetworksIEEE Journal on Selected Areas in Communications (JSAC), 2020 Saurav Prakash S. Dhakal M. Akdeniz Yair Yona S. Talwar Salman Avestimehr N. Himayat FedML 245 100 0 12 Nov 2020
Gradient Coding with Dynamic Clustering for Straggler Mitigation Baturalp Buyukates Emre Ozfatura S. Ulukus Deniz Gunduz 123 7 0 03 Nov 2020
Diversity/Parallelism Trade-off in Distributed Systems with RedundancyIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2020 Pei Peng E. Soljanin P. Whiting 286 14 0 05 Oct 2020
Berrut Approximated Coded Computing: Straggler Resistance Beyond Polynomial ComputingIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020 Tayyebeh Jahani-Nezhad M. Maddah-ali 223 39 0 17 Sep 2020
APMSqueeze: A Communication Efficient Adam-Preconditioned Momentum SGD Algorithm Hanlin Tang Shaoduo Gan Samyam Rajbhandari Xiangru Lian Ji Liu Yuxiong He Ce Zhang 165 8 0 26 Aug 2020
A Survey of Coded Distributed Computing Jer Shyuan Ng Wei Yang Bryan Lim Nguyen Cong Luong Zehui Xiong Alia Asheralieva Dusit Niyato Cyril Leung Chunyan Miao 131 26 0 20 Aug 2020
A New Combinatorial Coded Design for Heterogeneous Distributed Computing Nicholas Woolsey Rong-Rong Chen Mingyue Ji 223 23 0 21 Jul 2020
Coded Computing for Federated Learning at the Edge Saurav Prakash S. Dhakal M. Akdeniz A. Avestimehr N. Himayat FedML 242 11 0 07 Jul 2020
Coded Distributed Computing with Partial Recovery Emre Ozfatura S. Ulukus Deniz Gunduz 175 32 0 04 Jul 2020
Approximate Gradient Coding with Optimal Decoding Margalit Glasgow Mary Wootters 354 26 0 17 Jun 2020
Communication-Efficient Gradient Coding for Straggler Mitigation in Distributed Learning S. Kadhe O. O. Koyluoglu Kannan Ramchandran 151 14 0 14 May 2020
Straggler-aware Distributed Learning: Communication Computation Latency Trade-offEntropy (Entropy), 2020 Emre Ozfatura S. Ulukus Deniz Gunduz 164 45 0 10 Apr 2020
Adaptive Distributed Stochastic Gradient Descent for Minimizing Delay in the Presence of StragglersIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020 Serge Kas Hanna Rawad Bitar Parimal Parag Venkateswara Dasari S. E. Rouayheb 155 16 0 25 Feb 2020
Communication-Efficient Edge AI: Algorithms and SystemsIEEE Communications Surveys and Tutorials (COMST), 2020 Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 175 390 0 22 Feb 2020
A locality-based approach for coded computation Michael Rudow K. V. Rashmi V. Guruswami 164 7 0 06 Feb 2020
Serverless Straggler Mitigation using Local Error-Correcting Codes Vipul Gupta Dominic Carrano Yaoqing Yang Vaishaal Shankar T. Courtade Kannan Ramchandran 124 10 0 21 Jan 2020
Grand Challenges in Resilience: Autonomous System Resilience through Design and Runtime Measures S. Bagchi Vaneet Aggarwal Somali Chaterji F. Douglis Aly El Gamal ... K. Marais Prateek Mittal Shaoshuai Mou Xiaokang Qiu G. Scutari AI4CE 323 1 0 25 Dec 2019
Hierarchical Coded Matrix MultiplicationCanadian Workshop on Information Theory (CWIT), 2019 Shahrzad Kiani Nuwan S. Ferdinand S. Draper 195 36 0 14 Dec 2019