Speeding Up Distributed Machine Learning Using Codes

8 December 2015

Kangwook Lee

Maximilian Lam

Ramtin Pedarsani

Dimitris Papailiopoulos

Kannan Ramchandran

ArXiv PDF HTML

Papers citing "Speeding Up Distributed Machine Learning Using Codes"

50 / 266 papers shown

Title
Fault-Tolerant Strassen-Like Matrix Multiplication O. B. Güney Suayb S. Arslan 31 0 0 10 Oct 2022
Adaptive Stochastic Gradient Descent for Fast and Communication-Efficient Distributed Learning Serge Kas Hanna Rawad Bitar Parimal Parag Venkateswara Dasari S. E. Rouayheb 30 2 0 04 Aug 2022
Distributed Computations with Layered Resolution H. Esfahanizadeh Alejandro Cohen Muriel Médard S. Shamai 29 3 0 02 Aug 2022
Secure Linear MDS Coded Matrix Inversion Neophytos Charalambides Mert Pilanci Alfred Hero 29 5 0 13 Jul 2022
Hierarchical coded elastic computing Shahrzad Kiani Tharindu B. Adikari S. Draper 10 7 0 19 Jun 2022
Optimization-based Block Coordinate Gradient Coding for Mitigating Partial Stragglers in Distributed Learning Qi Wang Ying Cui Chenglin Li Junni Zou H. Xiong 33 4 0 06 Jun 2022
Sparse Random Khatri-Rao Product Codes for Distributed Matrix Multiplication Ruowan Ji A. Heidarzadeh Krishna R. Narayanan 35 7 0 12 May 2022
Byzantine Fault Tolerance in Distributed Machine Learning : a Survey Djamila Bouhata Hamouma Moumen Moumen Hamouma Ahcène Bounceur AI4CE 34 7 0 05 May 2022
Stream Iterative Distributed Coded Computing for Learning Applications in Heterogeneous Systems H. Esfahanizadeh Alejandro Cohen Muriel Médard 19 7 0 27 Apr 2022
Distributed Sketching for Randomized Optimization: Exact Characterization, Concentration and Lower Bounds Burak Bartan Mert Pilanci 8 4 0 18 Mar 2022
Adaptive Gap Entangled Polynomial Coding for Multi-Party Computation at the Edge Elahe Vedadi Yasaman Keshtkarjahromi H. Seferoglu 32 1 0 13 Mar 2022
Computational Code-Based Privacy in Coded Federated Learning M. Xhemrishi Alexandre Graell i Amat E. Rosnes Antonia Wachter-Zeh FedML 38 4 0 28 Feb 2022
Robust Federated Learning with Connectivity Failures: A Semi-Decentralized Framework with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 55 8 0 24 Feb 2022
Cost-Efficient Distributed Learning via Combinatorial Multi-Armed Bandits Maximilian Egger Rawad Bitar Antonia Wachter-Zeh Deniz Gunduz FedML 27 2 0 16 Feb 2022
Random Alloy Codes and the Fundamental Limits of Coded Distributed Tensors Pedro Soto 18 0 0 07 Feb 2022
Analog Secure Distributed Matrix Multiplication over Complex Numbers Okko Makkonen Camilla Hollanti 16 7 0 07 Feb 2022
Lightweight Projective Derivative Codes for Compressed Asynchronous Gradient Descent Pedro Soto Ilia Ilmer Haibin Guan Jun Li 38 3 0 31 Jan 2022
Stochastic Coded Federated Learning with Convergence and Privacy Guarantees Yuchang Sun Jiawei Shao Songze Li Yuyi Mao Jun Zhang FedML 30 17 0 25 Jan 2022
Polar Coded Computing: The Role of the Scaling Exponent Dorsa Fathollahi Marco Mondelli 16 3 0 25 Jan 2022
Orthonormal Sketches for Secure Coded Regression Neophytos Charalambides Hessam Mahdavifar Mert Pilanci Alfred Hero 30 8 0 21 Jan 2022
Successive Approximation Coding for Distributed Matrix Multiplication Shahrzad Kiani S. Draper 35 9 0 10 Jan 2022
Federated Optimization of Smooth Loss Functions Ali Jadbabaie A. Makur Devavrat Shah FedML 32 7 0 06 Jan 2022
Balanced Nonadaptive Redundancy Scheduling Amir Behrouzi-Far E. Soljanin 29 1 0 03 Jan 2022
Robust Distributed Bayesian Learning with Stragglers via Consensus Monte Carlo Hari Hara Suthan Chittoor Osvaldo Simeone 34 0 0 17 Dec 2021
CodedPaddedFL and CodedSecAgg: Straggler Mitigation and Secure Aggregation in Federated Learning Reent Schlegel Siddhartha Kumar E. Rosnes Alexandre Graell i Amat FedML 32 43 0 16 Dec 2021
Efficient Device Scheduling with Multi-Job Federated Learning Chen Zhou Ji Liu Juncheng Jia Jingbo Zhou Yang Zhou H. Dai Dejing Dou FedML 20 40 0 11 Dec 2021
DSAG: A mixed synchronous-asynchronous iterative method for straggler-resilient learning A. Severinson E. Rosnes S. E. Rouayheb Alexandre Graell i Amat 24 2 0 27 Nov 2021
Finite-Time Consensus Learning for Decentralized Optimization with Nonlinear Gossiping Junya Chen Sijia Wang Lawrence Carin Chenyang Tao 8 3 0 04 Nov 2021
Utilizing Redundancy in Cost Functions for Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 40 0 0 21 Oct 2021
Coding for Straggler Mitigation in Federated Learning Siddhartha Kumar Reent Schlegel E. Rosnes Alexandre Graell i Amat FedML 34 11 0 30 Sep 2021
Dynamics in Coded Edge Computing for IoT: A Fractional Evolutionary Game Approach Yue Han Dusit Niyato Cyril Leung Chunyan Miao Dong In Kim 20 8 0 28 Sep 2021
Coded Computation across Shared Heterogeneous Workers with Communication Delay Yuxuan Sun Fan Zhang Junlin Zhao Sheng Zhou Z. Niu Deniz Gündüz 14 15 0 23 Sep 2021
Decentralized Learning of Tree-Structured Gaussian Graphical Models from Noisy Data Akram Hussain 43 0 0 22 Sep 2021
ApproxIFER: A Model-Agnostic Approach to Resilient and Robust Prediction Serving Systems M. Soleymani Ramy E. Ali Hessam Mahdavifar A. Avestimehr 56 5 0 20 Sep 2021
Optimization-based Block Coordinate Gradient Coding Qi Wang Ying Cui Chenglin Li Junni Zou H. Xiong 22 2 0 18 Sep 2021
Computational Polarization: An Information-theoretic Method for Resilient Computing Mert Pilanci 19 3 0 08 Sep 2021
Modeling Performance and Energy trade-offs in Online Data-Intensive Applications Ajay Badita Rooji Jinan Balajee Vamanan Parimal Parag 9 0 0 18 Aug 2021
Secure Private and Adaptive Matrix Multiplication Beyond the Singleton Bound Christoph Hofmeister Rawad Bitar M. Xhemrishi Antonia Wachter-Zeh 19 15 0 12 Aug 2021
Private Retrieval, Computing and Learning: Recent Progress and Future Challenges S. Ulukus Salman Avestimehr Michael C. Gastpar S. Jafar Ravi Tandon Chao Tian FedML 43 64 0 30 Jul 2021
Adaptive Verifiable Coded Computing: Towards Fast, Secure and Private Distributed Machine Learning Ting-long Tang Ramy E. Ali H. Hashemi Tynan Gangwani A. Avestimehr M. Annavaram 54 13 0 27 Jul 2021
Flexible Distributed Matrix Multiplication Weiqi Li Zhen Chen Zhiying Wang S. Jafar Hamid Jafarkhani 32 6 0 22 Jul 2021
A Practical Algorithm Design and Evaluation for Heterogeneous Elastic Computing with Stragglers Nicholas Woolsey Joerg Kliewer Rong-Rong Chen Mingyue Ji 33 7 0 18 Jul 2021
PolyDot Coded Privacy Preserving Multi-Party Computation at the Edge Elahe Vedadi Yasaman Keshtkarjahromi H. Seferoglu 15 2 0 15 Jun 2021
On Large-Cohort Training for Federated Learning Zachary B. Charles Zachary Garrett Zhouyuan Huo Sergei Shmulyian Virginia Smith FedML 21 113 0 15 Jun 2021
Bivariate Polynomial Codes for Secure Distributed Matrix Multiplication Burak Hasircioglu J. Gómez-Vilardebó Deniz Gunduz 22 9 0 14 Jun 2021
Federated Learning with Buffered Asynchronous Aggregation John Nguyen Kshitiz Malik Hongyuan Zhan Ashkan Yousefpour Michael G. Rabbat Mani Malek Dzmitry Huba FedML 43 290 0 11 Jun 2021
Coded-InvNet for Resilient Prediction Serving Systems Tuan Dinh Kangwook Lee 27 3 0 11 Jun 2021
Jointly Optimize Coding and Node Selection for Distributed Computing over Wireless Edge Networks Cong T. Nguyen Diep N. Nguyen D. Hoang Hoang-Anh Pham E. Dutkiewicz 18 2 0 10 Jun 2021
Asynchronous Distributed Optimization with Redundancy in Cost Functions Shuo Liu Nirupam Gupta Nitin H. Vaidya 31 3 0 07 Jun 2021
Soft BIBD and Product Gradient Codes Animesh Sakorikar Lele Wang 29 5 0 11 May 2021