LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning

25 May 2018

Tianyi Chen

G. Giannakis

Tao Sun

W. Yin

ArXiv PDF HTML

Papers citing "LAG: Lazily Aggregated Gradient for Communication-Efficient Distributed Learning"

30 / 30 papers shown

Title
A Mirror Descent-Based Algorithm for Corruption-Tolerant Distributed Gradient Descent Shuche Wang Vincent Y. F. Tan FedML OOD 32 1 0 19 Jul 2024
FedEx: Expediting Federated Learning over Heterogeneous Mobile Devices by Overlapping and Participant Selection Jiaxiang Geng Boyu Li Xiaoqi Qin Yixuan Li Liang Li Yanzhao Hou Miao Pan FedML 22 0 0 01 Jul 2024
Distributed Stochastic Gradient Descent with Staleness: A Stochastic Delay Differential Equation Based Framework Siyuan Yu Wei Chen H. V. Poor 22 0 0 17 Jun 2024
Distributed Event-Based Learning via ADMM Güner Dilsad Er Sebastian Trimpe Michael Muehlebach FedML 27 2 0 17 May 2024
Version age-based client scheduling policy for federated learning Xinyi Hu Nikolaos Pappas Howard H. Yang 17 3 0 08 Feb 2024
Rendering Wireless Environments Useful for Gradient Estimators: A Zero-Order Stochastic Federated Learning Method Elissa Mhanna Mohamad Assaad 19 1 0 30 Jan 2024
Budgeted Online Model Selection and Fine-Tuning via Federated Learning P. M. Ghari Yanning Shen FedML 28 1 0 19 Jan 2024
Revolutionizing Wireless Networks with Federated Learning: A Comprehensive Review Sajjad Emdadi Mahdimahalleh AI4CE 18 0 0 01 Aug 2023
Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression Yutong He Xinmeng Huang Yiming Chen W. Yin Kun Yuan 26 7 0 12 May 2023
Clustered Federated Learning based on Nonconvex Pairwise Fusion Xue Yu Ziyi Liu Wu Wang Yifan Sun FedML 30 7 0 08 Nov 2022
Fast Heterogeneous Federated Learning with Hybrid Client Selection Guangyuan Shen D. Gao Duanxiao Song Libin Yang Xukai Zhou Shirui Pan W. Lou Fang Zhou FedML 27 11 0 10 Aug 2022
Communication-efficient Distributed Newton-like Optimization with Gradients and M-estimators Ziyan Yin 25 0 0 13 Jul 2022
Lazy Queries Can Reduce Variance in Zeroth-order Optimization Quan-Wu Xiao Qing Ling Tianyi Chen 20 0 0 14 Jun 2022
Distributed Riemannian Optimization with Lazy Communication for Collaborative Geometric Estimation Yulun Tian Amrit Singh Bedi Alec Koppel Miguel Calvo-Fullana David M. Rosen Jonathan P. How 14 5 0 02 Mar 2022
Adaptive Worker Grouping For Communication-Efficient and Straggler-Tolerant Distributed SGD Feng Zhu Jingjing Zhang Osvaldo Simeone Xin Eric Wang 6 0 0 12 Jan 2022
Federated Reinforcement Learning at the Edge Konstantinos Gatsis FedML 13 5 0 11 Dec 2021
Federated Learning over Wireless IoT Networks with Optimized Communication and Resources Student Member Ieee Hao Chen Shaocheng Huang Deyou Zhang Ming Xiao Fellow Ieee Mikael Skoglund L. F. I. H. Vincent Poor 16 91 0 22 Oct 2021
BEV-SGD: Best Effort Voting SGD for Analog Aggregation Based Federated Learning against Byzantine Attackers Xin-Yue Fan Yue Wang Yan Huo Zhi Tian FedML 14 23 0 18 Oct 2021
Learning, Computing, and Trustworthiness in Intelligent IoT Environments: Performance-Energy Tradeoffs B. Soret L. Nguyen J. Seeger Arne Bröring Chaouki Ben Issaid S. Samarakoon Anis El Gabli V. Kulkarni M. Bennis P. Popovski 11 13 0 04 Oct 2021
Accelerated Gradient Descent Learning over Multiple Access Fading Channels Raz Paul Yuval Friedman Kobi Cohen 14 30 0 26 Jul 2021
Joint Client Scheduling and Resource Allocation under Channel Uncertainty in Federated Learning Madhusanka Manimel Wadu S. Samarakoon M. Bennis 6 51 0 12 Jun 2021
Decentralized Federated Averaging Tao Sun Dongsheng Li Bao Wang FedML 21 206 0 23 Apr 2021
FederBoost: Private Federated Learning for GBDT Zhihua Tian Rui Zhang Xiaoyang Hou Jian-wei Liu K. Ren Jian Liu Kui Ren FedML AI4CE 28 64 0 05 Nov 2020
Communication Efficient Distributed Learning with Censored, Quantized, and Generalized Group ADMM Chaouki Ben Issaid Anis Elgabli Jihong Park M. Bennis Mérouane Debbah FedML 10 13 0 14 Sep 2020
XOR Mixup: Privacy-Preserving Data Augmentation for One-Shot Federated Learning Myungjae Shin Chihoon Hwang Joongheon Kim Jihong Park M. Bennis Seong-Lyun Kim FedML 6 108 0 09 Jun 2020
FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data Xinwei Zhang Mingyi Hong S. Dhople W. Yin Yang Liu FedML 8 225 0 22 May 2020
Joint Parameter-and-Bandwidth Allocation for Improving the Efficiency of Partitioned Edge Learning Dingzhu Wen M. Bennis Kaibin Huang 13 48 0 10 Mar 2020
General Proximal Incremental Aggregated Gradient Algorithms: Better and Novel Results under General Scheme Tao Sun Yuejiao Sun Dongsheng Li Qing Liao 19 16 0 11 Oct 2019
High-Dimensional Stochastic Gradient Quantization for Communication-Efficient Edge Learning Yuqing Du Sheng Yang Kaibin Huang 16 98 0 09 Oct 2019
Linear Convergence of Gradient and Proximal-Gradient Methods Under the Polyak-Łojasiewicz Condition Hamed Karimi J. Nutini Mark W. Schmidt 119 1,190 0 16 Aug 2016