FetchSGD: Communication-Efficient Federated Learning with Sketching

15 July 2020

Papers citing "FetchSGD: Communication-Efficient Federated Learning with Sketching"

50 / 66 papers shown

Title
FedFetch: Faster Federated Learning with Adaptive Downstream Prefetching Qifan Yan Andrew Liu Shiqi He Mathias Lécuyer Ivan Beschastnikh FedML 36 0 0 21 Apr 2025
Sketched Adaptive Federated Deep Learning: A Sharp Convergence Analysis Zhijie Chen Qiaobo Li A. Banerjee FedML 35 0 0 11 Nov 2024
Selective Aggregation for Low-Rank Adaptation in Federated Learning Pengxin Guo Shuang Zeng Y. Wang Huijie Fan Feifei Wang Liangqiong Qu FedML 44 8 0 02 Oct 2024
MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning Yupeng Chen Senmiao Wang Zhihang Lin Zhihang Lin Yushun Zhang Tian Ding Ruoyu Sun Ruoyu Sun CLL 72 1 0 30 Jul 2024
Loss Gradient Gaussian Width based Generalization and Optimization Guarantees A. Banerjee Qiaobo Li Yingxue Zhou 44 0 0 11 Jun 2024
VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections Roy Miles Pradyumna Reddy Ismail Elezi Jiankang Deng VLM 32 3 0 28 May 2024
SignSGD with Federated Voting Chanho Park H. Vincent Poor Namyoon Lee FedML 40 1 0 25 Mar 2024
Fed-CVLC: Compressing Federated Learning Communications with Variable-Length Codes Xiaoxin Su Yipeng Zhou Laizhong Cui John C. S. Lui Jiangchuan Liu FedML 29 1 0 06 Feb 2024
Flora: Low-Rank Adapters Are Secretly Gradient Compressors Yongchang Hao Yanshuai Cao Lili Mou 13 39 0 05 Feb 2024
Improved Quantization Strategies for Managing Heavy-tailed Gradients in Distributed Learning Guangfeng Yan Tan Li Yuanzhang Xiao Hanxu Hou Linqi Song MQ 24 0 0 02 Feb 2024
Privacy-Preserving Data Fusion for Traffic State Estimation: A Vertical Federated Learning Approach Qiqing Wang Kaidi Yang FedML 31 8 0 22 Jan 2024
Budgeted Online Model Selection and Fine-Tuning via Federated Learning P. M. Ghari Yanning Shen FedML 43 1 0 19 Jan 2024
Layered Randomized Quantization for Communication-Efficient and Privacy-Preserving Distributed Learning Guangfeng Yan Tan Li Tian-Shing Lan Kui Wu Linqi Song 19 6 0 12 Dec 2023
Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes Zhen Qin Daoyuan Chen Bingchen Qian Bolin Ding Yaliang Li Shuiguang Deng FedML 32 32 0 11 Dec 2023
Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training Lianke Qin Saayan Mitra Zhao-quan Song Yuanyuan Yang Tianyi Zhou 27 0 0 19 Nov 2023
A Survey for Federated Learning Evaluations: Goals and Measures Di Chai Leye Wang Liu Yang Junxue Zhang Kai Chen Qian Yang ELM FedML 17 21 0 23 Aug 2023
Efficient SGD Neural Network Training via Sublinear Activated Neuron Identification Lianke Qin Zhao-quan Song Yuanyuan Yang 25 9 0 13 Jul 2023
Deep Equilibrium Models Meet Federated Learning A. Gkillas D. Ampeliotis K. Berberidis FedML 35 3 0 29 May 2023
Aggregating Capacity in FL through Successive Layer Training for Computationally-Constrained Devices Kilian Pfeiffer R. Khalili J. Henkel FedML 37 5 0 26 May 2023
Green Federated Learning Ashkan Yousefpour Sheng Guo Ashish Shenoy Sayan Ghosh Pierre Stock Kiwan Maeng Schalk-Willem Kruger Michael G. Rabbat Carole-Jean Wu Ilya Mironov FedML AI4CE 38 10 0 26 Mar 2023
Federated Gradient Matching Pursuit Halyun Jeong Deanna Needell Jing Qin FedML 35 1 0 20 Feb 2023
Does Federated Learning Really Need Backpropagation? H. Feng Tianyu Pang Chao Du Wei-Neng Chen Shuicheng Yan Min-Bin Lin FedML 26 10 0 28 Jan 2023
M22: A Communication-Efficient Algorithm for Federated Learning Inspired by Rate-Distortion Yangyi Liu Stefano Rini Sadaf Salehkalaibar Jun Chen FedML 11 4 0 23 Jan 2023
Improving Federated Learning Communication Efficiency with Global Momentum Fusion for Gradient Compression Schemes Chun-Chih Kuo Ted T. Kuo Chia-Yu Lin FedML 8 1 0 17 Nov 2022
FedGRec: Federated Graph Recommender System with Lazy Update of Latent Embeddings Junyi Li Heng-Chiao Huang FedML 24 6 0 25 Oct 2022
Sketching for First Order Method: Efficient Algorithm for Low-Bandwidth Channel and Vulnerability Zhao-quan Song Yitan Wang Zheng Yu Licheng Zhang FedML 23 28 0 15 Oct 2022
Communication-Efficient Adam-Type Algorithms for Distributed Data Mining Wenhan Xian Feihu Huang Heng-Chiao Huang FedML 25 0 0 14 Oct 2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization Feng Zhu Jingjing Zhang Xin Eric Wang 28 3 0 06 Oct 2022
Over-the-Air Federated Learning with Privacy Protection via Correlated Additive Perturbations Jialing Liao Zheng Chen Erik G. Larsson 20 12 0 05 Oct 2022
FedMT: Federated Learning with Mixed-type Labels Qiong Zhang Jing Peng Xin Zhang A. Talhouk Gang Niu Xiaoxiao Li FedML 51 0 0 05 Oct 2022
Joint Optimization of Energy Consumption and Completion Time in Federated Learning Xinyu Zhou Jun Zhao Huimei Han C. Guet FedML 45 27 0 29 Sep 2022
FedMCSA: Personalized Federated Learning via Model Components Self-Attention Qianling Guo Yong Qi Saiyu Qi Di Wu Qian Li FedML 21 9 0 23 Aug 2022
Towards Efficient Communications in Federated Learning: A Contemporary Survey Zihao Zhao Yuzhu Mao Yang Liu Linqi Song Ouyang Ye Xinlei Chen Wenbo Ding FedML 51 59 0 02 Aug 2022
Accelerated Federated Learning with Decoupled Adaptive Optimization Jiayin Jin Jiaxiang Ren Yang Zhou Lingjuan Lyu Ji Liu Dejing Dou AI4CE FedML 19 51 0 14 Jul 2022
Personalized Federated Learning via Variational Bayesian Inference Xu Zhang Yinchuan Li Wenpeng Li Kaiyang Guo Yunfeng Shao FedML 43 85 0 16 Jun 2022
Neurotoxin: Durable Backdoors in Federated Learning Zhengming Zhang Ashwinee Panda Linyue Song Yaoqing Yang Michael W. Mahoney Joseph E. Gonzalez Kannan Ramchandran Prateek Mittal FedML 24 129 0 12 Jun 2022
Federated Offline Reinforcement Learning D. Zhou Yufeng Zhang Aaron Sonabend-W Zhaoran Wang Junwei Lu Tianxi Cai OffRL 29 13 0 11 Jun 2022
Can Foundation Models Help Us Achieve Perfect Secrecy? Simran Arora Christopher Ré FedML 16 6 0 27 May 2022
Decentral and Incentivized Federated Learning Frameworks: A Systematic Literature Review Leon Witt Mathis Heyer Kentaroh Toyoda Wojciech Samek Dan Li FedML 33 47 0 07 May 2022
Acceleration of Federated Learning with Alleviated Forgetting in Local Training Chencheng Xu Zhiwei Hong Minlie Huang Tao Jiang FedML 19 45 0 05 Mar 2022
Graph-Assisted Communication-Efficient Ensemble Federated Learning P. M. Ghari Yanning Shen FedML 17 4 0 27 Feb 2022
FedSpace: An Efficient Federated Learning Framework at Satellites and Ground Stations Jinhyun So Kevin Hsieh Behnaz Arzani Shadi Noghabi Salman Avestimehr Ranveer Chandra FedML 8 60 0 02 Feb 2022
Federated Active Learning (F-AL): an Efficient Annotation Strategy for Federated Learning J. Ahn Yeeun Ma Seoyun Park Cheolwoo You FedML 37 22 0 01 Feb 2022
A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning S. Zhang Jieyu Lin Qi Zhang 35 62 0 09 Jan 2022
To Talk or to Work: Delay Efficient Federated Learning over Mobile Edge Devices Pavana Prakash Jiahao Ding Maoqiang Wu Minglei Shu Rong Yu M. Pan FedML 35 3 0 01 Nov 2021
DAdaQuant: Doubly-adaptive quantization for communication-efficient Federated Learning Robert Hönig Yiren Zhao Robert D. Mullins FedML 107 53 0 31 Oct 2021
Federated Learning via Plurality Vote Kai Yue Richeng Jin Chau-Wai Wong H. Dai FedML 24 8 0 06 Oct 2021
Comfetch: Federated Learning of Large Networks on Constrained Clients via Sketching Tahseen Rabbani Brandon Yushan Feng Marco Bornstein Kyle Rui Sang Yifan Yang Arjun Rajkumar A. Varshney Furong Huang FedML 51 2 0 17 Sep 2021
FedKD: Communication Efficient Federated Learning via Knowledge Distillation Chuhan Wu Fangzhao Wu Lingjuan Lyu Yongfeng Huang Xing Xie FedML 19 371 0 30 Aug 2021
Communication Optimization in Large Scale Federated Learning using Autoencoder Compressed Weight Updates Srikanth Chandar Pravin Chandran Raghavendra Bhat Avinash Chakravarthi AI4CE 26 3 0 12 Aug 2021