Federated LoRA with Sparse Communication

Federated LoRA with Sparse Communication

7 June 2024

Papers citing "Federated LoRA with Sparse Communication"

10 / 10 papers shown

Title
Decentralized Low-Rank Fine-Tuning of Large Language Models Sajjad Ghiasvand Mahnoosh Alizadeh Ramtin Pedarsani ALM 64 0 0 26 Jan 2025
Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models Sajjad Ghiasvand Yifan Yang Zhiyu Xue Mahnoosh Alizadeh Zheng Zhang Ramtin Pedarsani FedML 25 3 0 16 Oct 2024
DEeR: Deviation Eliminating and Noise Regulating for Privacy-preserving Federated Low-rank Adaptation Meilu Zhu Axiu Mao Jun Liu Yixuan Yuan 32 1 0 16 Oct 2024
Communication-Efficient Federated Low-Rank Update Algorithm and its Connection to Implicit Regularization Haemin Park Diego Klabjan FedML 27 0 0 19 Sep 2024
DP-DyLoRA: Fine-Tuning Transformer-Based Models On-Device under Differentially Private Federated Learning using Dynamic Low-Rank Adaptation Jie Xu Karthikeyan P. Saravanan Rogier van Dalen Haaris Mehmood David Tuckey Mete Ozay 56 5 0 10 May 2024
Conquering the Communication Constraints to Enable Large Pre-Trained Models in Federated Learning Guangyu Sun Umar Khalid Matías Mendieta Taojiannan Yang C. L. P. Chen FedML 64 13 0 04 Oct 2022
Sparse Random Networks for Communication-Efficient Federated Learning Berivan Isik Francesco Pase Deniz Gunduz Tsachy Weissman M. Zorzi FedML 67 52 0 30 Sep 2022
FjORD: Fair and Accurate Federated Learning under heterogeneous targets with Ordered Dropout Samuel Horváth Stefanos Laskaridis Mario Almeida Ilias Leondiadis Stylianos I. Venieris Nicholas D. Lane 162 267 0 26 Feb 2021
Comparing Rewinding and Fine-tuning in Neural Network Pruning Alex Renda Jonathan Frankle Michael Carbin 219 382 0 05 Mar 2020
FedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization Amirhossein Reisizadeh Aryan Mokhtari Hamed Hassani Ali Jadbabaie Ramtin Pedarsani FedML 151 756 0 28 Sep 2019