Server-Side Local Gradient Averaging and Learning Rate Acceleration for Scalable Split Learning

11 December 2021

Papers citing "Server-Side Local Gradient Averaging and Learning Rate Acceleration for Scalable Split Learning"

7 / 7 papers shown

Title
HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models Zheng Lin Yuxin Zhang Zhe Chen Zihan Fang Xianhao Chen Praneeth Vepakomma Wei Ni Jun Luo Yue Gao MoE 41 2 0 05 May 2025
Breaking the Memory Wall for Heterogeneous Federated Learning via Model Splitting Chunlin Tian Li Li Kahou Tam Yebo Wu Chengzhong Xu FedML 26 1 0 12 Oct 2024
Parallel Split Learning with Global Sampling Mohammad Kohankhaki Ahmad Ayad Mahdi Barhoush A. Schmeink 38 1 0 22 Jul 2024
Local Learning on Transformers via Feature Reconstruction P. Pathak Jingwei Zhang Dimitris Samaras ViT 20 5 0 29 Dec 2022
PiPar: Pipeline Parallelism for Collaborative Machine Learning Zihan Zhang Philip Rodgers Peter Kilpatrick I. Spence Blesson Varghese FedML 40 3 0 01 Dec 2022
Combined Federated and Split Learning in Edge Computing for Ubiquitous Intelligence in Internet of Things: State of the Art and Future Directions Qiang Duan Shijing Hu Ruijun Deng Zhihui Lu FedML 31 61 0 20 Jul 2022
Larger-Scale Transformers for Multilingual Masked Language Modeling Naman Goyal Jingfei Du Myle Ott Giridhar Anantharaman Alexis Conneau 90 126 0 02 May 2021