Federating to Grow Transformers with Constrained Resources without Model Sharing

19 June 2024

Papers citing "Federating to Grow Transformers with Constrained Resources without Model Sharing"

2 / 2 papers shown

Title
Federated Learning on Non-IID Data Silos: An Experimental Study Q. Li Yiqun Diao Quan Chen Bingsheng He FedML OOD 85 936 0 03 Feb 2021
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 243 1,791 0 17 Sep 2019