ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2402.06787
  4. Cited By
ForestColl: Throughput-Optimal Collective Communications on Heterogeneous Network Fabrics

ForestColl: Throughput-Optimal Collective Communications on Heterogeneous Network Fabrics

9 February 2024
Liangyu Zhao
Saeed Maleki
Ziyue Yang
Hossein Pourreza
Aashaka Shah
ArXivPDFHTML

Papers citing "ForestColl: Throughput-Optimal Collective Communications on Heterogeneous Network Fabrics"

1 / 1 papers shown
Title
Megatron-LM: Training Multi-Billion Parameter Language Models Using
  Model Parallelism
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism
M. Shoeybi
M. Patwary
Raul Puri
P. LeGresley
Jared Casper
Bryan Catanzaro
MoE
243
1,815
0
17 Sep 2019
1