Blox: A Modular Toolkit for Deep Learning Schedulers

Blox: A Modular Toolkit for Deep Learning Schedulers

19 December 2023

Saurabh Agarwal

Amar Phanishayee

Shivaram Venkataraman

Papers citing "Blox: A Modular Toolkit for Deep Learning Schedulers"

3 / 3 papers shown

Title
Scheduling Deep Learning Jobs in Multi-Tenant GPU Clusters via Wise Resource Sharing Yizhou Luo Qiang-qiang Wang Shaohuai Shi Jiaxin Lai Shuhan Qi Jia-jia Zhang Xuan Wang 26 0 0 18 Jul 2024
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 245 1,821 0 17 Sep 2019
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,743 0 26 Sep 2016