Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform

16 February 2023

Ziji Shi

Zhen Zheng

Papers citing "Auto-Parallelizing Large Models with Rhino: A Systematic Approach on Production AI Platform"

2 / 2 papers shown

Title
Ada-Grouper: Accelerating Pipeline Parallelism in Preempted Network by Adaptive Group-Scheduling for Micro-Batches Siyu Wang Zongyan Cao Chang Si Lansong Diao Jiamang Wang W. Lin 16 0 0 03 Mar 2023
COMET: A Comprehensive Cluster Design Methodology for Distributed Deep Learning Training D. Kadiyala Saeed Rashidi Taekyung Heo A. Bambhaniya T. Krishna Alexandros Daglis VLM 13 9 0 30 Nov 2022