MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism

MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism

3 April 2025

Ruidong Zhu

Ziheng Jiang

Chao Jin

Peng Wu

Cesar A. Stuardo

Dongyang Wang

Xinlei Zhang

Huaping Zhou

Haoran Wei

Yang Cheng

Jianzhe Xiao

Xinyi Zhang

Lingjun Liu

Haibin Lin

Li-Wen Chang

Jianxi Ye

Xiao Yu

Xuanzhe Liu

Xin Jin

Xin Liu

Papers citing "MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism"

Title
No papers