EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference

16 October 2024

Papers citing "EPS-MoE: Expert Pipeline Scheduler for Cost-Efficient MoE Inference"

1 / 1 papers shown

Title
Speculative MoE: Communication Efficient Parallel MoE Inference with Speculative Token and Expert Pre-scheduling Yan Li Pengfei Zheng Shuang Chen Zewei Xu Yuanhao Lai Yunfei Du Z. Wang MoE 52 0 0 06 Mar 2025