HOBBIT: A Mixed Precision Expert Offloading System for Fast MoE Inference

3 November 2024

Papers citing "HOBBIT: A Mixed Precision Expert Offloading System for Fast MoE Inference"

2 / 2 papers shown

Title
MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design Haojie Duanmu Xiuhong Li Zhihang Yuan Size Zheng Jiangfei Duan Xingcheng Zhang Dahua Lin MQ MoE 47 0 0 09 May 2025
FloE: On-the-Fly MoE Inference on Memory-constrained GPU Yuxin Zhou Zheng Li J. Zhang Jue Wang Y. Wang Zhongle Xie Ke Chen Lidan Shou MoE 32 0 0 09 May 2025