HeterMoE: Efficient Training of Mixture-of-Experts Models on Heterogeneous GPUs

MoMe
MoE
Re-assign community