Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers

MoE
Re-assign community