Title
From Sparse to Soft Mixtures of Experts J. Puigcerver C. Riquelme Basil Mustafa N. Houlsby MoE 121 114 0 02 Aug 2023
Mixture-of-Experts with Expert Choice Routing Yan-Quan Zhou Tao Lei Han-Chu Liu Nan Du Yanping Huang Vincent Zhao Andrew M. Dai Zhifeng Chen Quoc V. Le James Laudon MoE 149 326 0 18 Feb 2022

Turn Waste into Worth: Rectifying Top-kkk Router of MoE

Papers citing "Turn Waste into Worth: Rectifying Top-$k$ Router of MoE"