Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2405.13997
Cited By
Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts
22 May 2024
Huy Nguyen
Nhat Ho
Alessandro Rinaldo
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts"
5 / 5 papers shown
Title
Revisiting Prefix-tuning: Statistical Benefits of Reparameterization among Prompts
Minh Le
Chau Nguyen
Huy Nguyen
Quyen Tran
Trung Le
Nhat Ho
25
3
0
03 Oct 2024
On Least Square Estimation in Softmax Gating Mixture of Experts
Huy Nguyen
Nhat Ho
Alessandro Rinaldo
28
13
0
05 Feb 2024
FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion
Xing Han
Huy Nguyen
Carl Harris
Nhat Ho
S. Saria
MoE
39
16
0
05 Feb 2024
From Sparse to Soft Mixtures of Experts
J. Puigcerver
C. Riquelme
Basil Mustafa
N. Houlsby
MoE
114
114
0
02 Aug 2023
Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT
James Lee-Thorp
Joshua Ainslie
MoE
22
11
0
24 May 2022
1