ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2402.00893
  4. Cited By
MoDE: A Mixture-of-Experts Model with Mutual Distillation among the
  Experts

MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts

31 January 2024
Zhitian Xie
Yinger Zhang
Chenyi Zhuang
Qitao Shi
Zhining Liu
Jinjie Gu
Guannan Zhang
    MoE
ArXivPDFHTML

Papers citing "MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts"

1 / 1 papers shown
Title
Knowledge Distillation by On-the-Fly Native Ensemble
Knowledge Distillation by On-the-Fly Native Ensemble
Xu Lan
Xiatian Zhu
S. Gong
192
473
0
12 Jun 2018
1