Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging

29 October 2024

Lefei Zhang

Dacheng Tao

Papers citing "Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging"

3 / 3 papers shown

Title
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications Siyuan Mu Sen Lin MoE 71 1 0 10 Mar 2025
Task Singular Vectors: Reducing Task Interference in Model Merging Antonio Andrea Gargiulo Donato Crisostomi Maria Sofia Bucarelli Simone Scardapane Fabrizio Silvestri Emanuele Rodolà MoMe 83 8 0 26 Nov 2024
SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery Enneng Yang Li Shen Zhenyi Wang G. Guo Xingwei Wang Xiaocun Cao Jie Zhang Dacheng Tao MoMe 24 4 0 18 Oct 2024