An Expert is Worth One Token: Synergizing Multiple Expert LLMs as
Generalist via Expert Token Routing

An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routing

25 March 2024

Jianbo Yuan

Hongxia Yang

Papers citing "An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routing"

5 / 5 papers shown

Title
Programming Refusal with Conditional Activation Steering Bruce W. Lee Inkit Padhi K. Ramamurthy Erik Miehling Pierre L. Dognin Manish Nagireddy Amit Dhurandhar LLMSV 89 13 0 06 Sep 2024
Towards Modular LLMs by Building and Reusing a Library of LoRAs O. Ostapenko Zhan Su E. Ponti Laurent Charlin Nicolas Le Roux Matheus Pereira Lucas Page-Caccia Alessandro Sordoni MoMe 27 30 0 18 May 2024
DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuning Wei Chen Qiushi Wang Zefei Long Xianyin Zhang Zhongtian Lu ... Siyuan Wang Jiarong Xu Xiang Bai Xuanjing Huang Zhongyu Wei 68 43 0 23 Oct 2023
$π$ -Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation Chengyue Wu Teng Wang Yixiao Ge Zeyu Lu Rui-Zhi Zhou Ying Shan Ping Luo MoMe 68 35 0 27 Apr 2023
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 278 3,784 0 18 Apr 2021