Theory on Mixture-of-Experts in Continual Learning

Theory on Mixture-of-Experts in Continual Learning

20 February 2025

Papers citing "Theory on Mixture-of-Experts in Continual Learning"

12 / 12 papers shown

Title
Plasticity-Aware Mixture of Experts for Learning Under QoE Shifts in Adaptive Video Streaming Zhiqiang He Zhi Liu 31 0 0 14 Apr 2025
A Comprehensive Survey of Mixture-of-Experts: Algorithms, Theory, and Applications Siyuan Mu Sen Lin MoE 61 1 0 10 Mar 2025
Mechanism Design for Blockchain Order Books against Selfish Miners Yunshu Liu Lingjie Duan 63 0 0 22 Jan 2025
Generate to Discriminate: Expert Routing for Continual Learning Yewon Byun Sanket Vaibhav Mehta Saurabh Garg Emma Strubell Michael Oberst Bryan Wilder Zachary Chase Lipton 62 0 0 31 Dec 2024
Algorithm Design for Continual Learning in IoT Networks Shugang Hao Lingjie Duan CLL 71 0 0 22 Dec 2024
A Survey on Model MoErging: Recycling and Routing Among Specialized Experts for Collaborative Learning Prateek Yadav Colin Raffel Mohammed Muqeeth Lucas Page-Caccia Haokun Liu Tianlong Chen Mohit Bansal Leshem Choshen Alessandro Sordoni MoMe 31 21 0 13 Aug 2024
Mixture of A Million Experts Xu Owen He MoE 16 25 0 04 Jul 2024
Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapters Jiazuo Yu Yunzhi Zhuge Lu Zhang Ping Hu Dong Wang Huchuan Lu You He VLM KELM CLL OODD 97 13 0 18 Mar 2024
The Ideal Continual Learner: An Agent That Never Forgets Liangzu Peng Paris V. Giampouras René Vidal CLL 90 17 0 29 Apr 2023
Mixture-of-Experts with Expert Choice Routing Yan-Quan Zhou Tao Lei Han-Chu Liu Nan Du Yanping Huang Vincent Zhao Andrew M. Dai Zhifeng Chen Quoc V. Le James Laudon MoE 137 323 0 18 Feb 2022
TRGP: Trust Region Gradient Projection for Continual Learning Sen Lin Li Yang Deliang Fan Junshan Zhang CLL 63 72 0 07 Feb 2022
Continual Learning with Recursive Gradient Optimization Hao Liu Huaping Liu VLM CLL 70 30 0 29 Jan 2022