A Survey on Collaborative Mechanisms Between Large and Small Language Models

12 May 2025

Papers citing "A Survey on Collaborative Mechanisms Between Large and Small Language Models"

31 / 31 papers shown

Title
Intelligence per Watt: Measuring Intelligence Efficiency of Local AI Jon Saad-Falcon A. Narayan Hakki Orhun Akengin J. Wes Griffin Herumb Shandilya ... Shang Zhu Ben Athiwaratkun John Hennessy Azalia Mirhoseini Christopher Ré 161 3 0 11 Nov 2025
Small-Large Collaboration: Training-efficient Concept Personalization for Large VLM using a Meta Personalized Small VLM Sihan Yang Huitong Ji Shaolin Lu Jiayi Chen Binxiao Xu Ming Lu Yuanxing Zhang Wenhui Dong Feiyu Xiong VLM 150 0 0 10 Aug 2025
Towards Efficient Multi-LLM Inference: Characterization and Analysis of LLM Routing and Hierarchical Techniques Adarsh Prasad Behera J. Champati Roberto Morabito Sasu Tarkoma J. Gross 176 5 0 06 Jun 2025
LLM-Empowered Embodied Agent for Memory-Augmented Task Planning in Household Robotics Marc Glocker Peter Honig Matthias Hirschmanner Markus Vincze LM&Ro 259 13 0 30 Apr 2025
Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks Yang Liu Bingjie Yan Tianyuan Zou Jianqing Zhang Zixuan Gu ... Jiajian Li Xiaozhou Ye Ye Ouyang Qiang Yang Yanzhe Zhang ALM 978 2 0 24 Apr 2025
Honey, I Shrunk the Language Model: Impact of Knowledge Distillation Methods on Performance and Explainability Daniel Hendriks Philipp Spitzer Niklas Kühl G. Satzger 317 2 0 22 Apr 2025
Collaborative Learning of On-Device Small Model and Cloud-Based Large Model: Advances and Future Directions Chaoyue Niu Yucheng Ding Junhui Lu Zhengxiang Huang Hang Zeng Yutong Dai Xuezhen Tu Chengfei Lv Fan Wu Guihai Chen 307 2 0 17 Apr 2025
DeepMLF: Multimodal language model with learnable tokens for deep fusion in sentiment analysis Efthymios Georgiou Vassilis Katsouros Yannis Avrithis Alexandros Potamianos 325 1 0 15 Apr 2025
Toward Super Agent System with Hybrid AI Routers Yuhang Yao Haixin Wang Yibo Chen Jiawen Wang Min Chang Jordan Ren Bosheng Ding Salman Avestimehr Chaoyang He LM&Ro LLMAG 383 3 0 11 Apr 2025
Collab-RAG: Boosting Retrieval-Augmented Generation for Complex Question Answering via White-Box and Black-Box LLM Collaboration Ran Xu W. Shi Yuchen Zhuang Yue Yu Joyce C. Ho Haoyu Wang Carl Yang 201 11 0 07 Apr 2025
KnowsLM: A framework for evaluation of small language models for knowledge augmentation and humanised conversations Chitranshu Harbola A. Purwar 271 7 0 06 Apr 2025
Self-Resource Allocation in Multi-Agent LLM Systems Alfonso Amayuelas Jingbo Yang Saaket Agashe Ashwin Nagarajan Antonis Antoniades Xinze Wang William Wang 418 9 0 02 Apr 2025
Hawkeye:Efficient Reasoning with Model Collaboration Jianshu She Ruoyao Xiao Zhemin Huang Qi Li Peiran Xu Haonan Li Qirong Ho LRM 427 10 0 01 Apr 2025
ReMA: Learning to Meta-think for LLMs with Multi-Agent Reinforcement Learning Bo Liu Yunxiang Li Yangqiu Song Hanjing Wang Linyi Yang ... Jun Wang Jun Wang Weinan Zhang Shuyue Hu Ying Wen LLMAG KELM LRM AI4CE 423 34 0 12 Mar 2025
Life-Cycle Routing Vulnerabilities of LLM Router Qiqi Lin Xiaoyang Ji Shengfang Zhai Qingni Shen Zhi-Li Zhang Yuejian Fang Yansong Gao AAML 183 2 0 09 Mar 2025
A Survey of Large Language Model Empowered Agents for Recommendation and Search: Towards Next-Generation Information Retrieval Yu Zhang Shutong Qiao Jiaqi Zhang Tzu-Heng Lin Chen Gao Yongqian Li LM&Ro LM&MA 534 18 0 07 Mar 2025
Collaborative Stance Detection via Small-Large Language Model Consistency Verification Yu Yan Sheng Sun Zixiang Tang Teli Liu Min Liu 298 3 0 27 Feb 2025
Sliding-Window Merging for Compacting Patch-Redundant Layers in LLMs Xuan Ding Rui Sun Yunjian Zhang Xiu Yan Yueqi Zhou Kaihao Huang Suzhong Fu Angelica I Aviles-Rivero Chuanlong Xie Yao Zhu 473 4 0 26 Feb 2025
Harnessing Multiple Large Language Models: A Survey on LLM Ensemble Zhijun Chen Jingzheng Li Pengpeng Chen Zhuoran Li Kai Sun ... Likang Xiao Dingqi Yang Yikun Ban Hailong Sun Philip S. Yu ELM 544 64 0 25 Feb 2025
Improving Consistency in Large Language Models through Chain of Guidance Harsh Raj Vipul Gupta Domenic Rosati Subhabrata Majumdar LLMAG LRM 233 12 0 21 Feb 2025
Dynamic Low-Rank Sparse Adaptation for Large Language ModelsInternational Conference on Learning Representations (ICLR), 2025 Weizhong Huang Yuxin Zhang Xiawu Zheng Wenshu Fan Aiyue Chen Yiwu Yao Rongrong Ji 402 4 0 21 Feb 2025
Minions: Cost-efficient Collaboration Between On-device and Cloud Language Models A. Narayan D. Biderman Sabri Eyuboglu Avner May Scott W. Linderman James Zou Christopher Ré 237 9 0 21 Feb 2025
Scaling Multimodal Search and Recommendation with Small Language Models via Upside-Down Reinforcement Learning Yu-Chen Lin Sanat Sharma Hari Manikandan Jayant Kumar Tracy Holloway King Jing Zheng LRM 286 2 0 14 Feb 2025
Speculate, then Collaborate: Fusing Knowledge of Language Models during Decoding Liang Luo Muneeza Azmart Ang Li R. Horesh Mikhail Yurochkin 396 6 0 11 Feb 2025
MixLLM: Dynamic Routing in Mixed Large Language ModelsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2025 Xinyuan Wang Yanchi Liu Wei Cheng Xujiang Zhao Zhe Chen Wenchao Yu Yanjie Fu Haifeng Chen 521 25 0 09 Feb 2025
Confident or Seek Stronger: Exploring Uncertainty-Based On-device LLM Routing From Benchmarking to Generalization Yu-Neng Chuang Leisheng Yu Guanchu Wang Lizhe Zhang Zirui Liu Xuanting Cai Yang Sui Vladimir Braverman Helen Zhou 232 20 0 06 Feb 2025
Division-of-Thoughts: Harnessing Hybrid Language Model Synergy for Efficient On-Device AgentsThe Web Conference (WWW), 2025 Chenyang Shao Xinyuan Hu Yutang Lin Fengli Xu LLMAG LRM 276 20 0 06 Feb 2025
Multi-Agent Geospatial Copilots for Remote Sensing Workflows Chaehong Lee Varatheepan Paramanayakam Andreas Karatzas Yanan Jian Michael Fore Heming Liao Fuxun Yu Ruopu Li Iraklis Anagnostopoulos Dimitrios Stamoulis 244 11 0 28 Jan 2025
Small Language Models (SLMs) Can Still Pack a Punch: A survey Shreyas Subramanian Vikram Elango Mecit Gungor ALM LM&MA 164 26 0 03 Jan 2025
A Survey on Large Language Models for Communication, Network, and Service Management: Application Insights, Challenges, and Future Directions Gordon Owusu Boateng Hani Sami Ahmed Alagha Hanae Elmekki Ahmad Hammoud ... Jamal Bentahar Sami Muhaidat C. Talhi Z. Dziong Mohsen Guizani 149 27 0 31 Dec 2024
Mobile Edge Intelligence for Large Language Models: A Contemporary Survey Guanqiao Qu Qiyuan Chen Wei Wei Zheng Lin Xianhao Chen Kaibin Huang 477 134 0 09 Jul 2024