Small Models are Valuable Plug-ins for Large Language Models

15 May 2023

Canwen Xu

Yichong Xu

Shuohang Wang

Yang Liu

Papers citing "Small Models are Valuable Plug-ins for Large Language Models"

34 / 34 papers shown

Title
Collab-RAG: Boosting Retrieval-Augmented Generation for Complex Question Answering via White-Box and Black-Box LLM Collaboration Ran Xu W. Shi Yuchen Zhuang Yue Yu Joyce C. Ho Haoyu Wang Carl Yang 24 0 0 07 Apr 2025
HERA: Hybrid Edge-cloud Resource Allocation for Cost-Efficient AI Agents Shiyi Liu Haiying Shen Shuai Che Mahdi Ghandi Mingqin Li LLMAG 48 0 0 01 Apr 2025
LeForecast: Enterprise Hybrid Forecast by Time Series Intelligence Zheng Tan Yiwen Nie Wenfa Wu Guanyu Zhang Yanze Liu ... Chao Yang Jiaxuan Fan Yuan He Hongsheng Qi Yangzhou Du AI4TS 29 0 0 27 Mar 2025
Towards Sustainable Large Language Model Serving Sophia Nguyen Beihao Zhou Yi Ding Sihang Liu 81 7 0 31 Dec 2024
GPT for Games: An Updated Scoping Review (2020-2024) Daijin Yang Erica Kleinman Casper Harteveld LLMAG AI4TS AI4CE 42 2 0 01 Nov 2024
Improving In-Context Learning with Small Language Model Ensembles M. Mehdi Mojarradi Lingyi Yang Robert McCraith Adam Mahdi 21 0 0 29 Oct 2024
Matryoshka: Learning to Drive Black-Box LLMs with LLMs Changhao Li Yuchen Zhuang Rushi Qiang Haotian Sun H. Dai Chao Zhang Bo Dai LRM 16 4 0 28 Oct 2024
Mitigating the Negative Impact of Over-association for Conversational Query Production Ante Wang Linfeng Song Zijun Min Ge Xu Xiaoli Wang Junfeng Yao Jinsong Su 16 0 0 29 Sep 2024
PICLe: Eliciting Diverse Behaviors from Large Language Models with Persona In-Context Learning Hyeong Kyu Choi Yixuan Li 57 17 0 03 May 2024
Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Tasks Yuhao Liu Zhanghan Ke Fang Liu Nanxuan Zhao Rynson W. H. Lau DiffM 24 19 0 01 Mar 2024
LinkNER: Linking Local Named Entity Recognition Models to Large Language Models using Uncertainty Zhen Zhang Yuhua Zhao Hang Gao Mengting Hu 22 3 0 16 Feb 2024
Online Cascade Learning for Efficient Inference over Streams Lunyiu Nie Zhimin Ding Erdong Hu Christopher M. Jermaine Swarat Chaudhuri 16 4 0 07 Feb 2024
Supervised Knowledge Makes Large Language Models Better In-context Learners Linyi Yang Shuibai Zhang Zhuohao Yu Guangsheng Bao Yidong Wang ... Ruochen Xu Weirong Ye Xing Xie Weizhu Chen Yue Zhang 11 10 0 26 Dec 2023
Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's LLM with Open Source SLMs in Production Chandra Irugalbandara Ashish Mahendra Roland Daynauth T. Arachchige Jayanaka L. Dantanarayana K. Flautner Lingjia Tang Yiping Kang Jason Mars ELM 16 14 0 20 Dec 2023
Robot Learning in the Era of Foundation Models: A Survey Xuan Xiao Jiahang Liu Zhipeng Wang Yanmin Zhou Yong Qi Qian Cheng Bin He Shuo Jiang AI4CE LM&Ro 8 25 0 24 Nov 2023
Plug-and-Play Policy Planner for Large Language Model Powered Dialogue Agents Yang Deng Wenxuan Zhang Wai Lam See-Kiong Ng Tat-Seng Chua LM&Ro LLMAG 8 34 0 01 Nov 2023
SCALE: Synergized Collaboration of Asymmetric Language Translation Engines Xin Cheng Xun Wang Tao Ge Si-Qing Chen Y. Li Dongyan Zhao Rui Yan 27 2 0 29 Sep 2023
Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection Beizhe Hu Qiang Sheng Juan Cao Yuhui Shi Yang Li Danding Wang Peng Qi 14 80 0 21 Sep 2023
Data Distribution Bottlenecks in Grounding Language Models to Knowledge Bases Yiheng Shu Zhiwei Yu 6 3 0 15 Sep 2023
Distilled GPT for Source Code Summarization Chia-Yi Su Collin McMillan 9 34 0 28 Aug 2023
A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis Izzeddin Gur Hiroki Furuta Austin Huang Mustafa Safdari Yutaka Matsuo Douglas Eck Aleksandra Faust LM&Ro LLMAG 12 193 0 24 Jul 2023
Insert-expansions for Tool-enabled Conversational Agents Andreas Göldi Roman Rietsche KELM 11 1 0 04 Jul 2023
Plug-and-Play Knowledge Injection for Pre-trained Language Models Zhengyan Zhang Zhiyuan Zeng Yankai Lin Huadong Wang Deming Ye ... Xu Han Zhiyuan Liu Peng Li Maosong Sun Jie Zhou KELM 29 10 0 28 May 2023
Plug-and-Play Document Modules for Pre-trained Models Chaojun Xiao Zhengyan Zhang Xu Han Chi-Min Chan Yankai Lin Zhiyuan Liu Xiangyang Li Zhonghua Li Zhao Cao Maosong Sun KELM 9 5 0 28 May 2023
Active Learning Principles for In-Context Learning with Large Language Models Katerina Margatina Timo Schick Nikolaos Aletras Jane Dwivedi-Yu 10 39 0 23 May 2023
One-stop Training of Multiple Capacity Models Lan Jiang Haoyang Huang Dongdong Zhang R. Jiang Furu Wei 19 0 0 23 May 2023
A Survey on In-context Learning Qingxiu Dong Lei Li Damai Dai Ce Zheng Jingyuan Ma ... Zhiyong Wu Baobao Chang Xu Sun Lei Li Zhifang Sui ReLM AIMat 17 443 0 31 Dec 2022
ProGen: Progressive Zero-shot Dataset Generation via In-context Feedback Jiacheng Ye Jiahui Gao Jiangtao Feng Zhiyong Wu Tao Yu Lingpeng Kong SyDa VLM 71 69 0 22 Oct 2022
YATO: Yet Another deep learning based Text analysis Open toolkit Zeqiang Wang Yile Wang Jiageng Wu Zhiyang Teng Jie Yang 17 3 0 28 Sep 2022
Can Large Language Models Truly Understand Prompts? A Case Study with Negated Prompts Joel Jang Seonghyeon Ye Minjoon Seo ELM LRM 69 64 0 26 Sep 2022
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity Yao Lu Max Bartolo Alastair Moore Sebastian Riedel Pontus Stenetorp AILaw LRM 274 882 0 18 Apr 2021
What Makes Good In-Context Examples for GPT- $3$ ? Jiachang Liu Dinghan Shen Yizhe Zhang Bill Dolan Lawrence Carin Weizhu Chen AAML RALM 275 1,296 0 17 Jan 2021
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 238 1,898 0 31 Dec 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018