Crayon: Customized On-Device LLM via Instant Adapter Blending and Edge-Server Hybrid Inference

11 June 2024

Papers citing "Crayon: Customized On-Device LLM via Instant Adapter Blending and Edge-Server Hybrid Inference"

5 / 5 papers shown

Title
LSRP: A Leader-Subordinate Retrieval Framework for Privacy-Preserving Cloud-Device Collaboration Y. Zhang Pengyue Jia X. Li Derong Xu Maolin Wang ... Zhaocheng Du Huifeng Guo Y. Liu Ruiming Tang Xiangyu Zhao 33 0 0 08 May 2025
Efficient Distributed Retrieval-Augmented Generation for Enhancing Language Model Performance S. Liu Zhenzhe Zheng Xiaoyao Huang Fan Wu Guihai Chen Jie Wu 25 0 0 15 Apr 2025
SLIP: Securing LLMs IP Using Weights Decomposition Yehonathan Refael Adam Hakim Lev Greenberg T. Aviv S. Lokam Ben Fishman Shachar Seidman 36 3 0 15 Jul 2024
Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference Sneha Kudugunta Yanping Huang Ankur Bapna M. Krikun Dmitry Lepikhin Minh-Thang Luong Orhan Firat MoE 119 104 0 24 Sep 2021
CrossFit: A Few-shot Learning Challenge for Cross-task Generalization in NLP Qinyuan Ye Bill Yuchen Lin Xiang Ren 209 167 0 18 Apr 2021