Towards Sustainable Large Language Model Serving

31 December 2024

Papers citing "Towards Sustainable Large Language Model Serving"

7 / 7 papers shown

Title
EnsembleCI: Ensemble Learning for Carbon Intensity Forecasting Leyi Yan Linda Wang Sihang Liu Yi Ding 126 0 0 04 May 2025
Taming the Titans: A Survey of Efficient LLM Inference Serving Ranran Zhen J. Li Yixin Ji Z. Yang Tong Liu Qingrong Xia Xinyu Duan Z. Wang Baoxing Huai M. Zhang LLMAG 77 0 0 28 Apr 2025
FreeRide: Harvesting Bubbles in Pipeline Parallelism Jiashu Zhang Zihan Pan Molly Xu Khuzaima S. Daudjee 90 0 0 11 Sep 2024
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU Yixin Song Zeyu Mi Haotong Xie Haibo Chen BDL 125 120 0 16 Dec 2023
ASPEN: High-Throughput LoRA Fine-Tuning of Large Language Models with a Single GPU Zhengmao Ye Dengchun Li Jingqi Tian Tingfeng Lan Jie Zuo ... Hui Lu Yexi Jiang Jian Sha Ke Zhang Mingjie Tang 99 7 0 05 Dec 2023
Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation Jiawei Liu Chun Xia Yuyao Wang Lingming Zhang ELM ALM 186 799 0 02 May 2023
NURD: Negative-Unlabeled Learning for Online Datacenter Straggler Prediction Yi Ding Avinash Rao Hyebin Song Rebecca Willett Henry Hoffmann 48 3 0 16 Mar 2022