Toward Sustainable GenAI using Generation Directives for Carbon-Friendly
Large Language Model Inference

Toward Sustainable GenAI using Generation Directives for Carbon-Friendly Large Language Model Inference

19 March 2024

Baolin Li

Yankai Jiang

Devesh Tiwari

Papers citing "Toward Sustainable GenAI using Generation Directives for Carbon-Friendly Large Language Model Inference"

5 / 5 papers shown

Title
Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation Joy Mahapatra Utpal Garain 29 8 0 19 Jul 2024
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU Ying Sheng Lianmin Zheng Binhang Yuan Zhuohan Li Max Ryabinin ... Joseph E. Gonzalez Percy Liang Christopher Ré Ion Stoica Ce Zhang 138 365 0 13 Mar 2023
Ecovisor: A Virtual Energy System for Carbon-Efficient Applications Abel Souza Noman Bashir Jorge R. Murillo Walid A. Hanafy Qianlin Liang David E. Irwin Prashant J. Shenoy 38 36 0 10 Oct 2022
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering Pan Lu Swaroop Mishra Tony Xia Liang Qiu Kai-Wei Chang Song-Chun Zhu Oyvind Tafjord Peter Clark A. Kalyan ELM ReLM LRM 198 1,089 0 20 Sep 2022
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 236 626 0 21 Apr 2021