Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM
Inference

Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference

29 March 2024

Jovan Stojkovic

Inigo Goiri

Josep Torrellas

Papers citing "Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference"

4 / 4 papers shown

Title
Green Prompting Marta Adamska Daria Smirnova Hamid Nasiri Zhengxin Yu Peter Garraghan 60 0 0 09 Mar 2025
CodEv: An Automated Grading Framework Leveraging Large Language Models for Consistent and Constructive Feedback En-Qi Tseng Pei-Cing Huang Chan Hsu Peng-Yi Wu Chan-Tung Ku Yihuang Kang 41 1 0 10 Jan 2025
MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI Arya Tschand Arun Tejusve Raghunath Rajan S. Idgunji Anirban Ghosh J. Holleman ... Rowan Taubitz Sean Zhan Scott Wasson David Kanter Vijay Janapa Reddi 55 2 0 15 Oct 2024
LLM in a flash: Efficient Large Language Model Inference with Limited Memory Keivan Alizadeh-Vahid Iman Mirzadeh Dmitry Belenko Karen Khatamifard Minsik Cho C. C. D. Mundo Mohammad Rastegari Mehrdad Farajtabar 70 104 0 12 Dec 2023