LLMCarbon: Modeling the end-to-end Carbon Footprint of Large Language Models

25 September 2023

Papers citing "LLMCarbon: Modeling the end-to-end Carbon Footprint of Large Language Models"

40 / 40 papers shown

Title
How Do Companies Manage the Environmental Sustainability of AI? An Interview Study About Green AI Efforts and Regulations Ashmita Sampatsing Sophie Vos Emma Beauxis-Aussalet Justus Bogner 18 0 0 12 May 2025
EnsembleCI: Ensemble Learning for Carbon Intensity Forecasting Leyi Yan Linda Wang Sihang Liu Yi Ding 41 0 0 04 May 2025
One Search Fits All: Pareto-Optimal Eco-Friendly Model Selection Filippo Betello Antonio Purificato Vittoria Vineis Gabriele Tolomei Fabrizio Silvestri 30 0 0 02 May 2025
Efficient LLMs with AMP: Attention Heads and MLP Pruning Leandro Giusti Mugnaini Bruno Yamamoto Lucas Lauton de Alcantara Victor Zacarias Edson Bollis Lucas Pellicer A. H. R. Costa Artur Jordao 37 0 0 29 Apr 2025
Carbon Footprint Evaluation of Code Generation through LLM as a Service Tina Vartziotis Maximilian Schmidt George Dasoulas Ippolyti Dellatolas Stefano Attademo Viet Dung Le Anke Wiechmann Tim Hoffmann Michael Keckeisen S. Kotsopoulos 31 2 0 30 Mar 2025
PLM: Efficient Peripheral Language Models Hardware-Co-Designed for Ubiquitous Computing Cheng Deng Luoyang Sun Jiwen Jiang Yongcheng Zeng Xinjian Wu ... Haoyang Li Lei Chen Lionel M. Ni H. Zhang Jun Wang 80 0 0 15 Mar 2025
Green Prompting Marta Adamska Daria Smirnova Hamid Nasiri Zhengxin Yu Peter Garraghan 78 0 0 09 Mar 2025
AOLO: Analysis and Optimization For Low-Carbon Oriented Wireless Large Language Model Services Xiaoqi Wang Hongyang Du Yuehong Gao Dong In Kim 66 0 0 06 Mar 2025
TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models Makoto Shing Kou Misaki Han Bao Sho Yokoi Takuya Akiba VLM 57 1 0 28 Jan 2025
Towards Sustainable Large Language Model Serving Sophia Nguyen Beihao Zhou Yi Ding Sihang Liu 84 7 0 31 Dec 2024
On the Ethical Considerations of Generative Agents Nýoma Diamond Soumya Banerjee 67 2 0 28 Nov 2024
JPPO: Joint Power and Prompt Optimization for Accelerated Large Language Model Services Feiran You Hongyang Du Kaibin Huang Abbas Jamalipour 64 2 0 27 Nov 2024
Layer Pruning with Consensus: A Triple-Win Solution Leandro Giusti Mugnaini Carolina Tavares Duarte Anna H. Reali Costa Artur Jordao 61 0 0 21 Nov 2024
Theoretical Investigations and Practical Enhancements on Tail Task Risk Minimization in Meta Learning Yiqin Lv Qi Wang Dong Liang Zheng Xie 36 2 0 30 Oct 2024
Cross-Modal Few-Shot Learning: a Generative Transfer Learning Framework Zhengwei Yang Yuke Li Qiang Sun Basura Fernando Heng-Chiao Huang Zheng Wang 23 1 0 14 Oct 2024
QERA: an Analytical Framework for Quantization Error Reconstruction Cheng Zhang Jeffrey T. H. Wong Can Xiao G. Constantinides Yiren Zhao MQ 35 0 0 08 Oct 2024
LLMCO2: Advancing Accurate Carbon Footprint Prediction for LLM Inferences Zhenxiao Fu Fan Chen Shan Zhou Haitong Li Lei Jiang 19 4 0 03 Oct 2024
Speculative Coreset Selection for Task-Specific Fine-tuning Xiaoyu Zhang Juan Zhai Shiqing Ma Chao Shen Tianlin Li Weipeng Jiang Yang Liu 30 1 0 02 Oct 2024
Tensor Train Low-rank Approximation (TT-LoRA): Democratizing AI with Accelerated LLMs Afia Anjum Maksim E. Eren V. Setlur Boian Alexandrov Manish Bhattarai 22 2 0 02 Aug 2024
DynamoLLM: Designing LLM Inference Clusters for Performance and Energy Efficiency Jovan Stojkovic Chaojie Zhang Íñigo Goiri Josep Torrellas Esha Choukse 35 29 0 01 Aug 2024
The Energy Cost of Artificial Intelligence Lifecycle in Communication Networks Shih-Kai Chou Jernej Hribar William Alberto Cruz Castañeda M. Mohorčič Carolina Fortuna 48 1 0 01 Aug 2024
Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation Joy Mahapatra Utpal Garain 29 8 0 19 Jul 2024
From Text to Life: On the Reciprocal Relationship between Artificial Life and Large Language Models Eleni Nisioti Claire Glanois Elias Najarro Andrew Dai Elliot Meyerson J. Pedersen Laetitia Teodorescu Conor F. Hayes Shyam Sudhakaran Sebastian Risi AI4CE LM&Ro 35 2 0 14 Jun 2024
Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models Meftahul Ferdaus Mahdi Abdelguerfi Elias Ioup Kendall N. Niles Ken Pathak Steve Sloan 32 10 0 01 Jun 2024
Effective Layer Pruning Through Similarity Metric Perspective Ian Pons Bruno Yamamoto Anna H. Reali Costa Artur Jordao 33 2 0 27 May 2024
OpenCarbonEval: A Unified Carbon Emission Estimation Framework in Large-Scale AI Models Zhaojian Yu Yinghao Wu Zhuotao Deng Yansong Tang Xiao-Ping Zhang 39 2 0 21 May 2024
Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunities Hao Zhou Chengming Hu Ye Yuan Yufei Cui Yili Jin ... Di Wu Xue Liu Charlie Zhang Xianbin Wang Jiangchuan Liu 30 55 0 17 May 2024
Simplicity within biological complexity Nataša Pržulj N. Malod-Dognin 27 0 0 15 May 2024
A Survey on Transformers in NLP with Focus on Efficiency Wazib Ansar Saptarsi Goswami Amlan Chakrabarti MedIm 27 2 0 15 May 2024
The Simpler The Better: An Entropy-Based Importance Metric To Reduce Neural Networks' Depth Victor Quétu Zhu Liao Enzo Tartaglione 25 4 0 27 Apr 2024
LLeMpower: Understanding Disparities in the Control and Access of Large Language Models Vishwas Sathish Hannah Lin Aditya K Kamath Anish Nyayachavadi 24 4 0 14 Apr 2024
SqueezeAttention: 2D Management of KV-Cache in LLM Inference via Layer-wise Optimal Budget Zihao Wang Shaoduo Gan 30 6 0 07 Apr 2024
Towards Greener LLMs: Bringing Energy-Efficiency to the Forefront of LLM Inference Jovan Stojkovic Esha Choukse Chaojie Zhang Inigo Goiri Josep Torrellas 33 33 0 29 Mar 2024
Toward Sustainable GenAI using Generation Directives for Carbon-Friendly Large Language Model Inference Baolin Li Yankai Jiang V. Gadepally Devesh Tiwari 27 14 0 19 Mar 2024
IoTCO2: Assessing the End-To-End Carbon Footprint of Internet-of-Things-Enabled Deep Learning Ahmad Faiz S. Attari Gayle Buck Fan Chen Lei Jiang 13 0 0 16 Mar 2024
SCARIF: Towards Carbon Modeling of Cloud Servers with Accelerators Shixin Ji Zhuoping Yang Xingzhen Chen Stephen Cahoon Jingtong Hu Yiyu Shi Alex K. Jones Peipei Zhou 8 5 0 11 Jan 2024
GLM-130B: An Open Bilingual Pre-trained Model Aohan Zeng Xiao Liu Zhengxiao Du Zihan Wang Hanyu Lai ... Jidong Zhai Wenguang Chen Peng-Zhen Zhang Yuxiao Dong Jie Tang BDL LRM 242 1,070 0 05 Oct 2022
Scalable and Efficient MoE Training for Multitask Multilingual Models Young Jin Kim A. A. Awan Alexandre Muzio Andres Felipe Cruz Salinas Liyang Lu Amr Hendy Samyam Rajbhandari Yuxiong He Hany Awadalla MoE 94 82 0 22 Sep 2021
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 239 626 0 21 Apr 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,424 0 23 Jan 2020