Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model

3 November 2022

Papers citing "Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model"

29 / 29 papers shown

Title
How Do Companies Manage the Environmental Sustainability of AI? An Interview Study About Green AI Efforts and Regulations Ashmita Sampatsing Sophie Vos Emma Beauxis-Aussalet Justus Bogner 20 0 0 12 May 2025
OBLIVIATE: Robust and Practical Machine Unlearning for Large Language Models Xiaoyu Xu Minxin Du Qingqing Ye Haibo Hu MU 52 0 0 07 May 2025
Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models Chuan Sun Han Yu Lizhen Cui Xiaoxiao Li 48 0 0 03 May 2025
Green Prompting Marta Adamska Daria Smirnova Hamid Nasiri Zhengxin Yu Peter Garraghan 105 0 0 09 Mar 2025
TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models Makoto Shing Kou Misaki Han Bao Sho Yokoi Takuya Akiba VLM 57 1 0 28 Jan 2025
Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goals Qingyang Wu Ying Xu Tingsong Xiao Yunze Xiao Yitong Li ... Yichi Zhang Shanghai Zhong Yuwei Zhang Wei Lu Yifan Yang 73 1 0 17 Jan 2025
Self-calibration for Language Model Quantization and Pruning Miles Williams G. Chrysostomou Nikolaos Aletras MQ 75 0 0 22 Oct 2024
Benchmarking Defeasible Reasoning with Large Language Models -- Initial Experiments and Future Directions Ilias Tachmazidis Sotiris Batsakis G. Antoniou ReLM LRM 13 0 0 16 Oct 2024
The Energy Cost of Artificial Intelligence Lifecycle in Communication Networks Shih-Kai Chou Jernej Hribar William Alberto Cruz Castañeda M. Mohorčič Carolina Fortuna 48 1 0 01 Aug 2024
Impact of Model Size on Fine-tuned LLM Performance in Data-to-Text Generation: A State-of-the-Art Investigation Joy Mahapatra Utpal Garain 29 8 0 19 Jul 2024
HORAE: A Domain-Agnostic Language for Automated Service Regulation Yutao Sun Mingshuai Chen Tiancheng Zhao Kangjia Zhao He Li ... Zhongyi Wang Liqiang Lu Shuiguang Deng Jianwei Yin Jianwei Yin 84 0 0 06 Jun 2024
Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment Abhinav Agarwalla Abhay Gupta Alexandre Marques Shubhra Pandit Michael Goin ... Tuan Nguyen Mahmoud Salem Dan Alistarh Sean Lie Mark Kurtz MoE SyDa 33 11 0 06 May 2024
Investigating Continual Pretraining in Large Language Models: Insights and Implications cCaugatay Yildiz Nishaanth Kanna Ravichandran Prishruit Punia Matthias Bethge B. Ermiş CLL KELM LRM 46 25 0 27 Feb 2024
CroissantLLM: A Truly Bilingual French-English Language Model Manuel Faysse Patrick Fernandes Nuno M. Guerreiro António Loison Duarte M. Alves ... François Yvon André F.T. Martins Gautier Viaud C´eline Hudelot Pierre Colombo 43 33 0 01 Feb 2024
Power Hungry Processing: Watts Driving the Cost of AI Deployment? Sasha Luccioni Yacine Jernite Emma Strubell 33 159 0 28 Nov 2023
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity Lu Yin You Wu Zhenyu (Allen) Zhang Cheng-Yu Hsieh Yaqing Wang ... Mykola Pechenizkiy Yi Liang Michael Bendersky Zhangyang Wang Shiwei Liu 20 78 0 08 Oct 2023
Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI Dustin Wright Christian Igel Gabrielle Samuel Raghavendra Selvan 25 15 0 05 Sep 2023
ADLER -- An efficient Hessian-based strategy for adaptive learning rate Dario Balboni D. Bacciu ODL 14 0 0 25 May 2023
GPT-SW3: An Autoregressive Language Model for the Nordic Languages Ariel Ekgren Amaru Cuba Gyllensten Felix Stollenwerk Joey Öhman T. Isbister Evangelia Gogoulou F. Carlsson Alice Heiman Judit Casademont Magnus Sahlgren 21 13 0 22 May 2023
Using Language Models to Detect Alarming Student Responses Christopher M. Ormerod Milan Patel Harry Wang 24 0 0 12 May 2023
ChatGPT Needs SPADE (Sustainability, PrivAcy, Digital divide, and Ethics) Evaluation: A Review Sunder Ali Khowaja P. Khuwaja K. Dev Weizheng Wang Lewis Nkenyereye 22 75 0 13 Apr 2023
Making AI Less "Thirsty": Uncovering and Addressing the Secret Water Footprint of AI Models Pengfei Li Jianyi Yang M. A. Islam Shaolei Ren 81 115 0 06 Apr 2023
How Efficient Are Today's Continual Learning Algorithms? Md Yousuf Harun Jhair Gallardo Tyler L. Hayes Christopher Kanan 11 22 0 29 Mar 2023
Counting Carbon: A Survey of Factors Influencing the Emissions of Machine Learning A. Luccioni Alex Hernandez-Garcia 19 45 0 16 Feb 2023
Demystifying Prompts in Language Models via Perplexity Estimation Hila Gonen Srini Iyer Terra Blevins Noah A. Smith Luke Zettlemoyer LRM 25 194 0 08 Dec 2022
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model BigScience Workshop : Teven Le Scao Angela Fan Christopher Akiki ... Zhongli Xie Zifan Ye M. Bras Younes Belkada Thomas Wolf VLM 68 2,301 0 09 Nov 2022
What Language Model to Train if You Have One Million GPU Hours? Teven Le Scao Thomas Wang Daniel Hesslow Lucile Saulnier Stas Bekman ... Lintang Sutawika Jaesung Tae Zheng-Xin Yong Julien Launay Iz Beltagy MoE AI4CE 225 103 0 27 Oct 2022
Towards Quantifying the Carbon Emissions of Differentially Private Machine Learning Rakshit Naidu Harshita Diddee Ajinkya Mulay Aleti Vardhan Krithika Ramesh Ahmed S. Zamzam 29 14 0 14 Jul 2021
Carbon Emissions and Large Neural Network Training David A. Patterson Joseph E. Gonzalez Quoc V. Le Chen Liang Lluís-Miquel Munguía D. Rothchild David R. So Maud Texier J. Dean AI4CE 239 642 0 21 Apr 2021