Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2204.05149
Cited By
The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink
11 April 2022
David A. Patterson
Joseph E. Gonzalez
Urs Holzle
Quoc V. Le
Chen Liang
Lluís-Miquel Munguía
D. Rothchild
David R. So
Maud Texier
J. Dean
AI4CE
Re-assign community
ArXiv (abs)
PDF
HTML
HuggingFace (9 upvotes)
Papers citing
"The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink"
50 / 136 papers shown
AI-focused HPC Data Centers Can Provide More Power Grid Flexibility and at Lower Cost
Yihong Zhou
Angel Paredes
Chaimaa Essayeh
Thomas Morstyn
116
5
0
22 Oct 2024
Ethics Whitepaper: Whitepaper on Ethical Research into Large Language Models
Eddie L. Ungless
Nikolas Vitsakis
Zeerak Talat
James Garforth
Bjorn Ross
Arno Onken
Atoosa Kasirzadeh
Alexandra Birch
262
3
0
17 Oct 2024
TensorSocket: Shared Data Loading for Deep Learning Training
Ties Robroek
Neil Kim Nielsen
Pınar Tözün
398
2
0
27 Sep 2024
LUT Tensor Core: A Software-Hardware Co-Design for LUT-Based Low-Bit LLM Inference
International Symposium on Computer Architecture (ISCA), 2024
Zhiwen Mo
Lei Wang
Jianyu Wei
Zhichen Zeng
Shijie Cao
...
Naifeng Jing
Ting Cao
Jilong Xue
Fan Yang
Mao Yang
346
4
0
12 Aug 2024
Computing Within Limits: An Empirical Study of Energy Consumption in ML Training and Inference
Ioannis Mavromatis
Kostas Katsaros
Aftab Khan
191
10
0
20 Jun 2024
Beyond Efficiency: Scaling AI Sustainably
IEEE Micro (IEEE Micro), 2024
Carole-Jean Wu
Bilge Acun
Ramya Raghavendra
Kim Hazelwood
GNN
236
25
0
08 Jun 2024
Building Socially-Equitable Public Models
Yejia Liu
Jianyi Yang
Pengfei Li
Tongxin Li
Shaolei Ren
OffRL
287
0
0
04 Jun 2024
Exploring Effects of Hyperdimensional Vectors for Tsetlin Machines
Vojtech Halenka
Ahmed K. Kadhim
Paul F. A. Clarke
Bimal Bhattarai
Rupsa Saha
Ole-Christoffer Granmo
Lei Jiao
Per-Arne Andersen
302
5
0
04 Jun 2024
Carbon Connect: An Ecosystem for Sustainable Computing
Benjamin C. Lee
David Brooks
Arthur van Benthem
Udit Gupta
G. Hills
...
Emma Strubell
Gu-Yeon Wei
Adam Wierman
Yuan Yao
Minlan Yu
178
5
0
22 May 2024
Sociotechnical Implications of Generative Artificial Intelligence for Information Access
Bhaskar Mitra
Henriette Cramer
Olya Gurevich
297
10
0
19 May 2024
Efficient Deep Learning with Decorrelated Backpropagation
Sander Dalm
Joshua Offergeld
Nasir Ahmad
Marcel van Gerven
757
8
0
03 May 2024
Lessons from the Use of Natural Language Inference (NLI) in Requirements Engineering Tasks
Mohamad Fazelnia
Viktoria Koscinski
Spencer Herzog
Mehdi Mirakhorli
231
16
0
24 Apr 2024
Lightweight Inference for Forward-Forward Algorithm
Amin Aminifar
Baichuan Huang
Azra Abtahi
Amir Aminifar
504
4
0
08 Apr 2024
Toward Sustainable GenAI using Generation Directives for Carbon-Friendly Large Language Model Inference
Baolin Li
Yankai Jiang
V. Gadepally
Devesh Tiwari
241
22
0
19 Mar 2024
MELTing point: Mobile Evaluation of Language Transformers
Stefanos Laskaridis
Kleomenis Katevas
Lorenzo Minto
Hamed Haddadi
301
34
0
19 Mar 2024
EncodingNet: A Novel Encoding-based MAC Design for Efficient Neural Network Acceleration
Bo Liu
Grace Li Zhang
Xunzhao Yin
Ulf Schlichtmann
Bing Li
MQ
AI4CE
213
0
0
25 Feb 2024
Towards Physical Plausibility in Neuroevolution Systems
Gabriel Cortes
Nuno Lourenço
Penousal Machado
198
4
0
31 Jan 2024
Information-Theoretic State Variable Selection for Reinforcement Learning
Charles Westphal
Stephen Hailes
Mirco Musolesi
235
4
0
21 Jan 2024
Computational Argumentation-based Chatbots: a Survey
Federico Castagna
Nadin Kökciyan
I. Sassoon
Simon Parsons
Elizabeth I. Sklar
317
16
0
07 Jan 2024
The Power of Training: How Different Neural Network Setups Influence the Energy Demand
ARCS (ARCS), 2024
Daniel Geissler
Bo Zhou
Mengxi Liu
Sungho Suh
P. Lukowicz
229
15
0
03 Jan 2024
AutoXPCR: Automated Multi-Objective Model Selection for Time Series Forecasting
Raphael Fischer
Amal Saadallah
237
5
0
20 Dec 2023
Climate Change from Large Language Models
Hongyin Zhu
Prayag Tiwari
ELM
254
10
0
19 Dec 2023
Adaptive Computation Modules: Granular Conditional Computation For Efficient Inference
AAAI Conference on Artificial Intelligence (AAAI), 2023
Bartosz Wójcik
Alessio Devoto
Karol Pustelnik
Pasquale Minervini
Simone Scardapane
285
7
0
15 Dec 2023
Part-time Power Measurements: nvidia-smi's Lack of Attention
International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2023
Zeyu Yang
Karel Adámek
Wesley Armour
220
25
0
05 Dec 2023
Power Hungry Processing: Watts Driving the Cost of AI Deployment?
Conference on Fairness, Accountability and Transparency (FAccT), 2023
Sasha Luccioni
Yacine Jernite
Emma Strubell
411
309
0
28 Nov 2023
Energy and Carbon Considerations of Fine-Tuning BERT
Xiaorong Wang
Clara Na
Emma Strubell
Sorelle A. Friedler
Sasha Luccioni
222
21
0
17 Nov 2023
AI-native Interconnect Framework for Integration of Large Language Model Technologies in 6G Systems
Sasu Tarkoma
Roberto Morabito
Jaakko Sauvola
357
32
0
10 Nov 2023
MAD Max Beyond Single-Node: Enabling Large Machine Learning Model Acceleration on Distributed Systems
International Symposium on Computer Architecture (ISCA), 2023
Samuel Hsia
Alicia Golden
Bilge Acun
Newsha Ardalani
Zach DeVito
Gu-Yeon Wei
David Brooks
Carole-Jean Wu
MoE
342
14
0
04 Oct 2023
Benchmarking and In-depth Performance Study of Large Language Models on Habana Gaudi Processors
Chengming Zhang
Baixi Sun
Xiaodong Yu
Zhen Xie
Weijian Zheng
K. Iskra
Pete Beckman
Dingwen Tao
137
7
0
29 Sep 2023
Carbon Containers: A System-level Facility for Managing Application-level Carbon Emissions
ACM Symposium on Cloud Computing (SoCC), 2023
John Thiede
Noman Bashir
David Irwin
Prashant J. Shenoy
160
16
0
25 Sep 2023
LLMCarbon: Modeling the end-to-end Carbon Footprint of Large Language Models
International Conference on Learning Representations (ICLR), 2023
Ahmad Faiz
S. Kaneda
Ruhan Wang
Rita Osi
Parteek Sharma
Fan Chen
Lei Jiang
289
108
0
25 Sep 2023
Large language models can accurately predict searcher preferences
Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023
Paul Thomas
S. Spielman
Nick Craswell
Bhaskar Mitra
ALM
LRM
406
224
0
19 Sep 2023
Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI
Communications of the ACM (CACM), 2023
Dustin Wright
Christian Igel
Gabrielle Samuel
Raghavendra Selvan
446
24
0
05 Sep 2023
Energy Concerns with HPC Systems and Applications
Roblex Nana
C. Tadonki
Petr Dokladal
Youssef Mesri
188
0
0
31 Aug 2023
Maestro: Uncovering Low-Rank Structures via Trainable Decomposition
International Conference on Machine Learning (ICML), 2023
Samuel Horváth
Stefanos Laskaridis
Shashank Rajput
Hongyi Wang
BDL
353
9
0
28 Aug 2023
POLCA: Power Oversubscription in LLM Cloud Providers
Pratyush Patel
Esha Choukse
Chaojie Zhang
Íñigo Goiri
Brijesh Warrier
Nithish Mahalingam
Ricardo Bianchini
138
17
0
24 Aug 2023
Batching for Green AI -- An Exploratory Study on Inference
EUROMICRO Conference on Software Engineering and Advanced Applications (EUROMICRO SEAA), 2023
Tim Yarally
Luís Cruz
Daniel Feitosa
June Sallou
A. V. Deursen
192
5
0
21 Jul 2023
TinyTrain: Resource-Aware Task-Adaptive Sparse Training of DNNs at the Data-Scarce Edge
International Conference on Machine Learning (ICML), 2023
Young D. Kwon
Rui Li
Stylianos I. Venieris
Jagmohan Chauhan
Nicholas D. Lane
Cecilia Mascolo
267
20
0
19 Jul 2023
Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluation
Hao Peng
Qingqing Cao
Jesse Dodge
Matthew E. Peters
Jared Fernandez
...
Darrell Plessas
Iz Beltagy
Evan Pete Walsh
Noah A. Smith
Hannaneh Hajishirzi
159
8
0
19 Jul 2023
LogPrécis: Unleashing Language Models for Automated Malicious Log Analysis
Computers & security (Comput. Secur.), 2023
Matteo Boffa
R. Valentim
L. Vassio
Danilo Giordano
Idilio Drago
Marco Mellia
Zied Ben-Houidi
296
17
0
17 Jul 2023
No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models
Neural Information Processing Systems (NeurIPS), 2023
Jean Kaddour
Oscar Key
Piotr Nawrot
Pasquale Minervini
Matt J. Kusner
427
58
0
12 Jul 2023
A Comparative Study of Machine Learning Algorithms for Anomaly Detection in Industrial Environments: Performance and Environmental Impact
Álvaro Huertas-García
Carlos Martí-González
Rubén García Maezo
Alejandro Echeverría Rey
143
9
0
01 Jul 2023
The War of the Efficiencies: Understanding the Tension between Carbon and Energy Optimization
Walid A. Hanafy
Roozbeh Bostandoost
Noman Bashir
David Irwin
Mohammad Hajiesmaili
Prashant J. Shenoy
167
23
0
29 Jun 2023
Surveying (Dis)Parities and Concerns of Compute Hungry NLP Research
Ji-Ung Lee
Haritz Puerto
Betty van Aken
Yuki Arase
Jessica Zosa Forde
...
Andreas Rucklé
Iryna Gurevych
Roy Schwartz
Emma Strubell
Jesse Dodge
270
7
0
29 Jun 2023
Broadening the perspective for sustainable AI: Comprehensive sustainability criteria and indicators for AI systems
Friederike Rohde
Josephin Wagner
A. Meyer
Philipp Reinhard
Marcus Voss
U. Petschow
Anne Mollen
181
5
0
22 Jun 2023
Towards Environmentally Equitable AI via Geographical Load Balancing
Energy-Efficient Computing and Networking (e-Energy), 2023
Pengfei Li
Jianyi Yang
Adam Wierman
Shaolei Ren
248
23
0
20 Jun 2023
[Experiments & Analysis] Evaluating the Feasibility of Sampling-Based Techniques for Training Multilayer Perceptrons
International Conference on Extending Database Technology (EDBT), 2023
Sana Ebrahimi
Rishi Advani
Abolfazl Asudeh
207
0
0
15 Jun 2023
High-performance deep spiking neural networks with 0.3 spikes per neuron
Nature Communications (Nat. Commun.), 2023
A. Stanojević
Stanislaw Wo'zniak
G. Bellec
G. Cherubini
A. Pantazi
W. Gerstner
318
49
0
14 Jun 2023
FedZero: Leveraging Renewable Excess Energy in Federated Learning
Energy-Efficient Computing and Networking (e-Energy), 2023
Philipp Wiesner
R. Khalili
Dennis Grinwald
Pratik Agrawal
L. Thamsen
O. Kao
238
36
0
24 May 2023
Has It All Been Solved? Open NLP Research Questions Not Solved by Large Language Models
International Conference on Language Resources and Evaluation (LREC), 2023
Oana Ignat
Zhijing Jin
Artem Abzaliev
Laura Biester
Santiago Castro
...
Verónica Pérez-Rosas
Siqi Shen
Zekun Wang
Winston Wu
Amélie Reymond
LRM
320
8
0
21 May 2023
Previous
1
2
3
Next
![[Experiments & Analysis] Evaluating the Feasibility of Sampling-Based
Techniques for Training Multilayer Perceptrons](https://cdn.parameterlab.de/resized-images/aHR0cHM6Ly9jZG4ucGFyYW1ldGVybGFiLmRlL3BhcGVycy8yMzA2LjA5MjkzL3BhZ2VzL3BhZ2UtMS1xODBkMzAwLmpwZw?w=256&q=75&f=webp)
