Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2402.03480
Cited By
Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision
5 February 2024
Nathaniel Hudson
J. G. Pauloski
Matt Baughman
Alok V. Kamatar
Mansi Sakarvadia
Logan T. Ward
Ryan Chard
André Bauer
Maksim Levental
Wenyi Wang
Will Engler
Owen Price Skelly
B. Blaiszik
Rick L. Stevens
Kyle Chard
Ian T. Foster
MedIm
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Trillion Parameter AI Serving Infrastructure for Scientific Discovery: A Survey and Vision"
8 / 8 papers shown
Title
MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI
Arya Tschand
Arun Tejusve Raghunath Rajan
S. Idgunji
Anirban Ghosh
J. Holleman
...
Rowan Taubitz
Sean Zhan
Scott Wasson
David Kanter
Vijay Janapa Reddi
55
2
0
15 Oct 2024
Attention Lens: A Tool for Mechanistically Interpreting the Attention Head Information Retrieval Mechanism
Mansi Sakarvadia
Arham Khan
Aswathy Ajith
Daniel Grzenda
Nathaniel Hudson
André Bauer
Kyle Chard
Ian T. Foster
172
9
0
25 Oct 2023
Dissecting Recall of Factual Associations in Auto-Regressive Language Models
Mor Geva
Jasmijn Bastings
Katja Filippova
Amir Globerson
KELM
189
260
0
28 Apr 2023
PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing
Xiaozhe Ren
Pingyi Zhou
Xinfan Meng
Xinjing Huang
Yadao Wang
...
Jiansheng Wei
Xin Jiang
Teng Su
Qun Liu
Jun Yao
ALM
MoE
53
59
0
20 Mar 2023
Interpretability in the Wild: a Circuit for Indirect Object Identification in GPT-2 small
Kevin Wang
Alexandre Variengien
Arthur Conmy
Buck Shlegeris
Jacob Steinhardt
210
486
0
01 Nov 2022
Zero-Shot Text-to-Image Generation
Aditya A. Ramesh
Mikhail Pavlov
Gabriel Goh
Scott Gray
Chelsea Voss
Alec Radford
Mark Chen
Ilya Sutskever
VLM
253
4,735
0
24 Feb 2021
funcX: A Federated Function Serving Fabric for Science
Ryan Chard
Y. Babuji
Zhuozhao Li
Tyler J. Skluzacek
A. Woodard
B. Blaiszik
Ian T. Foster
Kyle Chard
25
186
0
07 May 2020
Scaling Laws for Neural Language Models
Jared Kaplan
Sam McCandlish
T. Henighan
Tom B. Brown
B. Chess
R. Child
Scott Gray
Alec Radford
Jeff Wu
Dario Amodei
220
3,054
0
23 Jan 2020
1