tf.data service: A Case for Disaggregating ML Input Data Processing

26 October 2022

Papers citing "tf.data service: A Case for Disaggregating ML Input Data Processing"

8 / 8 papers shown

Title
OVERLORD: Ultimate Scaling of DataLoader for Multi-Source Large Foundation Model Training Juntao Zhao Qi Lu Wei Jia Borui Wan Lei Zuo ... Y. Hu Yanghua Peng H. Lin Xin Liu Chuan Wu AI4CE 32 0 0 14 Apr 2025
Climate And Resource Awareness is Imperative to Achieving Sustainable AI (and Preventing a Global AI Arms Race) Pedram Bakhtiarifard Pınar Tözün Christian Igel Raghavendra Selvan 37 0 0 27 Feb 2025
Efficient Tabular Data Preprocessing of ML Pipelines Yu Zhu Wenqi Jiang Gustavo Alonso LMTD 13 1 0 23 Sep 2024
PreSto: An In-Storage Data Preprocessing System for Training Recommendation Models Yunjae Lee Hyeseong Kim Minsoo Rhu 24 0 0 11 Jun 2024
I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey Noah Lewis J. L. Bez Suren Byna 45 0 0 16 Apr 2024
Bullion: A Column Store for Machine Learning Gang Liao Ye Liu Jianjun Chen Daniel J. Abadi 21 5 0 13 Apr 2024
Characterization of Large Language Model Development in the Datacenter Qi Hu Zhisheng Ye Zerui Wang Guoteng Wang Mengdie Zhang ... Dahua Lin Xiaolin Wang Yingwei Luo Yonggang Wen Tianwei Zhang 32 40 0 12 Mar 2024
tf.data: A Machine Learning Data Processing Framework D. Murray Jiří Šimša Ana Klimovic Ihor Indyk PINN AI4CE LMTD 39 86 0 28 Jan 2021