ROAM: memory-efficient large DNN training via optimized operator
ordering and memory layout

ROAM: memory-efficient large DNN training via optimized operator ordering and memory layout

30 October 2023

Ziji Shi

Yong Li

Papers citing "ROAM: memory-efficient large DNN training via optimized operator ordering and memory layout"

4 / 4 papers shown

Title
ZeRO-Offload: Democratizing Billion-Scale Model Training Jie Ren Samyam Rajbhandari Reza Yazdani Aminabadi Olatunji Ruwase Shuangyang Yang Minjia Zhang Dong Li Yuxiong He MoE 160 413 0 18 Jan 2021
ProGraML: Graph-based Deep Learning for Program Optimization and Analysis Chris Cummins Zacharias V. Fisches Tal Ben-Nun Torsten Hoefler Hugh Leather 85 56 0 23 Mar 2020
Ordering Chaos: Memory-Aware Scheduling of Irregularly Wired Neural Networks for Edge Devices Byung Hoon Ahn Jinwon Lee J. Lin Hsin-Pai Cheng Jilei Hou H. Esmaeilzadeh 62 54 0 04 Mar 2020
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications Andrew G. Howard Menglong Zhu Bo Chen Dmitry Kalenichenko Weijun Wang Tobias Weyand M. Andreetto Hartwig Adam 3DH 950 20,561 0 17 Apr 2017