XEngine: Optimal Tensor Rematerialization for Neural Networks in Heterogeneous Environments

19 December 2022

Papers citing "XEngine: Optimal Tensor Rematerialization for Neural Networks in Heterogeneous Environments"

2 / 2 papers shown

Title
Mimose: An Input-Aware Checkpointing Planner for Efficient Training on GPU Jian-He Liao Mingzhen Li Qingxiao Sun Jiwei Hao F. Yu ... Ye Tao Zicheng Zhang Hailong Yang Zhongzhi Luan D. Qian 18 4 0 06 Sep 2022
ZeRO-Offload: Democratizing Billion-Scale Model Training Jie Ren Samyam Rajbhandari Reza Yazdani Aminabadi Olatunji Ruwase Shuangyang Yang Minjia Zhang Dong Li Yuxiong He MoE 160 413 0 18 Jan 2021