HET: Scaling out Huge Embedding Model Training via Cache-enabled
Distributed Framework

HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework

14 December 2021

Xiaonan Nie

Papers citing "HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework"

13 / 13 papers shown

Title
ElasticRec: A Microservice-based Model Serving Architecture Enabling Elastic Resource Scaling for Recommendation Models Yujeong Choi Jiin Kim Minsoo Rhu 37 1 0 11 Jun 2024
NeutronStream: A Dynamic GNN Training Framework with Sliding Window for Graph Streams Chaoyi Chen Dechao Gao Yanfeng Zhang Qiange Wang Zhenbo Fu Xuecang Zhang Junhua Zhu Yu Gu Ge Yu GNN 35 5 0 05 Dec 2023
OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning Youhe Jiang Fangcheng Fu Xupeng Miao Xiaonan Nie Bin Cui 31 11 0 17 May 2023
Angel-PTM: A Scalable and Economical Large-scale Pre-training System in Tencent Xiaonan Nie Yi Liu Fangcheng Fu J. Xue Dian Jiao Xupeng Miao Yangyu Tao Bin Cui MoE 24 16 0 06 Mar 2023
Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism Xupeng Miao Yujie Wang Youhe Jiang Chunan Shi Xiaonan Nie Hailin Zhang Bin Cui GNN MoE 32 60 0 25 Nov 2022
A Frequency-aware Software Cache for Large Recommendation System Embeddings Jiarui Fang Geng Zhang Jiatong Han Shenggui Li Zhengda Bian Yongbin Li Jin Liu Yang You 21 3 0 08 Aug 2022
Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates Fangcheng Fu Xupeng Miao Jiawei Jiang Huanran Xue Bin Cui FedML 22 21 0 29 Jul 2022
BlindFL: Vertical Federated Machine Learning without Peeking into Your Data Fangcheng Fu Huanran Xue Yong Cheng Yangyu Tao Bin Cui FedML 16 59 0 16 Jun 2022
CowClip: Reducing CTR Prediction Model Training Time from 12 hours to 10 minutes on 1 GPU Zangwei Zheng Peng Xu Xuan Zou Da Tang Zhen Li ... Xiangzhuo Ding Fuzhao Xue Ziheng Qing Youlong Cheng Yang You VLM 39 7 0 13 Apr 2022
PICASSO: Unleashing the Potential of GPU-centric Training for Wide-and-deep Recommender Systems Yuanxing Zhang Langshi Chen Siran Yang Man Yuan Hui-juan Yi ... Yong Li Dingyang Zhang Wei Lin Lin Qu Bo Zheng 30 32 0 11 Apr 2022
BagPipe: Accelerating Deep Recommendation Model Training Saurabh Agarwal Chengpo Yan Ziyi Zhang Shivaram Venkataraman 24 17 0 24 Feb 2022
Distributed Hierarchical GPU Parameter Server for Massive Scale Deep Learning Ads Systems Weijie Zhao Deping Xie Ronglai Jia Yulei Qian Rui Ding Mingming Sun P. Li MoE 59 150 0 12 Mar 2020
Efficient Estimation of Word Representations in Vector Space Tomáš Mikolov Kai Chen G. Corrado J. Dean 3DV 239 31,257 0 16 Jan 2013