An Efficient Statistical-based Gradient Compression Technique for Distributed Training Systems

26 January 2021

Papers citing "An Efficient Statistical-based Gradient Compression Technique for Distributed Training Systems"

5 / 5 papers shown

Title
Novel Gradient Sparsification Algorithm via Bayesian Inference Ali Bereyhi B. Liang G. Boudreau Ali Afana 26 2 0 23 Sep 2024
Meta-Learning with a Geometry-Adaptive Preconditioner Suhyun Kang Duhun Hwang Moonjung Eo Taesup Kim Wonjong Rhee AI4CE 17 15 0 04 Apr 2023
AI-based Fog and Edge Computing: A Systematic Review, Taxonomy and Future Directions Sundas Iftikhar S. Gill Chenghao Song Minxian Xu M. Aslanpour ... Félix Cuadrado Blesson Varghese Omer F. Rana Schahram Dustdar Steve Uhlig 34 130 0 09 Dec 2022
Rethinking gradient sparsification as total error minimization Atal Narayan Sahu Aritra Dutta A. Abdelmoniem Trambak Banerjee Marco Canini Panos Kalnis 25 53 0 02 Aug 2021
Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism M. Shoeybi M. Patwary Raul Puri P. LeGresley Jared Casper Bryan Catanzaro MoE 243 1,791 0 17 Sep 2019