Accordion: Adaptive Gradient Communication via Critical Learning Regime
Identification

Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification

29 October 2020

Saurabh Agarwal

Shivaram Venkataraman

Dimitris Papailiopoulos

Papers citing "Accordion: Adaptive Gradient Communication via Critical Learning Regime Identification"

6 / 6 papers shown

Title
Kimad: Adaptive Gradient Compression with Bandwidth Awareness Jihao Xin Ivan Ilin Shunkang Zhang Marco Canini Peter Richtárik 28 2 0 13 Dec 2023
Accelerating Distributed ML Training via Selective Synchronization S. Tyagi Martin Swany FedML 24 3 0 16 Jul 2023
Adaptive Compression for Communication-Efficient Distributed Training Maksim Makarenko Elnur Gasanov Rustem Islamov Abdurakhmon Sadiev Peter Richtárik 10 12 0 31 Oct 2022
Solon: Communication-efficient Byzantine-resilient Distributed Training via Redundant Gradients Lingjiao Chen Leshang Chen Hongyi Wang S. Davidson Edgar Dobriban FedML 19 1 0 04 Oct 2021
Rethinking gradient sparsification as total error minimization Atal Narayan Sahu Aritra Dutta A. Abdelmoniem Trambak Banerjee Marco Canini Panos Kalnis 35 54 0 02 Aug 2021
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,878 0 15 Sep 2016