Clip21: Error Feedback for Gradient Clipping

30 May 2023

Papers citing "Clip21: Error Feedback for Gradient Clipping"

6 / 6 papers shown

Title
Smoothed Normalization for Efficient Distributed Private Optimization Egor Shulgin Sarit Khirirat Peter Richtárik FedML 82 0 0 20 Feb 2025
Loss Landscape Characterization of Neural Networks without Over-Parametrization Rustem Islamov Niccolò Ajroldi Antonio Orvieto Aurélien Lucchi 28 4 0 16 Oct 2024
Smoothed Gradient Clipping and Error Feedback for Distributed Optimization under Heavy-Tailed Noise Shuhua Yu D. Jakovetić S. Kar 22 1 0 25 Oct 2023
Towards a Better Theoretical Understanding of Independent Subnetwork Training Egor Shulgin Peter Richtárik AI4CE 16 6 0 28 Jun 2023
EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback Ilyas Fatkhullin Igor Sokolov Eduard A. Gorbunov Zhize Li Peter Richtárik 42 44 0 07 Oct 2021
Linearly Converging Error Compensated SGD Eduard A. Gorbunov D. Kovalev Dmitry Makarenko Peter Richtárik 158 77 0 23 Oct 2020