ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2205.05040
  4. Cited By
A Communication-Efficient Distributed Gradient Clipping Algorithm for
  Training Deep Neural Networks
v1v2 (latest)

A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks

Neural Information Processing Systems (NeurIPS), 2022
10 May 2022
Mingrui Liu
Zhenxun Zhuang
Yunwei Lei
Chunyang Liao
ArXiv (abs)PDFHTML

Papers citing "A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks"

14 / 14 papers shown
UCDSC: Open Set UnCertainty aware Deep Simplex Classifier for Medical Image Datasets
UCDSC: Open Set UnCertainty aware Deep Simplex Classifier for Medical Image Datasets
Arnav Aditya
Nitin Kumar
Saurabh J. Shigwan
90
0
0
11 Nov 2025
FedOne: Query-Efficient Federated Learning for Black-box Discrete Prompt Learning
FedOne: Query-Efficient Federated Learning for Black-box Discrete Prompt Learning
Ganyu Wang
Jinjie Fang
Maxwell J. Ying
Bin Gu
Xi Chen
Boyu Wang
Yi Chang
Charles Ling
FedML
277
1
0
17 Jun 2025
Efficient AllReduce with Stragglers
Efficient AllReduce with Stragglers
Arjun Devraj
Eric Ding
Abhishek Vijaya Kumar
Robert Kleinberg
Rachee Singh
266
0
0
29 May 2025
On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness
Xiaochuan Gong
Jie Hao
Mingrui Liu
327
1
0
05 Mar 2025
Smoothed Normalization for Efficient Distributed Private Optimization
Smoothed Normalization for Efficient Distributed Private Optimization
Egor Shulgin
Sarit Khirirat
Peter Richtárik
FedML
398
2
0
20 Feb 2025
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded SmoothnessInternational Conference on Machine Learning (ICML), 2024
Xiaochuan Gong
Jie Hao
Mingrui Liu
360
8
0
31 Dec 2024
Sketched Adaptive Federated Deep Learning: A Sharp Convergence Analysis
Sketched Adaptive Federated Deep Learning: A Sharp Convergence Analysis
Zhijie Chen
Qiaobo Li
A. Banerjee
FedML
468
1
0
11 Nov 2024
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded Smoothness
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded SmoothnessNeural Information Processing Systems (NeurIPS), 2024
Xiaochuan Gong
Jie Hao
Mingrui Liu
742
6
0
28 Sep 2024
Breaking MLPerf Training: A Case Study on Optimizing BERT
Breaking MLPerf Training: A Case Study on Optimizing BERT
Yongdeok Kim
Jaehyung Ahn
Myeongwoo Kim
Changin Choi
Heejae Kim
...
Xiongzhan Linghu
Jingkun Ma
Lin Chen
Yuehua Dai
Sungjoo Yoo
173
0
0
04 Feb 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and
  Convergence Analysis
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis
Jie Hao
Xiaochuan Gong
Mingrui Liu
329
11
0
17 Jan 2024
Clip21: Error Feedback for Gradient Clipping
Clip21: Error Feedback for Gradient Clipping
Sarit Khirirat
Eduard A. Gorbunov
Samuel Horváth
Rustem Islamov
Fakhri Karray
Peter Richtárik
238
16
0
30 May 2023
Revisiting Gradient Clipping: Stochastic bias and tight convergence
  guarantees
Revisiting Gradient Clipping: Stochastic bias and tight convergence guaranteesInternational Conference on Machine Learning (ICML), 2023
Anastasia Koloskova
Aymeric Dieuleveut
Sebastian U. Stich
454
86
0
02 May 2023
Variance-reduced Clipping for Non-convex Optimization
Variance-reduced Clipping for Non-convex OptimizationIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Amirhossein Reisizadeh
Haochuan Li
Subhro Das
Ali Jadbabaie
358
34
0
02 Mar 2023
EPISODE: Episodic Gradient Clipping with Periodic Resampled Corrections
  for Federated Learning with Heterogeneous Data
EPISODE: Episodic Gradient Clipping with Periodic Resampled Corrections for Federated Learning with Heterogeneous DataInternational Conference on Learning Representations (ICLR), 2023
M. Crawshaw
Yajie Bao
Mingrui Liu
FedML
201
10
0
14 Feb 2023
1