EPISODE: Episodic Gradient Clipping with Periodic Resampled Corrections
for Federated Learning with Heterogeneous Data

EPISODE: Episodic Gradient Clipping with Periodic Resampled Corrections for Federated Learning with Heterogeneous Data

International Conference on Learning Representations (ICLR), 2023

14 February 2023

ArXiv (abs)PDF HTML

Papers citing "EPISODE: Episodic Gradient Clipping with Periodic Resampled Corrections for Federated Learning with Heterogeneous Data"

6 / 6 papers shown

Title
On the Convergence of Adam-Type Algorithm for Bilevel Optimization under Unbounded Smoothness Xiaochuan Gong Jie Hao Mingrui Liu 268 1 0 05 Mar 2025
Smoothed Normalization for Efficient Distributed Private Optimization Egor Shulgin Sarit Khirirat Peter Richtárik FedML 364 0 0 20 Feb 2025
A Nearly Optimal Single Loop Algorithm for Stochastic Bilevel Optimization under Unbounded SmoothnessInternational Conference on Machine Learning (ICML), 2024 Xiaochuan Gong Jie Hao Mingrui Liu 323 8 0 31 Dec 2024
Lion Cub: Minimizing Communication Overhead in Distributed Lion Satoki Ishikawa Tal Ben-Nun B. Van Essen Rio Yokota Nikoli Dryden 374 1 0 25 Nov 2024
An Accelerated Algorithm for Stochastic Bilevel Optimization under Unbounded SmoothnessNeural Information Processing Systems (NeurIPS), 2024 Xiaochuan Gong Jie Hao Mingrui Liu 689 6 0 28 Sep 2024
Bilevel Optimization under Unbounded Smoothness: A New Algorithm and Convergence Analysis Jie Hao Xiaochuan Gong Mingrui Liu 246 11 0 17 Jan 2024