Distributed Stochastic Gradient Tracking Methods

25 May 2018

Papers citing "Distributed Stochastic Gradient Tracking Methods"

50 / 117 papers shown

Title
Decentralized Nonconvex Composite Federated Learning with Gradient Tracking and Momentum Yuan Zhou Xinli Shi Xuelong Li Jiachen Zhong G. Wen Jinde Cao FedML 53 0 0 17 Apr 2025
PDSL: Privacy-Preserved Decentralized Stochastic Learning with Heterogeneous Data Distribution Lina Wang Yunsheng Yuan Chunxiao Wang Feng Li FedML 48 0 0 31 Mar 2025
Distributed Learning over Arbitrary Topology: Linear Speed-Up with Polynomial Transient Time Runze You Shi Pu 44 0 0 20 Mar 2025
RAMEN: Real-time Asynchronous Multi-agent Neural Implicit Mapping Hongrui Zhao Boris Ivanovic Negar Mehr 98 0 0 26 Feb 2025
A Bias-Correction Decentralized Stochastic Gradient Algorithm with Momentum Acceleration Yuchen Hu Xi Chen Weidong Liu Xiaojun Mao 67 0 0 31 Jan 2025
Scalable Decentralized Learning with Teleportation Yuki Takezawa Sebastian U. Stich 74 1 0 25 Jan 2025
ROSS:RObust decentralized Stochastic learning based on Shapley values Lina Wang Yunsheng Yuan Feng Li Lingjie Duan FedML 52 0 0 01 Nov 2024
Fully First-Order Methods for Decentralized Bilevel Optimization Xiaoyu Wang Xuxing Chen Shiqian Ma Tong Zhang 45 0 0 25 Oct 2024
Fully Stochastic Primal-dual Gradient Algorithm for Non-convex Optimization on Random Graphs Chung-Yiu Yau Haoming Liu Hoi-To Wai 34 0 0 24 Oct 2024
Single Point-Based Distributed Zeroth-Order Optimization with a Non-Convex Stochastic Objective Function Elissa Mhanna Mohamad Assaad 61 4 0 08 Oct 2024
Distributed NeRF Learning for Collaborative Multi-Robot Perception Hongrui Zhao Boris Ivanovic Negar Mehr 41 1 0 30 Sep 2024
Decentralized Federated Learning with Gradient Tracking over Time-Varying Directed Networks Duong Thuy Anh Nguyen Su Wang Duong Tung Nguyen Angelia Nedich H. Vincent Poor 42 0 0 25 Sep 2024
Fast Distributed Optimization over Directed Graphs under Malicious Attacks using Trust Arif Kerem Dayı Orhan Eren Akgün Stephanie Gil Michal Yemini Angelia Nedić 44 1 0 09 Jul 2024
Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps Junchi Yang Murat Yildirim Qiu Feng 57 0 0 02 Jul 2024
Achieving Near-Optimal Convergence for Distributed Minimax Optimization with Adaptive Stepsizes Yan Huang Xiang Li Yipeng Shen Niao He Jinming Xu 51 1 0 05 Jun 2024
A finite time analysis of distributed Q-learning Han-Dong Lim Donghwan Lee OffRL 57 0 0 23 May 2024
Robust Decentralized Learning with Local Updates and Gradient Tracking Sajjad Ghiasvand Amirhossein Reisizadeh Mahnoosh Alizadeh Ramtin Pedarsani 47 3 0 02 May 2024
DIMAT: Decentralized Iterative Merging-And-Training for Deep Learning Models Nastaran Saadati Minh Pham Nasla Saleem Joshua R. Waite Aditya Balu Zhanhong Jiang Chinmay Hegde Soumik Sarkar MoMe 52 1 0 11 Apr 2024
FedNMUT -- Federated Noisy Model Update Tracking Convergence Analysis Vishnu Pandi Chellapandi Antesh Upadhyay Abolfazl Hashemi Stanislaw H. .Zak FedML 35 2 0 20 Mar 2024
Convergence of Decentralized Stochastic Subgradient-based Methods for Nonsmooth Nonconvex functions Siyuan Zhang Nachuan Xiao Xin Liu 61 1 0 18 Mar 2024
Decentralized and Lifelong-Adaptive Multi-Agent Collaborative Learning Shuo Tang Rui Ye Chenxin Xu Xiaowen Dong Siheng Chen Yanfeng Wang 49 0 0 11 Mar 2024
MUSIC: Accelerated Convergence for Distributed Optimization With Inexact and Exact Methods Mou Wu Haibin Liao Zhengtao Ding Yonggang Xiao 31 2 0 05 Mar 2024
An Accelerated Distributed Stochastic Gradient Method with Momentum Kun-Yen Huang Shi Pu Angelia Nedić 35 8 0 15 Feb 2024
Problem-Parameter-Free Decentralized Nonconvex Stochastic Optimization Jiaxiang Li Xuxing Chen Shiqian Ma Mingyi Hong ODL 23 2 0 13 Feb 2024
Communication-Efficient Federated Optimization over Semi-Decentralized Networks He Wang Yuejie Chi FedML 44 2 0 30 Nov 2023
A Single-Loop Algorithm for Decentralized Bilevel Optimization Youran Dong Shiqian Ma Junfeng Yang Chao Yin 39 7 0 15 Nov 2023
Compressed and Sparse Models for Non-Convex Decentralized Learning Andrew Campbell Hang Liu Leah Woldemariam Anna Scaglione 28 0 0 09 Nov 2023
Locally Differentially Private Gradient Tracking for Distributed Online Learning over Directed Graphs Ziqin Chen Yongqiang Wang FedML 32 2 0 24 Oct 2023
DePAint: A Decentralized Safe Multi-Agent Reinforcement Learning Algorithm considering Peak and Average Constraints Raheeb Hassan K. M. S. Wadith Md. Mamun-or Rashid Md. Mosaddek Khan 35 2 0 22 Oct 2023
Revisiting Decentralized ProxSkip: Achieving Linear Speedup Luyao Guo Sulaiman A. Alghunaim Kun Yuan Laurent Condat Jinde Cao FedML 41 1 0 12 Oct 2023
Federated Multi-Level Optimization over Decentralized Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang AI4CE 28 0 0 10 Oct 2023
A primal-dual perspective for distributed TD-learning Han-Dong Lim Donghwan Lee 27 1 0 01 Oct 2023
Achieving Linear Speedup in Decentralized Stochastic Compositional Minimax Optimization Hongchang Gao 47 1 0 25 Jul 2023
Robust Fully-Asynchronous Methods for Distributed Training over General Architecture Zehan Zhu Ye Tian Yan Huang Jinming Xu Shibo He OOD 37 2 0 21 Jul 2023
Decentralized Local Updates with Dual-Slow Estimation and Momentum-based Variance-Reduction for Non-Convex Optimization Kangyang Luo Kunkun Zhang Sheng Zhang Xiang Li Ming Gao 38 2 0 17 Jul 2023
Momentum Benefits Non-IID Federated Learning Simply and Provably Ziheng Cheng Xinmeng Huang Pengfei Wu Kun Yuan FedML 40 17 0 28 Jun 2023
Distributed Random Reshuffling Methods with Improved Convergence Kun-Yen Huang Linli Zhou Shi Pu 26 4 0 21 Jun 2023
On the Computation-Communication Trade-Off with A Flexible Gradient Tracking Approach Yan Huang Jinming Xu 35 2 0 12 Jun 2023
When Decentralized Optimization Meets Federated Learning Hongchang Gao My T. Thai Jie Wu FedML 37 22 0 05 Jun 2023
Unbiased Compression Saves Communication in Distributed Optimization: When and How Much? Yutong He Xinmeng Huang Kun Yuan 31 9 0 25 May 2023
Distributed Learning over Networks with Graph-Attention-Based Personalization Zhuojun Tian Zhaoyang Zhang Zhaohui Yang Richeng Jin H. Dai GNN FedML 33 6 0 22 May 2023
Beyond Exponential Graph: Communication-Efficient Topologies for Decentralized Learning via Finite-time Convergence Yuki Takezawa Ryoma Sato Han Bao Kenta Niwa M. Yamada 44 9 0 19 May 2023
Multi-Cluster Aggregative Games: A Linearly Convergent Nash Equilibrium Seeking Algorithm and its Applications in Energy Management Yue-Chun Chen Peng Yi 16 4 0 15 May 2023
Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression Yutong He Xinmeng Huang Yiming Chen W. Yin Kun Yuan 36 7 0 12 May 2023
Global Update Tracking: A Decentralized Learning Algorithm for Heterogeneous Data Sai Aparna Aketi Abolfazl Hashemi Kaushik Roy FedML 40 12 0 08 May 2023
Near-Optimal Decentralized Momentum Method for Nonconvex-PL Minimax Problems Feihu Huang Songcan Chen 25 5 0 21 Apr 2023
A One-Sample Decentralized Proximal Algorithm for Non-Convex Stochastic Composite Optimization Tesi Xiao Xuxing Chen Krishnakumar Balasubramanian Saeed Ghadimi 41 10 0 20 Feb 2023
Distributed Stochastic Optimization under a General Variance Condition Kun-Yen Huang Xiao Li Shin-Yi Pu FedML 45 6 0 30 Jan 2023
CEDAS: A Compressed Decentralized Stochastic Gradient Method with Improved Convergence Kun-Yen Huang Shin-Yi Pu 43 9 0 14 Jan 2023
Decentralized Stochastic Gradient Descent Ascent for Finite-Sum Minimax Problems Hongchang Gao 29 16 0 06 Dec 2022