Distributed Stochastic Gradient Tracking Methods

25 May 2018

Papers citing "Distributed Stochastic Gradient Tracking Methods"

50 / 117 papers shown

Title
Resilient Distributed Optimization for Multi-Agent Cyberphysical Systems M. Yemini Angelia Nedić Andrea J. Goldsmith Stephanie Gil 41 7 0 05 Dec 2022
DIAMOND: Taming Sample and Communication Complexities in Decentralized Bilevel Optimization Pei-Yuan Qiu Yining Li Zhuqing Liu Prashant Khanduri Jia Liu Ness B. Shroff Elizabeth S. Bentley K. Turck 26 4 0 05 Dec 2022
Event-Triggered Decentralized Federated Learning over Resource-Constrained Edge Devices Shahryar Zehtabi Seyyedali Hosseinalipour Christopher G. Brinton FedML 29 6 0 23 Nov 2022
Secure Distributed Optimization Under Gradient Attacks Shuhua Yu S. Kar 44 14 0 28 Oct 2022
Decentralized Stochastic Bilevel Optimization with Improved per-Iteration Complexity Xuxing Chen Minhui Huang Shiqian Ma Krishnakumar Balasubramanian 27 25 0 23 Oct 2022
Zero-Order One-Point Estimate with Distributed Stochastic Gradient-Tracking Technique Elissa Mhanna Mohamad Assaad 38 4 0 11 Oct 2022
Momentum Tracking: Momentum Acceleration for Decentralized Deep Learning on Heterogeneous Data Yuki Takezawa Hang Bao Kenta Niwa Ryoma Sato Makoto Yamada 32 19 0 30 Sep 2022
NET-FLEET: Achieving Linear Convergence Speedup for Fully Decentralized Federated Learning with Heterogeneous Data Xin Zhang Minghong Fang Zhuqing Liu Haibo Yang Jia-Wei Liu Zhengyuan Zhu FedML 37 14 0 17 Aug 2022
Quantization enabled Privacy Protection in Decentralized Stochastic Optimization Yongqiang Wang Tamer Basar 32 44 0 07 Aug 2022
Distributed Projection-free Algorithm for Constrained Aggregative Optimization Tong-Chai Wang Peng Yi 16 19 0 25 Jul 2022
Tackling Data Heterogeneity: A New Unified Framework for Decentralized SGD with Sample-induced Topology Yan Huang Ying Sun Zehan Zhu Changzhi Yan Jinming Xu FedML 38 15 0 08 Jul 2022
On the Convergence of Distributed Stochastic Bilevel Optimization Algorithms over a Network Hongchang Gao Bin Gu My T. Thai 40 14 0 30 Jun 2022
Decentralized Gossip-Based Stochastic Bilevel Optimization over Communication Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang 42 42 0 22 Jun 2022
Decentralized Stochastic Optimization with Inherent Privacy Protection Yongqiang Wang H. Vincent Poor 31 37 0 08 May 2022
Data-heterogeneity-aware Mixing for Decentralized Learning Yatin Dandi Anastasia Koloskova Martin Jaggi Sebastian U. Stich 43 18 0 13 Apr 2022
Decentralized Event-Triggered Federated Learning with Heterogeneous Communication Thresholds Shahryar Zehtabi Seyyedali Hosseinalipour Christopher G. Brinton FedML 39 15 0 07 Apr 2022
An Improved Analysis of Gradient Tracking for Decentralized Machine Learning Anastasia Koloskova Tao R. Lin Sebastian U. Stich 24 106 0 08 Feb 2022
Variance reduced stochastic optimization over directed graphs with row and column stochastic weights Muhammad I. Qureshi Ran Xin S. Kar U. Khan 26 3 0 07 Feb 2022
Tailoring Gradient Methods for Differentially-Private Distributed Optimization Yongqiang Wang A. Nedić 30 67 0 02 Feb 2022
Decentralized Stochastic Variance Reduced Extragradient Method Luo Luo Haishan Ye 29 7 0 01 Feb 2022
Variance-Reduced Stochastic Quasi-Newton Methods for Decentralized Learning: Part I Jiaojiao Zhang Huikang Liu Anthony Man-Cho So Qing Ling 34 14 0 19 Jan 2022
Distributed Random Reshuffling over Networks Kun-Yen Huang Xiao Li Andre Milzarek Shi Pu Junwen Qiu 41 11 0 31 Dec 2021
MDPGT: Momentum-based Decentralized Policy Gradient Tracking Zhanhong Jiang Xian Yeow Lee Sin Yong Tan Kai Liang Tan Aditya Balu Young M. Lee Chinmay Hegde Soumik Sarkar 24 7 0 06 Dec 2021
Distributed Adaptive Learning Under Communication Constraints Marco Carpentiero Vincenzo Matta Ali H. Sayed 29 17 0 03 Dec 2021
Distributed Policy Gradient with Variance Reduction in Multi-Agent Reinforcement Learning Xiaoxiao Zhao Jinlong Lei Li Li Jie-bin Chen OffRL 22 2 0 25 Nov 2021
A Law of Iterated Logarithm for Multi-Agent Reinforcement Learning Gugan Thoppe Bhumesh Kumar 31 4 0 27 Oct 2021
A Unified and Refined Convergence Analysis for Non-Convex Decentralized Learning Sulaiman A. Alghunaim Kun Yuan 47 57 0 19 Oct 2021
Learning to Coordinate in Multi-Agent Systems: A Coordinated Actor-Critic Algorithm and Finite-Time Guarantees Siliang Zeng Tianyi Chen Alfredo García Mingyi Hong 52 11 0 11 Oct 2021
RelaySum for Decentralized Deep Learning on Heterogeneous Data Thijs Vogels Lie He Anastasia Koloskova Tao R. Lin Sai Praneeth Karimireddy Sebastian U. Stich Martin Jaggi FedML MoE 18 61 0 08 Oct 2021
DiNNO: Distributed Neural Network Optimization for Multi-Robot Collaborative Learning Javier Yu Joseph A. Vincent Mac Schwager 53 36 0 17 Sep 2021
Decentralized Composite Optimization with Compression Yao Li Xiaorui Liu Jiliang Tang Ming Yan Kun Yuan 32 9 0 10 Aug 2021
Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphs Zhuoqing Song Lei Shi Shi Pu Ming Yan 26 3 0 26 Jul 2021
Decentralized Bayesian Learning with Metropolis-Adjusted Hamiltonian Monte Carlo Vyacheslav Kungurtsev Adam D. Cobb T. Javidi Brian Jalaian 56 4 0 15 Jul 2021
Decentralized Local Stochastic Extra-Gradient for Variational Inequalities Aleksandr Beznosikov Pavel Dvurechensky Anastasia Koloskova V. Samokhin Sebastian U. Stich Alexander Gasnikov 37 43 0 15 Jun 2021
Over-the-Air Decentralized Federated Learning Yandong Shi Yong Zhou Yuanming Shi FedML 39 41 0 15 Jun 2021
Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks Zhuoqing Song Lei Shi Shi Pu Ming Yan 27 24 0 14 Jun 2021
On Centralized and Distributed Mirror Descent: Convergence Analysis Using Quadratic Constraints Youbang Sun Mahyar Fazlyab Shahin Shahrampour 17 5 0 29 May 2021
Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD Kun Yuan Sulaiman A. Alghunaim Xinmeng Huang 36 32 0 17 May 2021
Improving the Transient Times for Distributed Stochastic Gradient Methods Kun-Yen Huang Shi Pu 42 23 0 11 May 2021
Compressed Gradient Tracking Methods for Decentralized Optimization with Linear Convergence Yiwei Liao Zhuoru Li Kun-Yen Huang Shi Pu 40 11 0 25 Mar 2021
Linear Convergence in Federated Learning: Tackling Client Heterogeneity and Sparse Gradients A. Mitra Rayana H. Jaafar George J. Pappas Hamed Hassani FedML 55 157 0 14 Feb 2021
A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization Ran Xin U. Khan S. Kar 33 39 0 12 Feb 2021
Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data Tao R. Lin Sai Praneeth Karimireddy Sebastian U. Stich Martin Jaggi FedML 28 101 0 09 Feb 2021
Accelerating Distributed Online Meta-Learning via Multi-Agent Collaboration under Limited Communication Sen Lin M. Dedeoglu Junshan Zhang FedML 21 6 0 15 Dec 2020
Faster Non-Convex Federated Learning via Global and Local Momentum Rudrajit Das Anish Acharya Abolfazl Hashemi Sujay Sanghavi Inderjit S. Dhillon Ufuk Topcu FedML 40 82 0 07 Dec 2020
A fast randomized incremental gradient method for decentralized non-convex optimization Ran Xin U. Khan S. Kar 35 33 0 07 Nov 2020
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! D. Kovalev Anastasia Koloskova Martin Jaggi Peter Richtárik Sebastian U. Stich 36 73 0 03 Nov 2020
A general framework for decentralized optimization with first-order methods Ran Xin Shi Pu Angelia Nedić U. Khan 25 87 0 12 Sep 2020
GTAdam: Gradient Tracking with Adaptive Momentum for Distributed Online Optimization Guido Carnevale Francesco Farina Ivano Notarnicola G. Notarstefano 19 22 0 03 Sep 2020
Fast decentralized non-convex finite-sum optimization with recursive variance reduction Ran Xin U. Khan S. Kar 29 43 0 17 Aug 2020