On Nonconvex Decentralized Gradient Descent

20 August 2016

Papers citing "On Nonconvex Decentralized Gradient Descent"

30 / 30 papers shown

Title
Asynchronous Decentralized SGD under Non-Convexity: A Block-Coordinate Descent Framework Yijie Zhou Shi Pu 29 0 0 15 May 2025
Convergence of Decentralized Stochastic Subgradient-based Methods for Nonsmooth Nonconvex functions Siyuan Zhang Nachuan Xiao Xin Liu 61 1 0 18 Mar 2024
Decentralized Gradient-Free Methods for Stochastic Non-Smooth Non-Convex Optimization Zhenwei Lin Jingfan Xia Qi Deng Luo Luo 36 3 0 18 Oct 2023
Decentralized Riemannian Conjugate Gradient Method on the Stiefel Manifold Jun Chen Haishan Ye Mengmeng Wang Tianxin Huang Guangwen Dai Ivor W.Tsang Yong Liu 39 11 0 21 Aug 2023
Achieving Consensus over Compact Submanifolds Jiang Hu Jiaojiao Zhang Kangkang Deng 43 4 0 07 Jun 2023
Theoretically Principled Federated Learning for Balancing Privacy and Utility Xiaojin Zhang Wenjie Li Kai Chen Shutao Xia Qian Yang FedML 30 9 0 24 May 2023
A One-Sample Decentralized Proximal Algorithm for Non-Convex Stochastic Composite Optimization Tesi Xiao Xuxing Chen Krishnakumar Balasubramanian Saeed Ghadimi 41 10 0 20 Feb 2023
Decentralized Nonconvex Optimization with Guaranteed Privacy and Accuracy Yongqiang Wang Tamer Basar 33 21 0 14 Dec 2022
A Penalty-Based Method for Communication-Efficient Decentralized Bilevel Programming Parvin Nazari Ahmad Mousavi Davoud Ataee Tarzanagh George Michailidis 48 4 0 08 Nov 2022
Distributed Online Non-convex Optimization with Composite Regret Zhanhong Jiang Aditya Balu Xian Yeow Lee Young M. Lee Chinmay Hegde Soumik Sarkar 46 4 0 21 Sep 2022
NET-FLEET: Achieving Linear Convergence Speedup for Fully Decentralized Federated Learning with Heterogeneous Data Xin Zhang Minghong Fang Zhuqing Liu Haibo Yang Jia-Wei Liu Zhengyuan Zhu FedML 37 14 0 17 Aug 2022
Semi-Decentralized Federated Learning with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 51 32 0 23 May 2022
Robust Federated Learning with Connectivity Failures: A Semi-Decentralized Framework with Collaborative Relaying M. Yemini R. Saha Emre Ozfatura Deniz Gündüz Andrea J. Goldsmith FedML 55 8 0 24 Feb 2022
Distributed Random Reshuffling over Networks Kun-Yen Huang Xiao Li Andre Milzarek Shi Pu Junwen Qiu 41 11 0 31 Dec 2021
Collaborative Learning over Wireless Networks: An Introductory Overview Emre Ozfatura Deniz Gunduz H. Vincent Poor 35 11 0 07 Dec 2021
Distributed Sparse Regression via Penalization Yao Ji G. Scutari Ying Sun Harsha Honnappa 34 5 0 12 Nov 2021
Federated Semi-Supervised Learning with Class Distribution Mismatch Zhiguo Wang Xintong Wang Ruoyu Sun Tsung-Hui Chang FedML 39 12 0 29 Oct 2021
GT-STORM: Taming Sample, Communication, and Memory Complexities in Decentralized Non-Convex Learning Xin Zhang Jia Liu Zhengyuan Zhu Elizabeth S. Bentley 51 14 0 04 May 2021
Decentralized Federated Averaging Tao Sun Dongsheng Li Bao Wang FedML 54 210 0 23 Apr 2021
A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems Jiawei Zhang Peijun Xiao Ruoyu Sun Zhi-Quan Luo 37 97 0 29 Oct 2020
Balancing Rates and Variance via Adaptive Batch-Size for Stochastic Optimization Problems Zhan Gao Alec Koppel Alejandro Ribeiro 33 10 0 02 Jul 2020
A Decentralized Proximal Point-type Method for Saddle Point Problems Weijie Liu Aryan Mokhtari Asuman Ozdaglar S. Pattathil Zebang Shen Nenggan Zheng 72 30 0 31 Oct 2019
Robust and Communication-Efficient Collaborative Learning Amirhossein Reisizadeh Hossein Taheri Aryan Mokhtari Hamed Hassani Ramtin Pedarsani 38 89 0 24 Jul 2019
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling Jianyu Wang Anit Kumar Sahu Zhouyi Yang Gauri Joshi S. Kar 29 159 0 23 May 2019
Decentralized Online Learning: Take Benefits from Others' Data without Sharing Your Own to Track Global Trend Wendi Wu Zongren Li Yawei Zhao Chenkai Yu P. Zhao Ji Liu FedML 18 16 0 29 Jan 2019
DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization Parvin Nazari Davoud Ataee Tarzanagh George Michailidis ODL 29 67 0 25 Jan 2019
Cooperative SGD: A unified Framework for the Design and Analysis of Communication-Efficient SGD Algorithms Jianyu Wang Gauri Joshi 33 348 0 22 Aug 2018
Collaborative Deep Learning in Fixed Topology Networks Zhanhong Jiang Aditya Balu Chinmay Hegde Soumik Sarkar FedML 32 179 0 23 Jun 2017
Decentralized Frank-Wolfe Algorithm for Convex and Non-convex Problems Hoi-To Wai Jean Lafond Anna Scaglione Eric Moulines 71 90 0 05 Dec 2016
A Fast Distributed Proximal-Gradient Method Annie I. Chen Asuman Ozdaglar 70 146 0 08 Oct 2012