v1v2v3 (latest)

A Dual Approach for Optimal Algorithms in Distributed Optimization over Networks

3 September 2018

Alexander Gasnikov

Papers citing "A Dual Approach for Optimal Algorithms in Distributed Optimization over Networks"

50 / 60 papers shown

Title
Accelerating Distributed Optimization: A Primal-Dual Perspective on Local Steps Junchi Yang Murat Yildirim Qiu Feng 105 0 0 02 Jul 2024
Byzantine-Robust Gossip: Insights from a Dual Approach Renaud Gaucher Hadrien Hendrikx Aymeric Dieuleveut AAML 64 0 0 06 May 2024
Robust Decentralized Learning with Local Updates and Gradient Tracking Sajjad Ghiasvand Amirhossein Reisizadeh Mahnoosh Alizadeh Ramtin Pedarsani 104 4 0 02 May 2024
Estimation Network Design framework for efficient distributed optimization M. Bianchi Sergio Grammatico 50 0 0 23 Apr 2024
Exploiting Agent Symmetries for Performance Analysis of Distributed Optimization Methods Sébastien Colla Julien Hendrickx 121 0 0 18 Mar 2024
Ravnest: Decentralized Asynchronous Training on Heterogeneous Devices A. Menon Unnikrishnan Menon Kailash Ahirwar 60 1 0 03 Jan 2024
Adaptive Federated Learning with Auto-Tuned Clients Junhyung Lyle Kim Taha Toghani César A. Uribe Anastasios Kyrillidis FedML 124 6 0 19 Jun 2023
FedDec: Peer-to-peer Aided Federated Learning Marina Costantini Giovanni Neglia T. Spyropoulos FedML 50 1 0 11 Jun 2023
An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization Le‐Yu Chen Haishan Ye Luo Luo 120 5 0 05 Dec 2022
Communication-Efficient Topologies for Decentralized Learning with $O(1)$ Consensus Rate Zhuoqing Song Weijian Li Kexin Jin Lei Shi Ming Yan W. Yin Kun Yuan 47 33 0 14 Oct 2022
Revisiting Optimal Convergence Rate for Smooth and Non-convex Stochastic Decentralized Optimization Kun Yuan Xinmeng Huang Yiming Chen Xiaohan Zhang Yingya Zhang Pan Pan 70 21 0 14 Oct 2022
Pick your Neighbor: Local Gauss-Southwell Rule for Fast Asynchronous Decentralized Optimization Marina Costantini N. Liakopoulos P. Mertikopoulos T. Spyropoulos 43 1 0 15 Jul 2022
A principled framework for the design and analysis of token algorithms Hadrien Hendrikx FedML 79 16 0 30 May 2022
On Arbitrary Compression for Decentralized Consensus and Stochastic Optimization over Directed Networks Taha Toghani César A. Uribe 41 1 0 18 Apr 2022
On Distributed Exact Sparse Linear Regression over Networks Tu Anh-Nguyen César A. Uribe 38 0 0 01 Apr 2022
DoCoM: Compressed Decentralized Optimization with Near-Optimal Sample Complexity Chung-Yiu Yau Hoi-To Wai 115 5 0 01 Feb 2022
Personalized On-Device E-health Analytics with Decentralized Block Coordinate Descent Guanhua Ye Hongzhi Yin Tong Chen Miao Xu Quoc Viet Hung Nguyen Jiangning Song 83 9 0 17 Dec 2021
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning Bicheng Ying Kun Yuan Hanbin Hu Yiming Chen W. Yin FedML 83 28 0 08 Nov 2021
Acceleration in Distributed Optimization under Similarity Helena Lofstrom G. Scutari Tianyue Cao Alexander Gasnikov 74 28 0 24 Oct 2021
Decentralized Composite Optimization with Compression Yao Li Xiaorui Liu Jiliang Tang Ming Yan Kun Yuan 83 9 0 10 Aug 2021
Finite-Bit Quantization For Distributed Algorithms With Linear Convergence Nicolò Michelusi G. Scutari Chang-Shen Lee MQ 66 27 0 23 Jul 2021
Decentralized Constrained Optimization: Double Averaging and Gradient Projection Firooz Shahriari-Mehr David Bosch Ashkan Panahi 46 8 0 21 Jun 2021
Decentralized Local Stochastic Extra-Gradient for Variational Inequalities Aleksandr Beznosikov Pavel Dvurechensky Anastasia Koloskova V. Samokhin Sebastian U. Stich Alexander Gasnikov 60 43 0 15 Jun 2021
Compressed Gradient Tracking for Decentralized Optimization Over General Directed Networks Zhuoqing Song Lei Shi Shi Pu Ming Yan 95 25 0 14 Jun 2021
Asynchronous speedup in decentralized optimization Mathieu Even Hadrien Hendrikx Laurent Massoulie 43 5 0 07 Jun 2021
Accelerating Gossip SGD with Periodic Global Averaging Yiming Chen Kun Yuan Yingya Zhang Pan Pan Yinghui Xu W. Yin 79 44 0 19 May 2021
Removing Data Heterogeneity Influence Enhances Network Topology Dependence of Decentralized SGD Kun Yuan Sulaiman A. Alghunaim Xinmeng Huang 69 35 0 17 May 2021
Accelerated Gradient Tracking over Time-varying Graphs for Decentralized Optimization Huan Li Zhouchen Lin 52 33 0 06 Apr 2021
Drowsiness Detection Based On Driver Temporal Behavior Using a New Developed Dataset F. Faraji F. Lotfi Javad Khorramdel Ali Najafi A. Ghaffari 25 1 0 31 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 131 35 0 04 Mar 2021
Decentralized Distributed Optimization for Saddle Point Problems Alexander Rogozin Alexander Beznosikov D. Dvinskikh D. Kovalev Pavel Dvurechensky Alexander Gasnikov 110 27 0 15 Feb 2021
Newton Method over Networks is Fast up to the Statistical Precision Amir Daneshmand G. Scutari Pavel Dvurechensky Alexander Gasnikov 64 22 0 12 Feb 2021
Asynchrony and Acceleration in Gossip Algorithms Mathieu Even Hadrien Hendrikx Laurent Massoulié 71 7 0 04 Nov 2020
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! D. Kovalev Anastasia Koloskova Martin Jaggi Peter Richtárik Sebastian U. Stich 93 75 0 03 Nov 2020
A general framework for decentralized optimization with first-order methods Ran Xin Shi Pu Angelia Nedić U. Khan 65 89 0 12 Sep 2020
Accelerated Multi-Agent Optimization Method over Stochastic Networks W. Ananduta C. Ocampo‐Martinez Angelia Nedić 33 6 0 08 Sep 2020
Communication-efficient distributed eigenspace estimation Vasileios Charisopoulos Austin R. Benson Anil Damle 39 10 0 05 Sep 2020
A Distributed Cubic-Regularized Newton Method for Smooth Convex Optimization over Networks César A. Uribe Ali Jadbabaie 28 5 0 07 Jul 2020
Dual-Free Stochastic Decentralized Optimization with Variance Reduction Hadrien Hendrikx Francis R. Bach Laurent Massoulié 52 26 0 25 Jun 2020
Optimal and Practical Algorithms for Smooth and Strongly Convex Decentralized Optimization D. Kovalev Adil Salim Peter Richtárik 70 83 0 21 Jun 2020
IDEAL: Inexact DEcentralized Accelerated Augmented Lagrangian Method Yossi Arjevani Joan Bruna Bugra Can Mert Gurbuzbalaban Stefanie Jegelka Hongzhou Lin 58 16 0 11 Jun 2020
An Optimal Algorithm for Decentralized Finite Sum Optimization Hadrien Hendrikx Francis R. Bach Laurent Massoulie 66 45 0 20 May 2020
Multi-consensus Decentralized Accelerated Gradient Descent Haishan Ye Luo Luo Ziang Zhou Tong Zhang 66 52 0 02 May 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 95 517 0 23 Mar 2020
Communication-Efficient Distributed Deep Learning: A Comprehensive Survey Zhenheng Tang Shaoshuai Shi Wei Wang Yue Liu Xiaowen Chu 80 49 0 10 Mar 2020
Revisiting EXTRA for Smooth Distributed Optimization Huan Li Zhouchen Lin 61 40 0 24 Feb 2020
Generalized Self-concordant Hessian-barrier algorithms Pavel Dvurechensky Mathias Staudigl César A. Uribe 42 4 0 04 Nov 2019
A Decentralized Proximal Point-type Method for Saddle Point Problems Weijie Liu Aryan Mokhtari Asuman Ozdaglar S. Pattathil Zebang Shen Nenggan Zheng 132 30 0 31 Oct 2019
Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks Jinming Xu Ye Tian Ying Sun G. Scutari 108 37 0 23 Oct 2019
Robust Distributed Accelerated Stochastic Gradient Methods for Multi-Agent Networks Alireza Fallah Mert Gurbuzbalaban Asuman Ozdaglar Umut Simsekli Lingjiong Zhu 75 28 0 19 Oct 2019