Optimal algorithms for smooth and strongly convex distributed optimization in networks

28 February 2017

Laurent Massoulié

Papers citing "Optimal algorithms for smooth and strongly convex distributed optimization in networks"

50 / 60 papers shown

Title
Ringmaster ASGD: The First Asynchronous SGD with Optimal Time Complexity Artavazd Maranjyan A. Tyurin Peter Richtárik 49 3 0 27 Jan 2025
OledFL: Unleashing the Potential of Decentralized Federated Learning via Opposite Lookahead Enhancement Qinglun Li Miao Zhang Mengzhu Wang Quanjun Yin Li Shen OODD FedML 26 0 0 09 Oct 2024
Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks D. Kovalev Ekaterina Borodich Alexander Gasnikov Dmitrii Feoktistov 48 0 0 28 May 2024
Byzantine-Robust Gossip: Insights from a Dual Approach Renaud Gaucher Hadrien Hendrikx Aymeric Dieuleveut AAML 38 0 0 06 May 2024
Compressed and Sparse Models for Non-Convex Decentralized Learning Andrew Campbell Hang Liu Leah Woldemariam Anna Scaglione 28 0 0 09 Nov 2023
On the Convergence of Decentralized Federated Learning Under Imperfect Information Sharing Vishnu Pandi Chellapandi Antesh Upadhyay Abolfazl Hashemi Stanislaw H. .Zak FedML 37 31 0 19 Mar 2023
Distributed Optimization Methods for Multi-Robot Systems: Part II -- A Survey O. Shorinwa Trevor Halsted Javier Yu Mac Schwager 31 19 0 26 Jan 2023
An Efficient Stochastic Algorithm for Decentralized Nonconvex-Strongly-Concave Minimax Optimization Le‐Yu Chen Haishan Ye Luo Luo 78 5 0 05 Dec 2022
Efficiency Ordering of Stochastic Gradient Descent Jie Hu Vishwaraj Doshi Do Young Eun 31 6 0 15 Sep 2022
Communication Acceleration of Local Gradient Methods via an Accelerated Primal-Dual Algorithm with Inexact Prox Abdurakhmon Sadiev D. Kovalev Peter Richtárik 35 20 0 08 Jul 2022
Tackling Data Heterogeneity: A New Unified Framework for Decentralized SGD with Sample-induced Topology Yan Huang Ying Sun Zehan Zhu Changzhi Yan Jinming Xu FedML 38 15 0 08 Jul 2022
A principled framework for the design and analysis of token algorithms Hadrien Hendrikx FedML 31 13 0 30 May 2022
Collaborative Multi-agent Stochastic Linear Bandits Ahmadreza Moradipari Mohammad Ghavamzadeh M. Alizadeh 21 6 0 12 May 2022
Understanding A Class of Decentralized and Federated Optimization Algorithms: A Multi-Rate Feedback Control Perspective Xinwei Zhang Mingyi Hong N. Elia FedML 21 3 0 27 Apr 2022
Data-heterogeneity-aware Mixing for Decentralized Learning Yatin Dandi Anastasia Koloskova Martin Jaggi Sebastian U. Stich 43 18 0 13 Apr 2022
Automatic Performance Estimation for Decentralized Optimization Sébastien Colla Julien Hendrickx 36 8 0 11 Mar 2022
Optimal Methods for Convex Risk Averse Distributed Optimization Guanghui Lan Zhe Zhang 16 2 0 10 Mar 2022
Optimal Algorithms for Decentralized Stochastic Variational Inequalities D. Kovalev Aleksandr Beznosikov Abdurakhmon Sadiev Michael Persiianov Peter Richtárik Alexander Gasnikov 42 35 0 06 Feb 2022
A dual approach for federated learning Zhenan Fan Huang Fang M. Friedlander FedML 18 3 0 26 Jan 2022
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning Bicheng Ying Kun Yuan Hanbin Hu Yiming Chen W. Yin FedML 44 27 0 08 Nov 2021
Acceleration in Distributed Optimization under Similarity Helena Lofstrom G. Scutari Tianyue Cao Alexander Gasnikov 32 26 0 24 Oct 2021
Decentralized Composite Optimization with Compression Yao Li Xiaorui Liu Jiliang Tang Ming Yan Kun Yuan 32 9 0 10 Aug 2021
Decentralized Constrained Optimization: Double Averaging and Gradient Projection Firooz Shahriari-Mehr David Bosch Ashkan Panahi 21 8 0 21 Jun 2021
Decentralized Local Stochastic Extra-Gradient for Variational Inequalities Aleksandr Beznosikov Pavel Dvurechensky Anastasia Koloskova V. Samokhin Sebastian U. Stich Alexander Gasnikov 37 43 0 15 Jun 2021
A Survey of Distributed Optimization Methods for Multi-Robot Systems Trevor Halsted O. Shorinwa Javier Yu Mac Schwager 33 39 0 23 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 42 33 0 04 Mar 2021
Decentralized Distributed Optimization for Saddle Point Problems Alexander Rogozin Alexander Beznosikov D. Dvinskikh D. Kovalev Pavel Dvurechensky Alexander Gasnikov 28 27 0 15 Feb 2021
Newton Method over Networks is Fast up to the Statistical Precision Amir Daneshmand G. Scutari Pavel Dvurechensky Alexander Gasnikov 30 22 0 12 Feb 2021
Straggler-Resilient Distributed Machine Learning with Dynamic Backup Workers Guojun Xiong Gang Yan Rahul Singh Jian Li 38 12 0 11 Feb 2021
Consensus Control for Decentralized Deep Learning Lingjing Kong Tao R. Lin Anastasia Koloskova Martin Jaggi Sebastian U. Stich 19 76 0 09 Feb 2021
Accelerated, Optimal, and Parallel: Some Results on Model-Based Stochastic Optimization Karan N. Chadha Gary Cheng John C. Duchi 62 16 0 07 Jan 2021
PMGT-VR: A decentralized proximal-gradient algorithmic framework with variance reduction Haishan Ye Wei Xiong Tong Zhang 16 16 0 30 Dec 2020
On the Benefits of Multiple Gossip Steps in Communication-Constrained Decentralized Optimization Abolfazl Hashemi Anish Acharya Rudrajit Das H. Vikalo Sujay Sanghavi Inderjit Dhillon 20 7 0 20 Nov 2020
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! D. Kovalev Anastasia Koloskova Martin Jaggi Peter Richtárik Sebastian U. Stich 31 73 0 03 Nov 2020
Throughput-Optimal Topology Design for Cross-Silo Federated Learning Othmane Marfoq Chuan Xu Giovanni Neglia Richard Vidal FedML 67 85 0 23 Oct 2020
Distributed Optimization, Averaging via ADMM, and Network Topology G. França José Bento 21 9 0 05 Sep 2020
On stochastic mirror descent with interacting particles: convergence properties and variance reduction Anastasia Borovykh N. Kantas P. Parpas G. Pavliotis 35 12 0 15 Jul 2020
Optimal Complexity in Decentralized Training Yucheng Lu Christopher De Sa 38 72 0 15 Jun 2020
FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data Xinwei Zhang Mingyi Hong S. Dhople W. Yin Yang Liu FedML 23 228 0 22 May 2020
A Robust Gradient Tracking Method for Distributed Optimization over Directed Networks Shi Pu 29 38 0 31 Mar 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 46 493 0 23 Mar 2020
Distributed Algorithms for Composite Optimization: Unified Framework and Convergence Analysis Jinming Xu Ye Tian Ying Sun G. Scutari 36 64 0 25 Feb 2020
A Decentralized Proximal Point-type Method for Saddle Point Problems Weijie Liu Aryan Mokhtari Asuman Ozdaglar S. Pattathil Zebang Shen Nenggan Zheng 72 30 0 31 Oct 2019
Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks Jinming Xu Ye Tian Ying Sun G. Scutari 24 37 0 23 Oct 2019
Variance-Reduced Decentralized Stochastic Optimization with Gradient Tracking -- Part II: GT-SVRG Ran Xin U. Khan S. Kar 24 8 0 08 Oct 2019
Social Learning in Multi Agent Multi Armed Bandits Abishek Sankararaman A. Ganesh Sanjay Shakkottai 28 84 0 04 Oct 2019
Regularized Diffusion Adaptation via Conjugate Smoothing Stefan Vlaski L. Vandenberghe Ali H. Sayed 23 6 0 20 Sep 2019
Communication-Censored Linearized ADMM for Decentralized Consensus Optimization Weiyu Li Yaohua Liu Z. Tian Qing Ling 14 22 0 15 Sep 2019
Robust and Communication-Efficient Collaborative Learning Amirhossein Reisizadeh Hossein Taheri Aryan Mokhtari Hamed Hassani Ramtin Pedarsani 38 89 0 24 Jul 2019
On linear convergence of two decentralized algorithms Yao Li Ming Yan 19 7 0 17 Jun 2019