Communication Complexity of Distributed Convex Learning and Optimization

5 June 2015

Papers citing "Communication Complexity of Distributed Convex Learning and Optimization"

37 / 37 papers shown

Title
FedSlate:A Federated Deep Reinforcement Learning Recommender System Yongxin Deng Xihe Qiu Xiaoyu Tan Yaochu Jin FedML 88 0 0 23 Sep 2024
DualFL: A Duality-based Federated Learning Algorithm with Communication Acceleration in the General Convex Regime Jongho Park Jinchao Xu FedML 47 1 0 17 May 2023
Lower Bounds and Accelerated Algorithms in Distributed Stochastic Optimization with Communication Compression Yutong He Xinmeng Huang Yiming Chen W. Yin Kun Yuan 26 7 0 12 May 2023
Stochastic Distributed Optimization under Average Second-order Similarity: Algorithms and Analysis Dachao Lin Yuze Han Haishan Ye Zhihua Zhang 17 11 0 15 Apr 2023
Similarity, Compression and Local Steps: Three Pillars of Efficient Communications for Distributed Variational Inequalities Aleksandr Beznosikov Martin Takáč Alexander Gasnikov 21 10 0 15 Feb 2023
Two Losses Are Better Than One: Faster Optimization Using a Cheaper Proxy Blake E. Woodworth Konstantin Mishchenko Francis R. Bach 42 6 0 07 Feb 2023
Communication-Efficient Local SGD with Age-Based Worker Selection Feng Zhu Jingjing Zhang Xin Eric Wang 18 1 0 31 Oct 2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization Feng Zhu Jingjing Zhang Xin Eric Wang 26 3 0 06 Oct 2022
FedSSO: A Federated Server-Side Second-Order Optimization Algorithm Xinteng Ma Renyi Bao Jinpeng Jiang Yang Liu Arthur Jiang Junhua Yan Xin Liu Zhisong Pan FedML 27 6 0 20 Jun 2022
SADAM: Stochastic Adam, A Stochastic Operator for First-Order Gradient-based Optimizer Wei Zhang Yun-Jian Bao ODL 17 1 0 20 May 2022
Efficient Convex Optimization Requires Superlinear Memory A. Marsden Vatsal Sharan Aaron Sidford Gregory Valiant 24 14 0 29 Mar 2022
Communication Efficient Federated Learning for Generalized Linear Bandits Chuanhao Li Hongning Wang FedML 22 13 0 02 Feb 2022
Acceleration in Distributed Optimization under Similarity Helena Lofstrom G. Scutari Tianyue Cao Alexander Gasnikov 11 26 0 24 Oct 2021
FedChain: Chained Algorithms for Near-Optimal Communication Cost in Federated Learning Charlie Hou K. K. Thekumparampil Giulia Fanti Sewoong Oh FedML 30 14 0 16 Aug 2021
A Field Guide to Federated Optimization Jianyu Wang Zachary B. Charles Zheng Xu Gauri Joshi H. B. McMahan ... Mi Zhang Tong Zhang Chunxiang Zheng Chen Zhu Wennan Zhu FedML 175 411 0 14 Jul 2021
Decentralized Local Stochastic Extra-Gradient for Variational Inequalities Aleksandr Beznosikov Pavel Dvurechensky Anastasia Koloskova V. Samokhin Sebastian U. Stich Alexander Gasnikov 24 43 0 15 Jun 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 27 31 0 04 Mar 2021
Decentralized Distributed Optimization for Saddle Point Problems Alexander Rogozin Alexander Beznosikov D. Dvinskikh D. Kovalev Pavel Dvurechensky Alexander Gasnikov 26 27 0 15 Feb 2021
Newton Method over Networks is Fast up to the Statistical Precision Amir Daneshmand G. Scutari Pavel Dvurechensky Alexander Gasnikov 9 21 0 12 Feb 2021
DBS: Dynamic Batch Size For Distributed Deep Neural Network Training Qing Ye Yuhao Zhou Mingjia Shi Yanan Sun Jiancheng Lv 14 11 0 23 Jul 2020
Challenges of AI in Wireless Networks for IoT Ijaz Ahmad Shahriar Shahabuddin T. Kumar E. Harjula M. Meisel M. Juntti T. Sauter M. Ylianttila 8 18 0 09 Jul 2020
Optimal Complexity in Decentralized Training Yucheng Lu Christopher De Sa 25 71 0 15 Jun 2020
Minibatch vs Local SGD for Heterogeneous Distributed Learning Blake E. Woodworth Kumar Kshitij Patel Nathan Srebro FedML 22 198 0 08 Jun 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 39 491 0 23 Mar 2020
Communication optimization strategies for distributed deep neural network training: A survey Shuo Ouyang Dezun Dong Yemao Xu Liquan Xiao 17 12 0 06 Mar 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 17 326 0 22 Feb 2020
Communication-Efficient Accurate Statistical Estimation Jianqing Fan Yongyi Guo Kaizheng Wang 6 111 0 12 Jun 2019
Semi-Cyclic Stochastic Gradient Descent Hubert Eichner Tomer Koren H. B. McMahan Nathan Srebro Kunal Talwar 14 106 0 23 Apr 2019
Gradient Sparsification for Communication-Efficient Distributed Optimization Jianqiao Wangni Jialei Wang Ji Liu Tong Zhang 15 521 0 26 Oct 2017
Distributed Mean Estimation with Limited Communication A. Suresh Felix X. Yu Sanjiv Kumar H. B. McMahan FedML 22 360 0 02 Nov 2016
Federated Optimization: Distributed Machine Learning for On-Device Intelligence Jakub Konecný H. B. McMahan Daniel Ramage Peter Richtárik FedML 22 1,874 0 08 Oct 2016
Less than a Single Pass: Stochastically Controlled Stochastic Gradient Method Lihua Lei Michael I. Jordan 13 95 0 12 Sep 2016
AIDE: Fast and Communication Efficient Distributed Optimization Sashank J. Reddi Jakub Konecný Peter Richtárik Barnabás Póczós Alex Smola 11 150 0 24 Aug 2016
Dimension-Free Iteration Complexity of Finite Sum Optimization Problems Yossi Arjevani Ohad Shamir 14 24 0 30 Jun 2016
Tight Complexity Bounds for Optimizing Composite Objectives Blake E. Woodworth Nathan Srebro 21 185 0 25 May 2016
Communication-Efficient Learning of Deep Networks from Decentralized Data H. B. McMahan Eider Moore Daniel Ramage S. Hampson Blaise Agüera y Arcas FedML 19 16,978 0 17 Feb 2016
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 168 683 0 07 Dec 2010