Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization

26 September 2017

Papers citing "Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization"

42 / 92 papers shown

Title
GT-STORM: Taming Sample, Communication, and Memory Complexities in Decentralized Non-Convex Learning Xin Zhang Jia Liu Zhengyuan Zhu Elizabeth S. Bentley 51 14 0 04 May 2021
D-Cliques: Compensating for Data Heterogeneity with Topology in Decentralized Federated Learning A. Bellet Anne-Marie Kermarrec Erick Lavoie FedML 30 21 0 15 Apr 2021
Optimal CPU Scheduling in Data Centers via a Finite-Time Distributed Quantized Coordination Mechanism Apostolos I. Rikos Andreas Grammenos Evangelia Kalyvianaki Christoforos N. Hadjicostis Themistoklis Charalambous Karl H. Johansson 38 23 0 07 Apr 2021
Distributed Learning in Wireless Networks: Recent Progress and Future Challenges Mingzhe Chen Deniz Gündüz Kaibin Huang Walid Saad M. Bennis Aneta Vulgarakis Feljan H. Vincent Poor 45 402 0 05 Apr 2021
A Survey of Distributed Optimization Methods for Multi-Robot Systems Trevor Halsted O. Shorinwa Javier Yu Mac Schwager 40 39 0 23 Mar 2021
Characterizing Trust and Resilience in Distributed Consensus for Cyberphysical Systems M. Yemini Angelia Nedić Andrea J. Goldsmith Stephanie Gil 9 39 0 09 Mar 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 42 33 0 04 Mar 2021
Newton Method over Networks is Fast up to the Statistical Precision Amir Daneshmand G. Scutari Pavel Dvurechensky Alexander Gasnikov 30 22 0 12 Feb 2021
A Hybrid Variance-Reduced Method for Decentralized Stochastic Non-Convex Optimization Ran Xin U. Khan S. Kar 33 39 0 12 Feb 2021
Straggler-Resilient Distributed Machine Learning with Dynamic Backup Workers Guojun Xiong Gang Yan Rahul Singh Jian Li 38 12 0 11 Feb 2021
Sparse-Push: Communication- & Energy-Efficient Decentralized Distributed Learning over Directed & Time-Varying Graphs with non-IID Datasets Sai Aparna Aketi Amandeep Singh J. Rabaey 29 10 0 10 Feb 2021
Federated Learning over Wireless Device-to-Device Networks: Algorithms and Convergence Analysis Hong Xing Osvaldo Simeone Suzhi Bi 54 94 0 29 Jan 2021
Cybersecurity of Industrial Cyber-Physical Systems: A Review Hakan Kayan Matthew Nunes Omer F. Rana Pete Burnap Charith Perera AI4CE 56 122 0 10 Jan 2021
Throughput-Optimal Topology Design for Cross-Silo Federated Learning Othmane Marfoq Chuan Xu Giovanni Neglia Richard Vidal FedML 67 85 0 23 Oct 2020
Distributed Optimization, Averaging via ADMM, and Network Topology G. França José Bento 26 9 0 05 Sep 2020
An improved convergence analysis for decentralized online stochastic non-convex optimization Ran Xin U. Khan S. Kar 44 100 0 10 Aug 2020
Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications Jihong Park S. Samarakoon Anis Elgabli Joongheon Kim M. Bennis Seong-Lyun Kim Mérouane Debbah 39 161 0 06 Aug 2020
Tackling the Objective Inconsistency Problem in Heterogeneous Federated Optimization Jianyu Wang Qinghua Liu Hao Liang Gauri Joshi H. Vincent Poor MoMe FedML 23 1,304 0 15 Jul 2020
Geometric Bounds for Convergence Rates of Averaging Algorithms Bernadette Charron-Bost 34 7 0 09 Jul 2020
DS-Sync: Addressing Network Bottlenecks with Divide-and-Shuffle Synchronization for Distributed DNN Training Weiyan Wang Cengguang Zhang Liu Yang Kai Chen Kun Tan 34 12 0 07 Jul 2020
Non-convex Min-Max Optimization: Applications, Challenges, and Recent Theoretical Advances Meisam Razaviyayn Tianjian Huang Songtao Lu Maher Nouiehed Maziar Sanjabi Mingyi Hong 19 109 0 15 Jun 2020
The Internet of Things as a Deep Neural Network Rong Du Sindri Magnússon Carlo Fischione 17 7 0 23 Mar 2020
A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova Nicolas Loizou Sadra Boreiri Martin Jaggi Sebastian U. Stich FedML 46 493 0 23 Mar 2020
Decentralized gradient methods: does topology matter? Giovanni Neglia Chuan Xu Don Towsley G. Calbi 24 50 0 28 Feb 2020
Communication-Efficient Edge AI: Algorithms and Systems Yuanming Shi Kai Yang Tao Jiang Jun Zhang Khaled B. Letaief GNN 34 327 0 22 Feb 2020
Gradient tracking and variance reduction for decentralized optimization and machine learning Ran Xin S. Kar U. Khan 19 10 0 13 Feb 2020
Accelerated Primal-Dual Algorithms for Distributed Smooth Convex Optimization over Networks Jinming Xu Ye Tian Ying Sun G. Scutari 34 37 0 23 Oct 2019
Q-GADMM: Quantized Group ADMM for Communication Efficient Decentralized Machine Learning Anis Elgabli Jihong Park Amrit Singh Bedi Chaouki Ben Issaid M. Bennis Vaneet Aggarwal 24 67 0 23 Oct 2019
Communication-Efficient Distributed Learning via Lazily Aggregated Quantized Gradients Jun Sun Tianyi Chen G. Giannakis Zaiyue Yang 30 93 0 17 Sep 2019
Communication-Censored Linearized ADMM for Decentralized Consensus Optimization Weiyu Li Yaohua Liu Z. Tian Qing Ling 22 22 0 15 Sep 2019
Finite-Time Performance of Distributed Temporal Difference Learning with Linear Function Approximation Thinh T. Doan S. T. Maguluri Justin Romberg 30 41 0 25 Jul 2019
Asymptotic Network Independence in Distributed Stochastic Optimization for Machine Learning Shi Pu Alexander Olshevsky I. Paschalidis 31 41 0 28 Jun 2019
MATCHA: Speeding Up Decentralized SGD via Matching Decomposition Sampling Jianyu Wang Anit Kumar Sahu Zhouyi Yang Gauri Joshi S. Kar 29 159 0 23 May 2019
An Asynchronous, Decentralized Solution Framework for the Large Scale Unit Commitment Problem P. Ramanan Murat Yildirim Edmond Chow N. Gebraeel 30 22 0 07 Apr 2019
Leveraging Communication Topologies Between Learning Agents in Deep Reinforcement Learning D. Adjodah D. Calacci Abhimanyu Dubey Anirudh Goyal P. Krafft Esteban Moro Egido Alex Pentland AI4CE 30 8 0 16 Feb 2019
DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization Parvin Nazari Davoud Ataee Tarzanagh George Michailidis ODL 29 67 0 25 Jan 2019
Push-Pull Gradient Methods for Distributed Optimization in Networks Shi Pu Wei Shi Jinming Xu A. Nedić 16 318 0 15 Oct 2018
Distributed Stochastic Gradient Tracking Methods Shi Pu A. Nedić 40 287 0 25 May 2018
Randomization and quantization for average consensus Bernadette Charron-Bost Patrick Lambein-Monette 24 6 0 29 Apr 2018
Asynchronous Gradient-Push Mahmoud Assran Michael G. Rabbat 30 61 0 23 Mar 2018
A Push-Pull Gradient Method for Distributed Optimization in Networks Shi Pu Wei Shi Jinming Xu A. Nedić 19 98 0 20 Mar 2018
D $^2$ : Decentralized Training over Decentralized Data Hanlin Tang Xiangru Lian Ming Yan Ce Zhang Ji Liu 20 348 0 19 Mar 2018