v1v2v3v4 (latest)

On Maintaining Linear Convergence of Distributed Learning and Optimization under Limited Communication

26 February 2019

Sindri Magnússon

H. S. Ghadikolaei

Na Li

ArXiv (abs)PDF HTML

Papers citing "On Maintaining Linear Convergence of Distributed Learning and Optimization under Limited Communication"

26 / 26 papers shown

Title
Single-Timescale Multi-Sequence Stochastic Approximation Without Fixed Point Smoothness: Theories and ApplicationsIEEE Transactions on Signal Processing (IEEE TSP), 2024 Yue Huang Zhaoxian Wu Shiqian Ma Qing Ling 254 2 0 17 Oct 2024
Distributed Learning based on 1-Bit Gradient Coding in the Presence of Stragglers Chengxi Li Mikael Skoglund 262 8 0 19 Mar 2024
Non-Coherent Over-the-Air Decentralized Gradient DescentIEEE Transactions on Signal Processing (IEEE Trans. Signal Process.), 2022 Nicolò Michelusi 243 12 0 19 Nov 2022
Quantized Adaptive Subgradient Algorithms and Their Applications Ke Xu Jianqiao Wangni Yifan Zhang Deheng Ye Jiaxiang Wu P. Zhao 142 0 0 11 Aug 2022
Edge Learning for B5G Networks with Distributed Signal Processing: Semantic Communication, Edge Computing, and Wireless SensingIEEE Journal on Selected Topics in Signal Processing (IEEE JSTSP), 2022 Wei Xu Zhaohui Yang Derrick Wing Kwan Ng Marco Levorato Yonina C. Eldar Mérouane Debbah 279 520 0 01 Jun 2022
A Survey on Distributed Online Optimization and Game Xiuxian Li Lihua Xie Na Li OffRL 212 4 0 01 May 2022
Communication-Efficient Distributed SGD with Compressed Sensing Yujie Tang V. Ramanathan Junshan Zhang Na Li FedML 156 8 0 15 Dec 2021
Federated Reinforcement Learning at the Edge Konstantinos Gatsis FedML 147 5 0 11 Dec 2021
Distributed Principal Component Analysis with Limited Communication Foivos Alimisis Peter Davies Bart Vandereycken Dan Alistarh 152 15 0 27 Oct 2021
Decentralized Composite Optimization with Compression Yao Li Xiaorui Liu Shucheng Zhou Ming Yan Kun Yuan 169 10 0 10 Aug 2021
Finite-Bit Quantization For Distributed Algorithms With Linear ConvergenceIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2021 Nicolò Michelusi G. Scutari Chang-Shen Lee MQ 224 35 0 23 Jul 2021
EF21: A New, Simpler, Theoretically Better, and Practically Faster Error FeedbackNeural Information Processing Systems (NeurIPS), 2021 Peter Richtárik Igor Sokolov Ilyas Fatkhullin 180 174 0 09 Jun 2021
Innovation Compression for Communication-efficient Distributed Optimization with Linear ConvergenceIEEE Transactions on Automatic Control (IEEE TAC), 2021 Jiaqi Zhang Keyou You Lihua Xie 149 35 0 14 May 2021
Decentralized Federated AveragingIEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021 Tao Sun Dongsheng Li Bao Wang FedML 229 286 0 23 Apr 2021
Joint Optimization of Communications and Federated Learning Over the AirIEEE Transactions on Wireless Communications (IEEE TWC), 2021 Xin-Yue Fan Yue Wang Yan Huo Z. Tian FedML 188 66 0 08 Apr 2021
Communication-Efficient Distributed Optimization with Quantized PreconditionersInternational Conference on Machine Learning (ICML), 2021 Foivos Alimisis Peter Davies Dan Alistarh 203 17 0 14 Feb 2021
A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! D. Kovalev Anastasia Koloskova Martin Jaggi Peter Richtárik Sebastian U. Stich 196 79 0 03 Nov 2020
Towards Tight Communication Lower Bounds for Distributed OptimisationNeural Information Processing Systems (NeurIPS), 2020 Dan Alistarh Janne H. Korhonen FedML 135 10 0 16 Oct 2020
A Low Complexity Decentralized Neural Net with Centralized Equivalence using Layer-wise Learning Xinyue Liang Alireza M. Javid Mikael Skoglund Saikat Chatterjee FedML 104 4 0 29 Sep 2020
Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and ApplicationsProceedings of the IEEE (Proc. IEEE), 2020 Jihong Park S. Samarakoon Anis Elgabli Joongheon Kim M. Bennis Seong-Lyun Kim Mérouane Debbah 258 175 0 06 Aug 2020
A Hybrid Model-based and Data-driven Approach to Spectrum Sharing in mmWave Cellular NetworksIEEE Transactions on Cognitive Communications and Networking (IEEE TCCN), 2020 H. S. Ghadikolaei H. Ghauch Gábor Fodor Mikael Skoglund Carlo Fischione 78 16 0 19 Mar 2020
Communication-efficient Variance-reduced Stochastic Gradient DescentIFAC-PapersOnLine (IFAC-PapersOnLine), 2020 H. S. Ghadikolaei Sindri Magnússon 122 3 0 10 Mar 2020
LASG: Lazily Aggregated Stochastic Gradients for Communication-Efficient Distributed Learning Tianyi Chen Yuejiao Sun W. Yin FedML 126 14 0 26 Feb 2020
Differentially Quantized Gradient MethodsIEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2020 Chung-Yi Lin V. Kostina B. Hassibi MQ 318 8 0 06 Feb 2020
Scalable Reinforcement Learning for Multi-Agent Networked SystemsOperational Research (OR), 2019 Guannan Qu Adam Wierman Na Li 244 43 0 05 Dec 2019
Communication-Efficient Distributed Learning via Lazily Aggregated Quantized GradientsNeural Information Processing Systems (NeurIPS), 2019 Jun Sun Tianyi Chen G. Giannakis Zaiyue Yang 168 98 0 17 Sep 2019