An Asynchronous Mini-Batch Algorithm for Regularized Stochastic Optimization

18 May 2015

Papers citing "An Asynchronous Mini-Batch Algorithm for Regularized Stochastic Optimization"

28 / 28 papers shown

Title
Ringmaster ASGD: The First Asynchronous SGD with Optimal Time Complexity Artavazd Maranjyan A. Tyurin Peter Richtárik 49 3 0 27 Jan 2025
Faster Stochastic Optimization with Arbitrary Delays via Asynchronous Mini-Batching Amit Attia Ofir Gaash Tomer Koren 40 0 0 14 Aug 2024
Reputation-Driven Asynchronous Federated Learning for Enhanced Trajectory Prediction with Blockchain Weiliang Chen Li Jia Yang Zhou Qianqian Ren 34 0 0 28 Jul 2024
Ordered Momentum for Asynchronous SGD Chang-Wei Shi Yi-Rui Yang Wu-Jun Li ODL 67 0 0 27 Jul 2024
Federated Multi-Level Optimization over Decentralized Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang AI4CE 28 0 0 10 Oct 2023
Convergence Analysis of Decentralized ASGD Mauro Dalle Lucca Tosi Martin Theobald 35 2 0 07 Sep 2023
Stability and Convergence of Distributed Stochastic Approximations with large Unbounded Stochastic Information Delays Adrian Redder Arunselvan Ramaswamy Holger Karl 25 1 0 11 May 2023
Impact of Redundancy on Resilience in Distributed Optimization and Learning Shuo Liu Nirupam Gupta Nitin H. Vaidya 39 2 0 16 Nov 2022
Unbounded Gradients in Federated Learning with Buffered Asynchronous Aggregation Taha Toghani César A. Uribe FedML 45 14 0 03 Oct 2022
Asynchronous Training Schemes in Distributed Learning with Time Delay Haoxiang Wang Zhanhong Jiang Chao Liu Soumik Sarkar D. Jiang Young M. Lee 42 2 0 28 Aug 2022
Decentralized Gossip-Based Stochastic Bilevel Optimization over Communication Networks Shuoguang Yang Xuezhou Zhang Mengdi Wang 40 42 0 22 Jun 2022
Analysis and Evaluation of Synchronous and Asynchronous FLchain F. Wilhelmi L. Giupponi Paolo Dini 28 5 0 15 Dec 2021
Distributed stochastic optimization with large delays Zhengyuan Zhou P. Mertikopoulos Nicholas Bambos Peter Glynn Yinyu Ye 28 9 0 06 Jul 2021
Fast Federated Learning in the Presence of Arbitrary Device Unavailability Xinran Gu Kaixuan Huang Jingzhao Zhang Longbo Huang FedML 35 96 0 08 Jun 2021
Asynchronous Distributed Optimization with Redundancy in Cost Functions Shuo Liu Nirupam Gupta Nitin H. Vaidya 31 3 0 07 Jun 2021
Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices Max Ryabinin Eduard A. Gorbunov Vsevolod Plokhotnyuk Gennady Pekhimenko 42 33 0 04 Mar 2021
Anytime Minibatch with Delayed Gradients H. Al-Lawati S. Draper 25 0 0 15 Dec 2020
Distributed Training of Deep Learning Models: A Taxonomic Perspective M. Langer Zhen He W. Rahayu Yanbo Xue 30 76 0 08 Jul 2020
Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems M. S. Munir N. H. Tran Walid Saad Choong Seon Hong 24 19 0 20 Feb 2020
Asynchronous Federated Learning with Differential Privacy for Edge Intelligence Yanan Li Shusen Yang Xuebin Ren Cong Zhao FedML 19 33 0 17 Dec 2019
The Error-Feedback Framework: Better Rates for SGD with Delayed Gradients and Compressed Communication Sebastian U. Stich Sai Praneeth Karimireddy FedML 25 20 0 11 Sep 2019
A Tight Convergence Analysis for Stochastic Gradient Descent with Delayed Updates Yossi Arjevani Ohad Shamir Nathan Srebro 16 63 0 26 Jun 2018
Graph Oracle Models, Lower Bounds, and Gaps for Parallel Stochastic Optimization Blake E. Woodworth Jialei Wang Adam D. Smith H. B. McMahan Nathan Srebro 24 123 0 25 May 2018
Stochastic Gradient MCMC with Stale Gradients Changyou Chen Nan Ding Chunyuan Li Yizhe Zhang Lawrence Carin BDL 46 23 0 21 Oct 2016
Analysis and Implementation of an Asynchronous Optimization Algorithm for the Parameter Server Arda Aytekin Hamid Reza Feyzmahdavian M. Johansson 39 54 0 18 Oct 2016
Level Up Your Strategy: Towards a Descriptive Framework for Meaningful Enterprise Gamification Xinghao Pan 33 62 0 29 May 2016
Asynchronous Parallel Stochastic Gradient for Nonconvex Optimization Xiangru Lian Yijun Huang Y. Li Ji Liu 36 500 0 27 Jun 2015
Optimal Distributed Online Prediction using Mini-Batches O. Dekel Ran Gilad-Bachrach Ohad Shamir Lin Xiao 184 683 0 07 Dec 2010