Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1808.07217
Cited By
v1
v2
v3
v4
v5
v6 (latest)
Don't Use Large Mini-Batches, Use Local SGD
22 August 2018
Tao Lin
Sebastian U. Stich
Kumar Kshitij Patel
Martin Jaggi
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Don't Use Large Mini-Batches, Use Local SGD"
50 / 280 papers shown
Exact Penalty Method for Federated Learning
Shenglong Zhou
Geoffrey Ye Li
FedML
189
1
0
23 Aug 2022
NET-FLEET: Achieving Linear Convergence Speedup for Fully Decentralized Federated Learning with Heterogeneous Data
ACM Interational Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc), 2022
Xin Zhang
Minghong Fang
Zhuqing Liu
Haibo Yang
Jia-Wei Liu
Zhengyuan Zhu
FedML
144
19
0
17 Aug 2022
ILASR: Privacy-Preserving Incremental Learning for Automatic Speech Recognition at Production Scale
Knowledge Discovery and Data Mining (KDD), 2022
Gopinath Chennupati
Milind Rao
Gurpreet Chadha
Aaron Eakin
A. Raju
...
Andrew Oberlin
Buddha Nandanoor
Prahalad Venkataramanan
Zheng Wu
Pankaj Sitpure
CLL
222
9
0
19 Jul 2022
On uniform-in-time diffusion approximation for stochastic gradient descent
Methods and Applications of Analysis (MAA), 2022
Lei Li
Yuliang Wang
162
5
0
11 Jul 2022
Compressed-VFL: Communication-Efficient Learning with Vertically Partitioned Data
International Conference on Machine Learning (ICML), 2022
Timothy Castiglia
Anirban Das
Maroun Touma
S. Patterson
FedML
245
67
0
16 Jun 2022
Anchor Sampling for Federated Learning with Partial Client Participation
International Conference on Machine Learning (ICML), 2022
Feijie Wu
Song Guo
Zhihao Qu
Shiqi He
Ziming Liu
Jing Gao
FedML
242
24
0
13 Jun 2022
A principled framework for the design and analysis of token algorithms
International Conference on Artificial Intelligence and Statistics (AISTATS), 2022
Aymeric Dieuleveut
FedML
223
17
0
30 May 2022
FedBR: Improving Federated Learning on Heterogeneous Data via Local Learning Bias Reduction
International Conference on Machine Learning (ICML), 2022
Yongxin Guo
Xiaoying Tang
Tao Lin
FedML
254
45
0
26 May 2022
Test-Time Robust Personalization for Federated Learning
International Conference on Learning Representations (ICLR), 2022
Liang Jiang
Tao Lin
FedML
OOD
TTA
352
55
0
22 May 2022
A Communication-Efficient Distributed Gradient Clipping Algorithm for Training Deep Neural Networks
Neural Information Processing Systems (NeurIPS), 2022
Mingrui Liu
Zhenxun Zhuang
Yunwei Lei
Chunyang Liao
244
28
0
10 May 2022
Federated Random Reshuffling with Compression and Variance Reduction
Grigory Malinovsky
Peter Richtárik
FedML
318
13
0
08 May 2022
Communication-Efficient Adaptive Federated Learning
International Conference on Machine Learning (ICML), 2022
Yujia Wang
Lu Lin
Jinghui Chen
FedML
339
96
0
05 May 2022
FedGiA: An Efficient Hybrid Algorithm for Federated Learning
IEEE Transactions on Signal Processing (IEEE Trans. Signal Process.), 2022
Shenglong Zhou
Geoffrey Ye Li
FedML
454
20
0
03 May 2022
FedShuffle: Recipes for Better Use of Local Work in Federated Learning
Samuel Horváth
Maziar Sanjabi
Lin Xiao
Peter Richtárik
Michael G. Rabbat
FedML
289
22
0
27 Apr 2022
Federated Learning via Inexact ADMM
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Shenglong Zhou
Geoffrey Ye Li
FedML
407
79
0
22 Apr 2022
FedCos: A Scene-adaptive Federated Optimization Enhancement for Performance Improvement
IEEE Internet of Things Journal (IEEE IoT J.), 2022
Hao Zhang
Tingting Wu
Siyao Cheng
Jie Liu
FedML
177
15
0
07 Apr 2022
Sparse Federated Learning with Hierarchical Personalized Models
IEEE Internet of Things Journal (IEEE IoT J.), 2022
Xiaofeng Liu
Qing Wang
Yunfeng Shao
Yinchuan Li
FedML
256
17
0
25 Mar 2022
The Role of Local Steps in Local SGD
Optimization Methods and Software (OMS), 2022
Tiancheng Qin
S. Rasoul Etesami
César A. Uribe
289
5
0
14 Mar 2022
Scaling the Wild: Decentralizing Hogwild!-style Shared-memory SGD
Bapi Chatterjee
Vyacheslav Kungurtsev
Dan Alistarh
FedML
150
2
0
13 Mar 2022
ProxSkip: Yes! Local Gradient Steps Provably Lead to Communication Acceleration! Finally!
International Conference on Machine Learning (ICML), 2022
Konstantin Mishchenko
Grigory Malinovsky
Sebastian U. Stich
Peter Richtárik
317
188
0
18 Feb 2022
Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam
International Conference on Learning Representations (ICLR), 2022
Yucheng Lu
Conglong Li
Minjia Zhang
Christopher De Sa
Yuxiong He
OffRL
AI4CE
330
22
0
12 Feb 2022
Partial Model Averaging in Federated Learning: Performance Guarantees and Benefits
Neurocomputing (Neurocomputing), 2022
Sunwoo Lee
Anit Kumar Sahu
Chaoyang He
Salman Avestimehr
FedML
180
22
0
11 Jan 2022
AET-SGD: Asynchronous Event-triggered Stochastic Gradient Descent
Nhuong V. Nguyen
Song Han
171
2
0
27 Dec 2021
Towards Federated Learning on Time-Evolving Heterogeneous Data
Yongxin Guo
Tao Lin
Xiaoying Tang
FedML
253
41
0
25 Dec 2021
Communication-Efficient Distributed Learning via Sparse and Adaptive Stochastic Gradient
Xiaoge Deng
Dongsheng Li
Tao Sun
Xicheng Lu
FedML
268
1
0
08 Dec 2021
Collaborative Learning over Wireless Networks: An Introductory Overview
Emre Ozfatura
Deniz Gunduz
H. Vincent Poor
174
12
0
07 Dec 2021
Loss Landscape Dependent Self-Adjusting Learning Rates in Decentralized Stochastic Gradient Descent
Wei Zhang
Mingrui Liu
Yu Feng
Xiaodong Cui
Brian Kingsbury
Yuhai Tu
180
3
0
02 Dec 2021
HADFL: Heterogeneity-aware Decentralized Federated Learning Framework
Design Automation Conference (DAC), 2021
Jing Cao
Zirui Lian
Weihong Liu
Zongwei Zhu
Cheng Ji
FedML
60
26
0
16 Nov 2021
Persia: An Open, Hybrid System Scaling Deep Learning-based Recommenders up to 100 Trillion Parameters
Knowledge Discovery and Data Mining (KDD), 2021
Xiangru Lian
Binhang Yuan
Xuefeng Zhu
Yulong Wang
Yongjun He
...
Lei Yuan
Hai-bo Yu
Sen Yang
Ce Zhang
Ji Liu
VLM
262
41
0
10 Nov 2021
Sharp Bounds for Federated Averaging (Local SGD) and Continuous Perspective
Margalit Glasgow
Honglin Yuan
Tengyu Ma
FedML
211
51
0
05 Nov 2021
Large-Scale Deep Learning Optimizations: A Comprehensive Survey
Xiaoxin He
Fuzhao Xue
Xiaozhe Ren
Yang You
329
18
0
01 Nov 2021
Communication-Efficient ADMM-based Federated Learning
Shenglong Zhou
Geoffrey Ye Li
FedML
400
24
0
28 Oct 2021
FedGEMS: Federated Learning of Larger Server Models via Selective Knowledge Fusion
Sijie Cheng
Jingwen Wu
Yanghua Xiao
Yang Liu
Yang Liu
FedML
165
82
0
21 Oct 2021
Trade-offs of Local SGD at Scale: An Empirical Study
Jose Javier Gonzalez Ortiz
Jonathan Frankle
Michael G. Rabbat
Ari S. Morcos
Nicolas Ballas
FedML
222
21
0
15 Oct 2021
KNOT: Knowledge Distillation using Optimal Transport for Solving NLP Tasks
Rishabh Bhardwaj
Tushar Vaidya
Soujanya Poria
OT
FedML
347
10
0
06 Oct 2021
Accelerate Distributed Stochastic Descent for Nonconvex Optimization with Momentum
Guojing Cong
Tianyi Liu
224
0
0
01 Oct 2021
Communication Efficient Generalized Tensor Factorization for Decentralized Healthcare Networks
Jing Ma
Qiuchen Zhang
Jian Lou
Li Xiong
S. Bhavani
Joyce C. Ho
155
0
0
03 Sep 2021
Statistical Estimation and Inference via Local SGD in Federated Learning
Xiang Li
Jiadong Liang
Xiangyu Chang
Zhihua Zhang
FedML
165
6
0
03 Sep 2021
FedChain: Chained Algorithms for Near-Optimal Communication Cost in Federated Learning
Charlie Hou
K. K. Thekumparampil
Giulia Fanti
Sewoong Oh
FedML
286
15
0
16 Aug 2021
RingFed: Reducing Communication Costs in Federated Learning on Non-IID Data
Guang Yang
Ke Mu
Chunhe Song
Zhijia Yang
Tierui Gong
FedML
75
17
0
19 Jul 2021
A Field Guide to Federated Optimization
Jianyu Wang
Zachary B. Charles
Zheng Xu
Gauri Joshi
H. B. McMahan
...
Mi Zhang
Tong Zhang
Chunxiang Zheng
Chen Zhu
Wennan Zhu
FedML
524
463
0
14 Jul 2021
Sparse Personalized Federated Learning
Xiaofeng Liu
Yinchuan Li
Qing Wang
Xu Zhang
Yunfeng Shao
Yanhui Geng
FedML
232
13
0
12 Jul 2021
BAGUA: Scaling up Distributed Learning with System Relaxations
Shaoduo Gan
Xiangru Lian
Rui Wang
Jianbin Chang
Chengjun Liu
...
Jiawei Jiang
Binhang Yuan
Sen Yang
Ji Liu
Ce Zhang
347
33
0
03 Jul 2021
ResIST: Layer-Wise Decomposition of ResNets for Distributed Training
Chen Dun
Cameron R. Wolfe
C. Jermaine
Anastasios Kyrillidis
329
23
0
02 Jul 2021
Personalized Federated Learning with Gaussian Processes
Neural Information Processing Systems (NeurIPS), 2021
Idan Achituve
Aviv Shamsian
Aviv Navon
Gal Chechik
Ethan Fetaya
FedML
295
127
0
29 Jun 2021
Implicit Gradient Alignment in Distributed and Federated Learning
AAAI Conference on Artificial Intelligence (AAAI), 2021
Yatin Dandi
Luis Barba
Martin Jaggi
FedML
347
40
0
25 Jun 2021
Behavior Mimics Distribution: Combining Individual and Group Behaviors for Federated Learning
Hua Huang
Fanhua Shang
Yuanyuan Liu
Hongying Liu
FedML
123
15
0
23 Jun 2021
CD-SGD: Distributed Stochastic Gradient Descent with Compression and Delay Compensation
International Conference on Parallel Processing (ICPP), 2021
Enda Yu
Dezun Dong
Yemao Xu
Shuo Ouyang
Xiangke Liao
156
6
0
21 Jun 2021
STEM: A Stochastic Two-Sided Momentum Algorithm Achieving Near-Optimal Sample and Communication Complexities for Federated Learning
Neural Information Processing Systems (NeurIPS), 2021
Prashant Khanduri
Pranay Sharma
Haibo Yang
Min-Fong Hong
Jia Liu
K. Rajawat
P. Varshney
FedML
117
72
0
19 Jun 2021
Local AdaGrad-Type Algorithm for Stochastic Convex-Concave Optimization
Machine-mediated learning (ML), 2021
Luofeng Liao
Li Shen
Jia Duan
Mladen Kolar
Dacheng Tao
247
5
0
18 Jun 2021
Previous
1
2
3
4
5
6
Next
Page 3 of 6
