Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2106.07820
Cited By
On Large-Cohort Training for Federated Learning
Neural Information Processing Systems (NeurIPS), 2021
15 June 2021
Zachary B. Charles
Zachary Garrett
Zhouyuan Huo
Sergei Shmulyian
Virginia Smith
FedML
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"On Large-Cohort Training for Federated Learning"
50 / 67 papers shown
Federated Stochastic Minimax Optimization under Heavy-Tailed Noises
Xinwen Zhang
Hongchang Gao
FedML
384
0
0
06 Nov 2025
SparsyFed: Sparse Adaptive Federated Training
Adriano Guastella
Lorenzo Sani
Alex Iacob
Alessio Mora
Paolo Bellavista
Nicholas D. Lane
FedML
411
1
0
07 Apr 2025
AIGC-assisted Federated Learning for Edge Intelligence: Architecture Design, Research Challenges and Future Directions
Xianke Qiang
Zheng Chang
Ying-Chang Liang
FedML
247
0
0
26 Mar 2025
Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
Zachary B. Charles
Gabriel Teston
Lucio Dery
Keith Rush
Nova Fallen
Zachary Garrett
Arthur Szlam
Arthur Douillard
909
12
0
12 Mar 2025
Sketched Adaptive Federated Deep Learning: A Sharp Convergence Analysis
Zhijie Chen
Qiaobo Li
A. Banerjee
FedML
468
1
0
11 Nov 2024
Photon: Federated LLM Pre-Training
Lorenzo Sani
Alex Iacob
Zeyu Cao
Royson Lee
Bill Marino
...
Dongqi Cai
Zexi Li
Wanru Zhao
Xinchi Qiu
Nicholas D. Lane
AI4CE
316
16
0
05 Nov 2024
Personalized Federated Learning with Mixture of Models for Adaptive Prediction and Model Fine-Tuning
Neural Information Processing Systems (NeurIPS), 2024
P. M. Ghari
Yanning Shen
FedML
179
11
0
28 Oct 2024
Tackling Data Heterogeneity in Federated Learning via Loss Decomposition
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024
Shuang Zeng
Pengxin Guo
Shuai Wang
Jianbo Wang
Yuyin Zhou
Liangqiong Qu
FedML
282
11
0
22 Aug 2024
FLea: Addressing Data Scarcity and Label Skew in Federated Learning via Privacy-preserving Feature Augmentation
Tong Xia
Abhirup Ghosh
Xinchi Qiu
Cecilia Mascolo
199
7
0
13 Jun 2024
Federated LoRA with Sparse Communication
Kevin Kuo
Arian Raje
Kousik Rajesh
Virginia Smith
409
22
0
07 Jun 2024
FedStaleWeight: Buffered Asynchronous Federated Learning with Fair Aggregation via Staleness Reweighting
Jeffrey Ma
Alan Tu
Yiling Chen
Vijay Janapa Reddi
FedML
246
5
0
05 Jun 2024
Federated Unsupervised Domain Generalization using Global and Local Alignment of Gradients
Farhad Pourpanah
Mahdiyar Molahasani
Milad Soltany
Michael A. Greenspan
Ali Etemad
FedML
OOD
827
5
0
25 May 2024
Harnessing Increased Client Participation with Cohort-Parallel Federated Learning
Akash Dhasade
Anne-Marie Kermarrec
Tuan-Anh Nguyen
Rafael Pires
M. Vos
FedML
395
0
0
24 May 2024
Worldwide Federated Training of Language Models
Alexandru Iacob
Lorenzo Sani
Bill Marino
Preslav Aleksandrov
William F. Shen
Nicholas D. Lane
FedML
351
6
0
23 May 2024
The Limits and Potentials of Local SGD for Distributed Heterogeneous Learning with Intermittent Communication
Kumar Kshitij Patel
Margalit Glasgow
Ali Zindari
Lingxiao Wang
Sebastian U. Stich
Ziheng Cheng
Nirmit Joshi
Nathan Srebro
267
11
0
19 May 2024
The Future of Large Language Model Pre-training is Federated
Lorenzo Sani
Alexandru Iacob
Zeyu Cao
Bill Marino
Yan Gao
...
Wanru Zhao
William F. Shen
Preslav Aleksandrov
Xinchi Qiu
Nicholas D. Lane
AI4CE
447
40
0
17 May 2024
Towards Fairness in Provably Communication-Efficient Federated Recommender Systems
Kirandeep Kaur
Sujit Gujar
Shweta Jain
FedML
259
0
0
03 May 2024
Not All Federated Learning Algorithms Are Created Equal: A Performance Evaluation Study
Gustav A. Baumgart
Jaemin Shin
Ali Payani
Myungjin Lee
Ramana Rao Kompella
FedML
153
15
0
26 Mar 2024
FLASH: Federated Learning Across Simultaneous Heterogeneities
Xiangyu Chang
Sk. Miraj Ahmed
S. Krishnamurthy
Başak Güler
A. Swami
Samet Oymak
Amit K. Roy-Chowdhury
FedML
357
4
0
13 Feb 2024
FedImpro: Measuring and Improving Client Update in Federated Learning
International Conference on Learning Representations (ICLR), 2024
Zhenheng Tang
Yonggang Zhang
Shaoshuai Shi
Xinmei Tian
Tongliang Liu
Bo Han
Xiaowen Chu
FedML
297
23
0
10 Feb 2024
Version age-based client scheduling policy for federated learning
Xinyi Hu
Nikolaos Pappas
Howard H. Yang
200
7
0
08 Feb 2024
Asynchronous Wireless Federated Learning with Probabilistic Client Selection
IEEE Transactions on Wireless Communications (IEEE TWC), 2023
Jiarong Yang
Yuan Liu
Fangjiong Chen
Wen Chen
Changle Li
FedML
185
17
0
28 Nov 2023
Federated Learning with Manifold Regularization and Normalized Update Reaggregation
Neural Information Processing Systems (NeurIPS), 2023
Xuming An
Li Shen
Han Hu
Yong Luo
FedML
205
11
0
10 Nov 2023
DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning with Static and Streaming Dataset
Weijie Liu
Xiaoxi Zhang
Jingpu Duan
Carlee Joe-Wong
Zhi Zhou
Xu Chen
238
21
0
20 Oct 2023
Enabling Differentially Private Federated Learning for Speech Recognition: Benchmarks, Adaptive Optimizers and Gradient Clipping
Martin Pelikan
Sheikh Shams Azam
Vitaly Feldman
Jan Honza Silovsky
Kunal Talwar
Christopher G. Brinton
Tatiana Likhomanenko
577
8
0
29 Sep 2023
Stochastic Controlled Averaging for Federated Learning with Communication Compression
International Conference on Learning Representations (ICLR), 2023
Xinmeng Huang
Ping Li
Xiaoyun Li
390
253
0
16 Aug 2023
Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learning
Neural Information Processing Systems (NeurIPS), 2023
Zachary B. Charles
Nicole Mitchell
Krishna Pillutla
Michael Reneer
Zachary Garrett
FedML
AI4CE
320
33
0
18 Jul 2023
Pollen: High-throughput Federated Learning Simulation via Resource-Aware Client Placement
Lorenzo Sani
Pedro Gusmão
Alexandru Iacob
Wanru Zhao
Xinchi Qiu
Yan Gao
Javier Fernandez-Marques
Nicholas D. Lane
235
0
0
30 Jun 2023
Synthetic data shuffling accelerates the convergence of federated learning under data heterogeneity
Yue Liu
Yasin Esfandiari
Mikkel N. Schmidt
T. S. Alstrøm
Sebastian U. Stich
FedML
296
6
0
23 Jun 2023
Improving Accelerated Federated Learning with Compression and Importance Sampling
Michal Grudzieñ
Grigory Malinovsky
Peter Richtárik
FedML
275
11
0
05 Jun 2023
Perspectives on AI Architectures and Co-design for Earth System Predictability
Artificial Intelligence for the Earth Systems (AI4ES), 2023
M. Mudunuru
James A. Ang
M. Halappanavar
Simon D. Hammond
Maya Gokhale
...
Tushar Krishna
S. Sreepathi
Matthew R. Norman
Ivy Bo Peng
Philip W. Jones
142
2
0
07 Apr 2023
A Comparative Study of Federated Learning Models for COVID-19 Detection
Erfan Darzidehkalani
N. Sijtsema
P. V. Ooijen
FedML
OOD
134
4
0
28 Mar 2023
Green Federated Learning
Ashkan Yousefpour
Sheng Guo
Ashish Shenoy
Sayan Ghosh
Pierre Stock
Kiwan Maeng
Schalk-Willem Kruger
Michael G. Rabbat
Carole-Jean Wu
Ilya Mironov
FedML
AI4CE
280
16
0
26 Mar 2023
An Empirical Evaluation of Federated Contextual Bandit Algorithms
Alekh Agarwal
H. B. McMahan
Zheng Xu
FedML
283
2
0
17 Mar 2023
Making Batch Normalization Great in Federated Deep Learning
Shitian Zhao
Hong-You Chen
Wei-Lun Chao
FedML
593
12
0
12 Mar 2023
FLINT: A Platform for Federated Learning Integration
Conference on Machine Learning and Systems (MLSys), 2023
Ewen N. Wang
Ajaykumar Kannan
Yuefeng Liang
Boyi Chen
Mosharaf Chowdhury
296
29
0
24 Feb 2023
Federated Gradient Matching Pursuit
IEEE Transactions on Information Theory (IEEE Trans. Inf. Theory), 2023
Halyun Jeong
Deanna Needell
Jing Qin
FedML
179
2
0
20 Feb 2023
Revisiting Weighted Aggregation in Federated Learning with Neural Networks
International Conference on Machine Learning (ICML), 2023
Zexi Li
Tao Lin
Xinyi Shang
Chao-Xiang Wu
FedML
334
102
0
14 Feb 2023
Topology-aware Federated Learning in Edge Computing: A Comprehensive Survey
ACM Computing Surveys (ACM Comput. Surv.), 2023
Jiajun Wu
Steve Drew
Fan Dong
Zhuangdi Zhu
Jiayu Zhou
FedML
321
96
0
06 Feb 2023
Federated Automatic Differentiation
Keith Rush
Zachary B. Charles
Zachary Garrett
FedML
283
1
0
18 Jan 2023
On Noisy Evaluation in Federated Hyperparameter Tuning
Conference on Machine Learning and Systems (MLSys), 2022
Kevin Kuo
Pratiksha Thaker
M. Khodak
John Nguyen
Daniel Jiang
Ameet Talwalkar
Virginia Smith
FedML
374
9
0
17 Dec 2022
Analysis of Error Feedback in Federated Non-Convex Optimization with Biased Compression
Xiaoyun Li
Ping Li
FedML
209
6
0
25 Nov 2022
FLamby: Datasets and Benchmarks for Cross-Silo Federated Learning in Realistic Healthcare Settings
Neural Information Processing Systems (NeurIPS), 2022
Jean Ogier du Terrail
Samy Ayed
Edwige Cyffers
Felix Grimberg
Chaoyang He
...
Sai Praneeth Karimireddy
Marco Lorenzi
Giovanni Neglia
Marc Tommasi
M. Andreux
FedML
331
194
0
10 Oct 2022
Taming Fat-Tailed ("Heavier-Tailed'' with Potentially Infinite Variance) Noise in Federated Learning
Neural Information Processing Systems (NeurIPS), 2022
Haibo Yang
Pei-Yuan Qiu
Jia Liu
FedML
351
17
0
03 Oct 2022
Federated Select: A Primitive for Communication- and Memory-Efficient Federated Learning
Zachary B. Charles
Kallista A. Bonawitz
Stanislav Chiknavaryan
H. B. McMahan
Blaise Agüera y Arcas
FedML
144
14
0
19 Aug 2022
Reconciling Security and Communication Efficiency in Federated Learning
IEEE Data Engineering Bulletin (DEB), 2022
Karthik Prasad
Sayan Ghosh
Graham Cormode
Ilya Mironov
Ashkan Yousefpour
Pierre Stock
FedML
174
11
0
26 Jul 2022
TCT: Convexifying Federated Learning using Bootstrapped Neural Tangent Kernels
Neural Information Processing Systems (NeurIPS), 2022
Yaodong Yu
Alexander Wei
Sai Praneeth Karimireddy
Yi-An Ma
Michael I. Jordan
FedML
258
33
0
13 Jul 2022
Variance Reduced ProxSkip: Algorithm, Theory and Application to Federated Learning
Neural Information Processing Systems (NeurIPS), 2022
Grigory Malinovsky
Kai Yi
Peter Richtárik
FedML
300
42
0
09 Jul 2022
Motley: Benchmarking Heterogeneity and Personalization in Federated Learning
Shan-shan Wu
Tian Li
Zachary B. Charles
Yu Xiao
Ziyu Liu
Zheng Xu
Virginia Smith
FedML
492
53
0
18 Jun 2022
On the Unreasonable Effectiveness of Federated Averaging with Heterogeneous Data
Jianyu Wang
Rudrajit Das
Gauri Joshi
Satyen Kale
Zheng Xu
Tong Zhang
FedML
223
46
0
09 Jun 2022
1
2
Next
