Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
2002.12410
Cited By
v1
v2
v3
v4 (latest)
On Biased Compression for Distributed Learning
Journal of machine learning research (JMLR), 2020
27 February 2020
Aleksandr Beznosikov
Samuel Horváth
Peter Richtárik
M. Safaryan
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"On Biased Compression for Distributed Learning"
50 / 125 papers shown
Gradient Projection onto Historical Descent Directions for Communication-Efficient Federated Learning
Arnaud Descours
Léonard Deroose
Jan Ramon
FedML
159
0
0
05 Nov 2025
Composite Optimization with Error Feedback: the Dual Averaging Approach
Yuan Gao
Anton Rodomanov
Jeremy Rack
Sebastian U. Stich
165
1
0
03 Oct 2025
Accelerated Gradient Methods with Biased Gradient Estimates: Risk Sensitivity, High-Probability Guarantees, and Large Deviation Bounds
Mert Gurbuzbalaban
Yasa Syed
Necdet Serhat Aybat
313
1
0
17 Sep 2025
Tight analyses of first-order methods with error feedback
Daniel Berg Thomsen
Adrien B. Taylor
Hadrien Hendrikx
297
1
0
05 Jun 2025
Quantitative Error Feedback for Quantization Noise Reduction of Filtering over Graphs
Xue Xian Zheng
Weihang Liu
Xin Lou
Stefan Vlaski
Tareq Al-Naffouri
MQ
333
1
0
02 Jun 2025
Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)
Artem Riabinin
Egor Shulgin
Kaja Gruntkowska
Peter Richtárik
AI4CE
518
33
0
19 May 2025
Coded Robust Aggregation for Distributed Learning under Byzantine Attacks
Chengxi Li
Ming Xiao
Mikael Skoglund
OOD
AAML
FedML
220
0
0
17 May 2025
Analysis of Asynchronous Federated Learning: Unraveling the Interactions between Gradient Compression, Delay, and Data Heterogeneity
Diying Yang
Yingwei Hou
Danyang Xiao
FedML
513
0
0
28 Apr 2025
BurTorch: Revisiting Training from First Principles by Coupling Autodiff, Math Optimization, and Systems
Konstantin Burlachenko
Peter Richtárik
AI4CE
290
0
0
18 Mar 2025
Accelerated Distributed Optimization with Compression and Error Feedback
Yuan Gao
Anton Rodomanov
Jeremy Rack
Sebastian U. Stich
429
4
0
11 Mar 2025
Smoothed Normalization for Efficient Distributed Private Optimization
Egor Shulgin
Sarit Khirirat
Peter Richtárik
FedML
437
2
0
20 Feb 2025
MARINA-P: Superior Performance in Non-smooth Federated Optimization with Adaptive Stepsizes
Igor Sokolov
Peter Richtárik
346
1
0
22 Dec 2024
Accelerated Methods with Compressed Communications for Distributed Optimization Problems under Data Similarity
AAAI Conference on Artificial Intelligence (AAAI), 2024
Dmitry Bylinkin
Aleksandr Beznosikov
512
3
0
21 Dec 2024
Review of Mathematical Optimization in Federated Learning
Shusen Yang
Fangyuan Zhao
Zihao Zhou
Liang Shi
Xuebin Ren
Zongben Xu
FedML
AI4CE
430
6
0
02 Dec 2024
Problem-dependent convergence bounds for randomized linear gradient compression
Thomas Flynn
Patrick R. Johnstone
Shinjae Yoo
499
1
0
19 Nov 2024
Sketched Adaptive Federated Deep Learning: A Sharp Convergence Analysis
Zhijie Chen
Qiaobo Li
A. Banerjee
FedML
580
3
0
11 Nov 2024
Trustworthiness of Stochastic Gradient Descent in Distributed Learning
European Control Conference (ECC), 2024
Hongyang Li
Caesar Wu
Mohammed Chadli
Said Mammar
Pascal Bouvry
404
2
0
28 Oct 2024
Error Feedback under
(
L
0
,
L
1
)
(L_0,L_1)
(
L
0
,
L
1
)
-Smoothness: Normalization and Momentum
Sarit Khirirat
Abdurakhmon Sadiev
Artem Riabinin
Eduard A. Gorbunov
Peter Richtárik
378
10
0
22 Oct 2024
Tighter Performance Theory of FedExProx
Wojciech Anyszka
Kaja Gruntkowska
Alexander Tyurin
Peter Richtárik
FedML
248
2
0
20 Oct 2024
On the Convergence of FedProx with Extrapolation and Inexact Prox
Hanmin Li
Peter Richtárik
FedML
317
6
0
02 Oct 2024
Accelerated Stochastic ExtraGradient: Mixing Hessian and Gradient Similarity to Reduce Communication in Distributed and Federated Learning
Успехи математических наук (Uspekhi Mat. Nauk.), 2024
Dmitry Bylinkin
Kirill Degtyarev
Aleksandr Beznosikov
FedML
272
0
0
22 Sep 2024
Byzantine-Robust and Communication-Efficient Distributed Learning via Compressed Momentum Filtering
Changxin Liu
Yanghao Li
Yuhao Yi
Karl H. Johansson
FedML
243
1
0
13 Sep 2024
Mask-Encoded Sparsification: Mitigating Biased Gradients in Communication-Efficient Split Learning
European Conference on Artificial Intelligence (ECAI), 2024
Wenxuan Zhou
Zhihao Qu
Shen-Huan Lyu
Miao Cai
Baoliu Ye
389
1
0
25 Aug 2024
MSfusion: A Dynamic Model Splitting Approach for Resource-Constrained Machines to Collaboratively Train Larger Models
Jin Xie
Songze Li
FedML
252
0
0
04 Jul 2024
Towards Federated Learning with On-device Training and Communication in 8-bit Floating Point
Bokun Wang
Axel Berg
D. A. E. Acar
Chuteng Zhou
MQ
FedML
377
1
0
02 Jul 2024
Differential error feedback for communication-efficient decentralized learning
Roula Nassif
Stefan Vlaski
Marco Carpentiero
Vincenzo Matta
Ali H. Sayed
370
3
0
26 Jun 2024
Communication-efficient Vertical Federated Learning via Compressed Error Feedback
Pedro Valdeira
João Xavier
Cláudia Soares
Yuejie Chi
FedML
405
8
0
20 Jun 2024
Local Methods with Adaptivity via Scaling
Saveliy Chezhegov
Sergey Skorik
Nikolas Khachaturov
Danil Shalagin
A. Avetisyan
Aleksandr Beznosikov
Martin Takáč
Yaroslav Kholodov
Alexander Gasnikov
510
4
0
02 Jun 2024
SPAM: Stochastic Proximal Point Method with Momentum Variance Reduction for Non-convex Cross-Device Federated Learning
Avetik G. Karagulyan
Egor Shulgin
Abdurakhmon Sadiev
Peter Richtárik
FedML
334
4
0
30 May 2024
Near Optimal Decentralized Optimization with Compression and Momentum Tracking
Rustem Islamov
Yuan Gao
Sebastian U. Stich
318
0
0
30 May 2024
PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression
Neural Information Processing Systems (NeurIPS), 2024
Vladimir Malinovskii
Denis Mazur
Ivan Ilin
Denis Kuznedelev
Konstantin Burlachenko
Kai Yi
Dan Alistarh
Peter Richtárik
MQ
364
48
0
23 May 2024
Compressed Federated Reinforcement Learning with a Generative Model
Ali Beikmohammadi
Sarit Khirirat
Sindri Magnússon
FedML
388
5
0
26 Mar 2024
LoCoDL: Communication-Efficient Distributed Learning with Local Training and Compression
Laurent Condat
Artavazd Maranjyan
Peter Richtárik
495
11
0
07 Mar 2024
Communication Efficient ConFederated Learning: An Event-Triggered SAGA Approach
Bin Wang
Jun Fang
Hongbin Li
Yonina C. Eldar
FedML
274
4
0
28 Feb 2024
Gradient Coding in Decentralized Learning for Evading Stragglers
Chengxi Li
Mikael Skoglund
428
2
0
06 Feb 2024
Non-asymptotic Analysis of Biased Adaptive Stochastic Approximation
Sobihan Surendran
Antoine Godichon-Baggioni
Adeline Fermanian
Sylvain Le Corff
348
5
0
05 Feb 2024
Activations and Gradients Compression for Model-Parallel Training
Doklady. Mathematics (Dokl. Math.), 2023
Mikhail Rudakov
Aleksandr Beznosikov
Yaroslav Kholodov
Alexander Gasnikov
476
5
0
15 Jan 2024
Correlated Quantization for Faster Nonconvex Distributed Optimization
Conference on Uncertainty in Artificial Intelligence (UAI), 2024
Andrei Panferov
Yury Demidovich
Ahmad Rammal
Peter Richtárik
MQ
319
4
0
10 Jan 2024
EControl: Fast Distributed Optimization with Compression and Error Control
International Conference on Learning Representations (ICLR), 2023
Yuan Gao
Rustem Islamov
Sebastian U. Stich
325
17
0
06 Nov 2023
Escaping Saddle Points in Heterogeneous Federated Learning via Distributed SGD with Communication Compression
International Conference on Artificial Intelligence and Statistics (AISTATS), 2023
Sijin Chen
Zhize Li
Yuejie Chi
FedML
293
5
0
29 Oct 2023
Optimal Guarantees for Algorithmic Reproducibility and Gradient Complexity in Convex Optimization
Neural Information Processing Systems (NeurIPS), 2023
Liang Zhang
Junchi Yang
Amin Karbasi
Niao He
438
3
0
26 Oct 2023
Communication Compression for Byzantine Robust Learning: New Efficient Algorithms and Improved Rates
Ahmad Rammal
Kaja Gruntkowska
Nikita Fedin
Eduard A. Gorbunov
Peter Richtárik
432
13
0
15 Oct 2023
Exploring the Impact of Serverless Computing on Peer To Peer Training Machine Learning
Amine Barrak
Ranim Trabelsi
Fehmi Jaafar
Fábio Petrillo
264
5
0
25 Sep 2023
CORE: Common Random Reconstruction for Distributed Optimization with Provable Low Communication Complexity
Pengyun Yue
Hanzheng Zhao
Cong Fang
Di He
Liwei Wang
Zhouchen Lin
Song-Chun Zhu
248
1
0
23 Sep 2023
Stochastic Controlled Averaging for Federated Learning with Communication Compression
International Conference on Learning Representations (ICLR), 2023
Xinmeng Huang
Ping Li
Xiaoyun Li
453
279
0
16 Aug 2023
Towards a Better Theoretical Understanding of Independent Subnetwork Training
International Conference on Machine Learning (ICML), 2023
Egor Shulgin
Peter Richtárik
AI4CE
405
8
0
28 Jun 2023
Quantize Once, Train Fast: Allreduce-Compatible Compression with Provable Guarantees
Jihao Xin
Marco Canini
Peter Richtárik
Samuel Horváth
436
2
0
29 May 2023
A Guide Through the Zoo of Biased SGD
Neural Information Processing Systems (NeurIPS), 2023
Yury Demidovich
Grigory Malinovsky
Igor Sokolov
Peter Richtárik
327
48
0
25 May 2023
Error Feedback Shines when Features are Rare
Peter Richtárik
Elnur Gasanov
Konstantin Burlachenko
231
2
0
24 May 2023
Momentum Provably Improves Error Feedback!
Neural Information Processing Systems (NeurIPS), 2023
Ilyas Fatkhullin
Alexander Tyurin
Peter Richtárik
382
42
0
24 May 2023
1
2
3
Next
Page 1 of 3
