ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2102.09700
  4. Cited By
AI-SARAH: Adaptive and Implicit Stochastic Recursive Gradient Methods
v1v2v3 (latest)

AI-SARAH: Adaptive and Implicit Stochastic Recursive Gradient Methods

19 February 2021
Zheng Shi
Abdurakhmon Sadiev
Nicolas Loizou
Peter Richtárik
Martin Takávc
    ODL
ArXiv (abs)PDFHTML

Papers citing "AI-SARAH: Adaptive and Implicit Stochastic Recursive Gradient Methods"

10 / 10 papers shown
Glocal Smoothness: Line Search can really help!
Glocal Smoothness: Line Search can really help!
Curtis Fox
Aaron Mishkin
Sharan Vaswani
Mark Schmidt
219
4
0
14 Jun 2025
Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance
Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance
Dimitris Oikonomou
Nicolas Loizou
306
11
0
06 Jun 2024
Remove that Square Root: A New Efficient Scale-Invariant Version of AdaGrad
Remove that Square Root: A New Efficient Scale-Invariant Version of AdaGrad
Sayantan Choudhury
N. Tupitsa
Nicolas Loizou
Samuel Horváth
Martin Takáč
Eduard A. Gorbunov
421
5
0
05 Mar 2024
Stochastic Gradient Descent with Preconditioned Polyak Step-size
Stochastic Gradient Descent with Preconditioned Polyak Step-sizeComputational Mathematics and Mathematical Physics (CMMP), 2023
Farshed Abdukhakimov
Chulu Xiang
Dmitry Kamzolov
Martin Takáč
206
8
0
03 Oct 2023
Towards a Better Theoretical Understanding of Independent Subnetwork
  Training
Towards a Better Theoretical Understanding of Independent Subnetwork TrainingInternational Conference on Machine Learning (ICML), 2023
Egor Shulgin
Peter Richtárik
AI4CE
354
8
0
28 Jun 2023
On the Fairness Impacts of Private Ensembles Models
On the Fairness Impacts of Private Ensembles ModelsInternational Joint Conference on Artificial Intelligence (IJCAI), 2023
Cuong Tran
Ferdinando Fioretto
203
6
0
19 May 2023
FLECS-CGD: A Federated Learning Second-Order Framework via Compression
  and Sketching with Compressed Gradient Differences
FLECS-CGD: A Federated Learning Second-Order Framework via Compression and Sketching with Compressed Gradient Differences
A. Agafonov
Brahim Erraji
Martin Takáč
FedML
242
5
0
18 Oct 2022
An Adaptive Incremental Gradient Method With Support for Non-Euclidean
  Norms
An Adaptive Incremental Gradient Method With Support for Non-Euclidean Norms
Binghui Xie
Chen Jin
Kaiwen Zhou
James Cheng
Wei Meng
183
1
0
28 Apr 2022
Accelerating Perturbed Stochastic Iterates in Asynchronous Lock-Free
  Optimization
Accelerating Perturbed Stochastic Iterates in Asynchronous Lock-Free Optimization
Kaiwen Zhou
Anthony Man-Cho So
James Cheng
202
1
0
30 Sep 2021
A Fairness Analysis on Private Aggregation of Teacher Ensembles
A Fairness Analysis on Private Aggregation of Teacher Ensembles
Cuong Tran
M. H. Dinh
Kyle Beiter
Ferdinando Fioretto
227
14
0
17 Sep 2021
1