Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2206.15397
Cited By
Randomized K-FACs: Speeding up K-FAC with Randomized Numerical Linear Algebra
30 June 2022
C. Puiu
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Randomized K-FACs: Speeding up K-FAC with Randomized Numerical Linear Algebra"
2 / 2 papers shown
Title
COSMOS: A Hybrid Adaptive Optimizer for Memory-Efficient Training of LLMs
Liming Liu
Zhenghao Xu
Zixuan Zhang
Hao Kang
Zichong Li
Chen Liang
Weizhu Chen
T. Zhao
125
1
0
24 Feb 2025
SOAP: Improving and Stabilizing Shampoo using Adam
Nikhil Vyas
Depen Morwani
Rosie Zhao
Itai Shapira
David Brandfonbrener
Lucas Janson
Sham Kakade
Sham Kakade
72
23
0
17 Sep 2024
1