Papers
Communities
Events
Blog
Pricing
Search
Open menu
Home
Papers
2410.01623
Cited By
Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
2 October 2024
Xi Chen
Kaituo Feng
Changsheng Li
Xunhao Lai
Xiangyu Yue
Ye Yuan
Guoren Wang
Re-assign community
ArXiv
PDF
HTML
Papers citing
"Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?"
1 / 1 papers shown
Title
Memory-Efficient LLM Training by Various-Grained Low-Rank Projection of Gradients
Yezhen Wang
Zhouhao Yang
Brian K Chen
Fanyi Pu
Bo-wen Li
Tianyu Gao
Kenji Kawaguchi
34
0
0
03 May 2025
1