Exploring Low Rank Training of Deep Neural Networks

27 September 2022

Jimmy Ba

Papers citing "Exploring Low Rank Training of Deep Neural Networks"

3 / 3 papers shown

Title
GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection Jiawei Zhao Zhenyu (Allen) Zhang Beidi Chen Zhangyang Wang A. Anandkumar Yuandong Tian 27 173 0 06 Mar 2024
Point Cloud Network: An Order of Magnitude Improvement in Linear Layer Parameter Count Charles Hetterich 3DPC 6 0 0 22 Sep 2023
Initialization and Regularization of Factorized Neural Layers M. Khodak Neil A. Tenenholtz Lester W. Mackey Nicolò Fusi 63 56 0 03 May 2021