Efficient Compression of Overparameterized Deep Models through
Low-Dimensional Learning Dynamics

Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics

8 November 2023

Zekai Zhang

Qing Qu

Papers citing "Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics"

4 / 4 papers shown

Title
Structure-Preserving Network Compression Via Low-Rank Induced Training Through Linear Layers Composition Xitong Zhang Ismail R. Alkhouri Rongrong Wang 27 0 0 06 May 2024
Investigating the Catastrophic Forgetting in Multimodal Large Language Models Yuexiang Zhai Shengbang Tong Xiao Li Mu Cai Qing Qu Yong Jae Lee Y. Ma VLM MLLM CLL 72 75 0 19 Sep 2023
Cuttlefish: Low-Rank Model Training without All the Tuning Hongyi Wang Saurabh Agarwal Pongsakorn U-chupala Yoshiki Tanaka Eric P. Xing Dimitris Papailiopoulos OffRL 45 21 0 04 May 2023
Initialization and Regularization of Factorized Neural Layers M. Khodak Neil A. Tenenholtz Lester W. Mackey Nicolò Fusi 63 56 0 03 May 2021