Revealing the Utilized Rank of Subspaces of Learning in Neural Networks

5 July 2024

Papers citing "Revealing the Utilized Rank of Subspaces of Learning in Neural Networks"

3 / 3 papers shown

Title
Neural Rank Collapse: Weight Decay and Small Within-Class Variability Yield Low-Rank Bias Emanuele Zangrando Piero Deidda Simone Brugiapaglia Nicola Guglielmi Francesco Tudisco 27 8 0 06 Feb 2024
Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations Steffen Schotthöfer Emanuele Zangrando J. Kusch Gianluca Ceruti Francesco Tudisco 53 30 0 26 May 2022
Initialization and Regularization of Factorized Neural Layers M. Khodak Neil A. Tenenholtz Lester W. Mackey Nicolò Fusi 63 56 0 03 May 2021