Feature learning as alignment: a structural property of gradient descent in non-linear neural networks

7 February 2024

Papers citing "Feature learning as alignment: a structural property of gradient descent in non-linear neural networks"

2 / 2 papers shown

Title
Neural Networks Efficiently Learn Low-Dimensional Representations with SGD Alireza Mousavi-Hosseini Sejun Park M. Girotti Ioannis Mitliagkas Murat A. Erdogdu MLT 313 48 0 29 Sep 2022
Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher Guangda Ji Zhanxing Zhu 43 32 0 20 Oct 2020