Imitating Deep Learning Dynamics via Locally Elastic Stochastic
Differential Equations

Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations

11 October 2021

Weijie J. Su

Papers citing "Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations"

7 / 7 papers shown

Title
When Representations Align: Universality in Representation Learning Dynamics Loek van Rossem Andrew M. Saxe AI4CE 33 4 0 14 Feb 2024
Neural (Tangent Kernel) Collapse Mariia Seleznova Dana Weitzner Raja Giryes Gitta Kutyniok H. Chou 11 6 0 25 May 2023
Deep Neural Collapse Is Provably Optimal for the Deep Unconstrained Features Model Peter Súkeník Marco Mondelli Christoph H. Lampert 13 20 0 22 May 2023
TiDAL: Learning Training Dynamics for Active Learning Seong Min Kye Kwanghee Choi Hyeongmin Byun Buru Chang 11 13 0 13 Oct 2022
Neural Collapse: A Review on Modelling Principles and Generalization Vignesh Kothapalli 19 69 0 08 Jun 2022
Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training Cong Fang Hangfeng He Qi Long Weijie J. Su FAtt 114 162 0 29 Jan 2021
On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima N. Keskar Dheevatsa Mudigere J. Nocedal M. Smelyanskiy P. T. P. Tang ODL 273 2,878 0 15 Sep 2016