Grokking as a First Order Phase Transition in Two Layer Networks

5 October 2023

Papers citing "Grokking as a First Order Phase Transition in Two Layer Networks"

5 / 5 papers shown

Title
Learning Single-Index Models with Shallow Neural Networks A. Bietti Joan Bruna Clayton Sanford M. Song 160 65 0 27 Oct 2022
Grokking phase transitions in learning local rules with gradient descent Bojan Žunkovič E. Ilievski 50 16 0 26 Oct 2022
Omnigrok: Grokking Beyond Algorithmic Data Ziming Liu Eric J. Michaud Max Tegmark 54 76 0 03 Oct 2022
Neural Networks Efficiently Learn Low-Dimensional Representations with SGD Alireza Mousavi-Hosseini Sejun Park M. Girotti Ioannis Mitliagkas Murat A. Erdogdu MLT 319 48 0 29 Sep 2022
MCMC using Hamiltonian dynamics Radford M. Neal 132 3,260 0 09 Jun 2012