Grokking Modular Polynomials

5 June 2024

Papers citing "Grokking Modular Polynomials"

5 / 5 papers shown

Title
Let Me Grok for You: Accelerating Grokking via Embedding Transfer from a Weaker Model Zhiwei Xu Zhiyu Ni Yixin Wang Wei Hu CLL 32 0 0 17 Apr 2025
Low Rank and Sparse Fourier Structure in Recurrent Networks Trained on Modular Addition Akshay Rangamani 35 0 0 28 Mar 2025
Teaching Transformers Modular Arithmetic at Scale Eshika Saxena Alberto Alfarano Emily Wenger Kristin E. Lauter 22 0 0 04 Oct 2024
Emergence in non-neural models: grokking modular arithmetic via average gradient outer product Neil Rohit Mallinar Daniel Beaglehole Libin Zhu Adityanarayanan Radhakrishnan Parthe Pandit Misha Belkin 37 7 0 29 Jul 2024
Omnigrok: Grokking Beyond Algorithmic Data Ziming Liu Eric J. Michaud Max Tegmark 54 76 0 03 Oct 2022