Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data

Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data

4 October 2023

Gal Vardi

Papers citing "Benign Overfitting and Grokking in ReLU Networks for XOR Cluster Data"

7 / 7 papers shown

Title
Sharper Guarantees for Learning Neural Network Classifiers with Gradient Methods Hossein Taheri Christos Thrampoulidis Arya Mazumdar MLT 26 0 0 13 Oct 2024
Overfitting Behaviour of Gaussian Kernel Ridgeless Regression: Varying Bandwidth or Dimensionality Marko Medvedev Gal Vardi Nathan Srebro 49 3 0 05 Sep 2024
Information-Theoretic Progress Measures reveal Grokking is an Emergent Phase Transition Kenzo Clauw S. Stramaglia Daniele Marinazzo 45 3 0 16 Aug 2024
When does compositional structure yield compositional generalization? A kernel theory Samuel Lippl Kim Stachenfeld NAI CoGe 62 5 0 26 May 2024
Benign Overfitting in Linear Classifiers and Leaky ReLU Networks from KKT Conditions for Margin Maximization Spencer Frei Gal Vardi Peter L. Bartlett Nathan Srebro 27 22 0 02 Mar 2023
Grokking phase transitions in learning local rules with gradient descent Bojan Žunkovič E. Ilievski 50 16 0 26 Oct 2022
Omnigrok: Grokking Beyond Algorithmic Data Ziming Liu Eric J. Michaud Max Tegmark 54 76 0 03 Oct 2022