On the Interaction of Noise, Compression Role, and Adaptivity under $(L_0, L_1)$ -Smoothness: An SDE-based Approach

30 May 2025

Papers citing "On the Interaction of Noise, Compression Role, and Adaptivity under $(L_0, L_1)$-Smoothness: An SDE-based Approach"

1 / 1 papers shown

Title
Is your batch size the problem? Revisiting the Adam-SGD gap in language modeling Teodora Srećković Jonas Geiping Antonio Orvieto MoE 11 0 0 14 Jun 2025