Tending Towards Stability: Convergence Challenges in Small Language Models

15 October 2024

Papers citing "Tending Towards Stability: Convergence Challenges in Small Language Models"

1 / 1 papers shown

Title
PolyPythias: Stability and Outliers across Fifty Language Model Pre-Training Runs Oskar van der Wal Pietro Lesci Max Muller-Eberstein Naomi Saphra Hailey Schoelkopf Willem H. Zuidema Stella Biderman LRM 56 0 0 12 Mar 2025