Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)

19 May 2025

Papers citing "Gluon: Making Muon & Scion Great Again! (Bridging Theory and Practice of LMO-based Optimizers for LLMs)"

2 / 2 papers shown

Title
The Polar Express: Optimal Matrix Sign Methods and Their Application to the Muon Algorithm Noah Amsel David Persson Christopher Musco Robert Gower 23 1 0 22 May 2025
Understanding Gradient Orthogonalization for Deep Learning via Non-Euclidean Trust-Region Optimization Dmitry Kovalev 132 5 0 16 Mar 2025