Dynamic Gradient Alignment for Online Data Mixing

3 October 2024

Simin Fan

Pierre Ablin

Papers citing "Dynamic Gradient Alignment for Online Data Mixing"

1 / 1 papers shown

Title
R&B: Domain Regrouping and Data Mixture Balancing for Efficient Foundation Model Training Albert Ge Tzu-Heng Huang John Cooper Avi Trost Ziyi Chu Satya Sai Srinath Namburi GNVV Ziyang Cai Kendall Park Nicholas Roberts Frederic Sala 47 0 0 01 May 2025