Data Selection via Optimal Control for Language Models

9 October 2024

Hongning Wang

Qingxiu Dong

Minlie Huang

Papers citing "Data Selection via Optimal Control for Language Models"

3 / 3 papers shown

Title
QuaDMix: Quality-Diversity Balanced Data Selection for Efficient LLM Pretraining Fengze Liu Weidong Zhou Binbin Liu Zhimiao Yu Yifan Zhang ... Yifeng Yu Bingni Zhang Xiaohuan Zhou Taifeng Wang Yong Cao 50 0 0 23 Apr 2025
MASS: Mathematical Data Selection via Skill Graphs for Pretraining Large Language Models J. Li Lu Yu Qing Cui Zhiqiang Zhang Jun Zhou Yanfang Ye Chuxu Zhang 51 0 0 19 Mar 2025
MiniPLM: Knowledge Distillation for Pre-Training Language Models Yuxian Gu Hao Zhou Fandong Meng Jie Zhou Minlie Huang 46 5 0 22 Oct 2024