Rethinking Data Selection for Supervised Fine-Tuning

8 February 2024

Papers citing "Rethinking Data Selection for Supervised Fine-Tuning"

5 / 5 papers shown

Title
Data Diversity Matters for Robust Instruction Tuning Alexander Bukharin Tuo Zhao 72 35 0 21 Nov 2023
Maybe Only 0.5% Data is Needed: A Preliminary Exploration of Low Training Data Instruction Tuning Haowen Chen Yiming Zhang Qi Zhang Hantao Yang Xiaomeng Hu Xuetao Ma Yifan YangGong J. Zhao ALM 61 46 0 16 May 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 303 11,730 0 04 Mar 2022
A Data-Centric Approach for Training Deep Neural Networks with Less Data Mohammad Motamedi Nikolay Sakharnykh T. Kaldewey 54 65 0 07 Oct 2021
Data-Centric AI Requires Rethinking Data Notion Mustafa Hajij Ghada Zamzmi K. Ramamurthy Aldo Guzmán-Sáenz 44 16 0 06 Oct 2021