SHED: Shapley-Based Automated Dataset Refinement for Instruction
Fine-Tuning

SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning

23 April 2024

Zheyu Shen

Guoheng Sun

Ang Li

Papers citing "SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning"

4 / 4 papers shown

Title
Take the essence and discard the dross: A Rethinking on Data Selection for Fine-Tuning Large Language Models Ziche Liu Rui Ke Feng Jiang Feng Jiang Haizhou Li 61 1 0 20 Jun 2024
Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks Po-Nien Kung Fan Yin Di Wu Kai-Wei Chang Nanyun Peng 67 39 0 01 Nov 2023
Data Selection for Fine-tuning Large Language Models Using Transferred Shapley Values S. Schoch Ritwick Mishra Yangfeng Ji TDI 75 18 0 16 Jun 2023
GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Training Krishnateja Killamsetty D. Sivasubramanian Ganesh Ramakrishnan A. De Rishabh K. Iyer OOD 86 188 0 27 Feb 2021