Scaling Laws for the Value of Individual Data Points in Machine Learning

30 May 2024

Papers citing "Scaling Laws for the Value of Individual Data Points in Machine Learning"

7 / 7 papers shown

Title
Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models Yulei Qin Yuncheng Yang Pengcheng Guo Gang Li Hang Shao Yuchen Shi Zihan Xu Yun Gu Ke Li Xing Sun ALM 88 11 0 31 Dec 2024
Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance Jiasheng Ye Peiju Liu Tianxiang Sun Yunhua Zhou Jun Zhan Xipeng Qiu 37 60 0 25 Mar 2024
OpenDataVal: a Unified Benchmark for Data Valuation Kevin Jiang Weixin Liang James Y. Zou Yongchan Kwon FedML 42 34 0 18 Jun 2023
Variance reduced Shapley value estimation for trustworthy data valuation Mengmeng Wu R. Jia Changle Lin Wei Huang Xiangyu Chang TDI 35 12 0 30 Oct 2022
Tutorial on amortized optimization Brandon Amos OffRL 70 42 0 01 Feb 2022
Learning Curve Theory Marcus Hutter 128 58 0 08 Feb 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,424 0 23 Jan 2020