Enhancing Data Quality in Federated Fine-Tuning of Foundation Models

Enhancing Data Quality in Federated Fine-Tuning of Foundation Models

7 March 2024

Nicholas D. Lane

Siheng Chen

Papers citing "Enhancing Data Quality in Federated Fine-Tuning of Foundation Models"

5 / 5 papers shown

Title
Ten Challenging Problems in Federated Foundation Models Tao Fan Hanlin Gu Xuemei Cao Chee Seng Chan Qian Chen ... Y. Zhang Xiaojin Zhang Zhenzhe Zheng Lixin Fan Qiang Yang FedML 73 4 0 14 Feb 2025
Towards Understanding and Mitigating Dimensional Collapse in Heterogeneous Federated Learning Yujun Shi Jian Liang Wenqing Zhang Vincent Y. F. Tan Song Bai FedML 64 55 0 01 Oct 2022
Deduplicating Training Data Makes Language Models Better Katherine Lee Daphne Ippolito A. Nystrom Chiyuan Zhang Douglas Eck Chris Callison-Burch Nicholas Carlini SyDa 237 588 0 14 Jul 2021
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,424 0 23 Jan 2020
PubMedQA: A Dataset for Biomedical Research Question Answering Qiao Jin Bhuwan Dhingra Zhengping Liu William W. Cohen Xinghua Lu 202 791 0 13 Sep 2019