Selective Pre-training for Private Fine-tuning

23 May 2023

Papers citing "Selective Pre-training for Private Fine-tuning"

26 / 26 papers shown

Title
DPImageBench: A Unified Benchmark for Differentially Private Image Synthesis Chen Gong Kecen Li Zinan Lin Tianhao Wang 47 3 0 18 Mar 2025
AugFL: Augmenting Federated Learning with Pretrained Models Sheng Yue Zerui Qin Yongheng Deng Ju Ren Yaoxue Zhang Junshan Zhang FedML 80 0 0 04 Mar 2025
Ten Challenging Problems in Federated Foundation Models Tao Fan Hanlin Gu Xuemei Cao Chee Seng Chan Qian Chen ... Y. Zhang Xiaojin Zhang Zhenzhe Zheng Lixin Fan Qiang Yang FedML 75 4 0 14 Feb 2025
Differentially Private Synthetic Data via APIs 3: Using Simulators Instead of Foundation Model Zinan Lin Tadas Baltrusaitis Sergey Yekhanin SyDa 83 1 0 08 Feb 2025
Differentially Private Kernel Density Estimation Erzhi Liu Jerry Yao-Chieh Hu Alex Reneau Zhao Song Han Liu 61 3 0 03 Sep 2024
LLM-PBE: Assessing Data Privacy in Large Language Models Qinbin Li Junyuan Hong Chulin Xie Jeffrey Tan Rachel Xin ... Dan Hendrycks Zhangyang Wang Bo Li Bingsheng He Dawn Song ELM PILM 36 12 0 23 Aug 2024
Unique Security and Privacy Threats of Large Language Model: A Comprehensive Survey Shang Wang Tianqing Zhu Bo Liu Ming Ding Xu Guo Dayong Ye Wanlei Zhou Philip S. Yu PILM 57 17 0 12 Jun 2024
PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restoration Ziqian Zeng Jianwei Wang Zhengdong Lu Huiping Zhuang Cen Chen RALM KELM 30 7 0 03 Jun 2024
Small Language Models for Application Interactions: A Case Study Beibin Li Yi Zhang Sébastien Bubeck Jeevan Pathuri Ishai Menache 34 3 0 23 May 2024
Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data Haoran Li Xinyuan Zhao Dadi Guo Hanlin Gu Ziqian Zeng Yuxing Han Yangqiu Song Lixin Fan Qiang Yang 21 1 0 23 May 2024
Prompt Public Large Language Models to Synthesize Data for Private On-device Applications Shanshan Wu Zheng Xu Yanxiang Zhang Yuanbo Zhang Daniel Ramage SyDa 21 9 0 05 Apr 2024
Efficiently Computing Similarities to Private Datasets A. Backurs Zinan Lin S. Mahabadi Sandeep Silwal Jakub Tarnawski 60 4 0 13 Mar 2024
Differentially Private Knowledge Distillation via Synthetic Text Generation James Flemings Murali Annavaram SyDa 35 11 0 01 Mar 2024
Grounding Foundation Models through Federated Transfer Learning: A General Framework Yan Kang Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 68 19 0 29 Nov 2023
Privacy in Large Language Models: Attacks, Defenses and Future Directions Haoran Li Yulin Chen Jinglong Luo Yan Kang Xiaojin Zhang Qi Hu Chunkit Chan Yangqiu Song PILM 38 40 0 16 Oct 2023
Textbooks Are All You Need Suriya Gunasekar Yi Zhang J. Aneja C. C. T. Mendes Allison Del Giorno ... Sébastien Bubeck Ronen Eldan Adam Tauman Kalai Y. Lee Yuan-Fang Li AI4CE ALM SyDa 22 386 0 20 Jun 2023
Composition of Differential Privacy & Privacy Amplification by Subsampling Thomas Steinke 54 50 0 02 Oct 2022
Scalable and Efficient Training of Large Convolutional Neural Networks with Differential Privacy Zhiqi Bu J. Mao Shiyun Xu 131 47 0 21 May 2022
The Role of Adaptive Optimizers for Honest Private Hyperparameter Selection Shubhankar Mohapatra Sajin Sasy Xi He Gautam Kamath Om Thakkar 109 32 0 09 Nov 2021
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 134 346 0 13 Oct 2021
Hyperparameter Tuning with Renyi Differential Privacy Nicolas Papernot Thomas Steinke 123 119 0 07 Oct 2021
Deduplicating Training Data Makes Language Models Better Katherine Lee Daphne Ippolito A. Nystrom Chiyuan Zhang Douglas Eck Chris Callison-Burch Nicholas Carlini SyDa 237 590 0 14 Jul 2021
Leveraging Public Data for Practical Private Query Release Terrance Liu G. Vietri Thomas Steinke Jonathan R. Ullman Zhiwei Steven Wu 148 58 0 17 Feb 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 267 1,808 0 14 Dec 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 226 4,453 0 23 Jan 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018