Privately Fine-Tuning Large Language Models with Differential Privacy

26 October 2022

R. Behnia

Mohammadreza Ebrahimi

Jason L. Pacheco

B. Padmanabhan

ArXiv PDF HTML

Papers citing "Privately Fine-Tuning Large Language Models with Differential Privacy"

30 / 30 papers shown

Title
Can Language Models Follow Multiple Turns of Entangled Instructions? Chi Han ELM LRM 38 1 0 17 Mar 2025
Can Textual Gradient Work in Federated Learning? Minghui Chen Ruinan Jin Wenlong Deng Yuanyuan Chen Zhi Huang Han Yu Xiaoxiao Li FedML 70 2 0 27 Feb 2025
Privacy in Fine-tuning Large Language Models: Attacks, Defenses, and Future Directions Hao Du Shang Liu Lele Zheng Yang Cao Atsuyoshi Nakamura Lei Chen AAML 103 3 0 21 Dec 2024
AI Delegates with a Dual Focus: Ensuring Privacy and Strategic Self-Disclosure Xi Chen Zhiyang Zhang Fangkai Yang Xiaoting Qin Chao Du ... Hangxin Liu Qingwei Lin Saravan Rajmohan Dongmei Zhang Qi Zhang 23 1 0 26 Sep 2024
Differential Privacy Regularization: Protecting Training Data Through Loss Function Regularization Francisco Aguilera-Martínez Fernando Berzal 30 0 0 25 Sep 2024
Trustworthiness in Retrieval-Augmented Generation Systems: A Survey Yujia Zhou Yan Liu Xiaoxi Li Jiajie Jin Hongjin Qian Zheng Liu Chaozhuo Li Zhicheng Dou Tsung-Yi Ho Philip S. Yu 3DV RALM 43 22 0 16 Sep 2024
Generated Data with Fake Privacy: Hidden Dangers of Fine-tuning Large Language Models on Generated Data Atilla Akkus Mingjie Li Junjie Chu Junjie Chu Michael Backes Sinem Sav Sinem Sav SILM SyDa 28 1 0 12 Sep 2024
Exploring User Privacy Awareness on GitHub: An Empirical Study Costanza Alfieri Juri Di Rocco Paola Inverardi Phuong T. Nguyen SyDa 20 0 0 06 Sep 2024
Model Agnostic Hybrid Sharding For Heterogeneous Distributed Inference Claudio Angione Yue Zhao Harry Yang Ahmad Farhan Fielding Johnston James Buban Patrick Colangelo 31 1 0 29 Jul 2024
Learning-From-Mistakes Prompting for Indigenous Language Translation You-Cheng Liao Chen-Jui Yu Chi-Yi Lin He-Feng Yun Yen-Hsiang Wang Hsiao-Min Li Yao-Chung Fan 26 1 0 18 Jul 2024
PFID: Privacy First Inference Delegation Framework for LLMs Haoyan Yang Zhitao Li Yong Zhang Jianzong Wang Ning Cheng Ming Li Jing Xiao 23 1 0 18 Jun 2024
CheckEmbed: Effective Verification of LLM Solutions to Open-Ended Tasks Maciej Besta Lorenzo Paleari Aleš Kubíček Piotr Nyczyk Robert Gerstenberger Patrick Iff Tomasz Lehmann H. Niewiadomski Torsten Hoefler 52 5 0 04 Jun 2024
Large Language Models for UAVs: Current State and Pathways to the Future Shumaila Javaid Nasir Saeed Bin He 32 15 0 02 May 2024
Initial Exploration of Zero-Shot Privacy Utility Tradeoffs in Tabular Data Using GPT-4 Bishwas Mandal G. Amariucai Shuangqing Wei 16 1 0 07 Apr 2024
On Protecting the Data Privacy of Large Language Models (LLMs): A Survey Biwei Yan Kun Li Minghui Xu Yueyan Dong Yue Zhang Zhaochun Ren Xiuzhen Cheng AILaw PILM 70 70 0 08 Mar 2024
Data Augmentation using Large Language Models: Data Perspectives, Learning Paradigms and Challenges Bosheng Ding Chengwei Qin Ruochen Zhao Tianze Luo Xinze Li Guizhen Chen Wenhan Xia Junjie Hu A. Luu Shafiq R. Joty 29 16 0 05 Mar 2024
A Survey of Large Language Models in Cybersecurity Gabriel de Jesus Coelho da Silva Carlos Becker Westphall 19 5 0 26 Feb 2024
From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscape Timothy R. McIntosh Teo Susnjak Tong Liu Paul Watters Malka N. Halgamuge 79 46 0 18 Dec 2023
Grounding Foundation Models through Federated Transfer Learning: A General Framework Yan Kang Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 59 19 0 29 Nov 2023
Differentially Private Reward Estimation with Preference Feedback Sayak Ray Chowdhury Xingyu Zhou Nagarajan Natarajan 20 4 0 30 Oct 2023
Private Matrix Factorization with Public Item Features Mihaela Curmei Walid Krichene Li Zhang Mukund Sundararajan 12 3 0 17 Sep 2023
Privacy Aware Question-Answering System for Online Mental Health Risk Assessment P. Chhikara Ujjwal Pasupulety J. Marshall Dhiraj Chaurasia Shwetanjali Kumari AI4MH 8 2 0 09 Jun 2023
Challenges and Remedies to Privacy and Security in AIGC: Exploring the Potential of Privacy Computing, Blockchain, and Beyond Chuan Chen Zhenpeng Wu Yan-Hao Lai Wen-chao Ou Tianchi Liao Zibin Zheng 4 30 0 01 Jun 2023
Differentially Private Attention Computation Yeqi Gao Zhao-quan Song Xin Yang 42 19 0 08 May 2023
Differentially Private Natural Language Models: Recent Advances and Future Directions Lijie Hu Ivan Habernal Lei Shen Di Wang AAML 10 17 0 22 Jan 2023
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 131 258 0 13 Oct 2021
Zero-Shot Text-to-Image Generation Aditya A. Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen Ilya Sutskever VLM 253 4,735 0 24 Feb 2021
Transformer-based Conditional Variational Autoencoder for Controllable Story Generation Le Fang Tao Zeng Chao-Ning Liu Liefeng Bo Wen Dong Changyou Chen DRL 39 58 0 04 Jan 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 264 1,798 0 14 Dec 2020
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018