Delving into Differentially Private Transformer

Delving into Differentially Private Transformer

28 May 2024

Papers citing "Delving into Differentially Private Transformer"

12 / 12 papers shown

Title
A Theoretical Survey on Foundation Models Shi Fu Yuzhu Chen Yingjie Wang Dacheng Tao 21 0 0 15 Oct 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs Charlie Hou Akshat Shrivastava Hongyuan Zhan Rylan Conway Trang Le Adithya Sagar Giulia Fanti Daniel Lazar 24 8 0 05 Jun 2024
Private Fine-tuning of Large Language Models with Zeroth-order Optimization Xinyu Tang Ashwinee Panda Milad Nasr Saeed Mahloujifar Prateek Mittal 44 18 0 09 Jan 2024
Split-and-Denoise: Protect large language model inference with local differential privacy Peihua Mai Ran Yan Zhe Huang Youjia Yang Yan Pang 24 10 0 13 Oct 2023
Privacy-Preserving Prompt Tuning for Large Language Model Services Yansong Li Zhixing Tan Yang Liu SILM VLM 43 63 0 10 May 2023
The Role of Adaptive Optimizers for Honest Private Hyperparameter Selection Shubhankar Mohapatra Sajin Sasy Xi He Gautam Kamath Om Thakkar 109 32 0 09 Nov 2021
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 134 344 0 13 Oct 2021
Hyperparameter Tuning with Renyi Differential Privacy Nicolas Papernot Thomas Steinke 123 119 0 07 Oct 2021
Opacus: User-Friendly Differential Privacy Library in PyTorch Ashkan Yousefpour I. Shilov Alexandre Sablayrolles Davide Testuggine Karthik Prasad ... Sayan Gosh Akash Bharadwaj Jessica Zhao Graham Cormode Ilya Mironov VLM 144 348 0 25 Sep 2021
TEM: High Utility Metric Differential Privacy on Text Ricardo Silva Carvalho Theodore Vasiloudis Oluwaseyi Feyisetan 34 36 0 16 Jul 2021
Tempered Sigmoid Activations for Deep Learning with Differential Privacy Nicolas Papernot Abhradeep Thakurta Shuang Song Steve Chien Ulfar Erlingsson AAML 128 178 0 28 Jul 2020
Efficient Per-Example Gradient Computations Ian Goodfellow 169 73 0 07 Oct 2015