Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe

25 October 2022

Girish Kumar

Huan Sun

Papers citing "Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe"

50 / 69 papers shown

Title
Improved Algorithms for Differentially Private Language Model Alignment Keyu Chen Hao Tang Qinglin Liu Yizhao Xu 9 0 0 13 May 2025
A False Sense of Privacy: Evaluating Textual Data Sanitization Beyond Surface-level Privacy Leakage Rui Xin Niloofar Mireshghallah Shuyue Stella Li Michael Duan Hyunwoo Kim Yejin Choi Yulia Tsvetkov Sewoong Oh Pang Wei Koh 69 1 0 28 Apr 2025
PatientDx: Merging Large Language Models for Protecting Data-Privacy in Healthcare José G. Moreno Jesus Lovon M'Rick Robin-Charlet Christine Damase-Michel L. Tamine MoMe LM&MA 48 0 0 24 Apr 2025
Private Federated Learning using Preference-Optimized Synthetic Data Charlie Hou Mei-Yu Wang Yige Zhu Daniel Lazar Giulia Fanti FedML Presented at ResearchTrend Connect \| FedML on 07 May 2025 57 0 0 23 Apr 2025
Cultural Learning-Based Culture Adaptation of Language Models Chen Cecilia Liu Anna Korhonen Iryna Gurevych 39 0 0 03 Apr 2025
From Easy to Hard: Building a Shortcut for Differentially Private Image Synthesis Kecen Li Chen Gong Xiaochen Li Yuzhong Zhao Xinwen Hou Tianhao Wang 31 1 0 02 Apr 2025
Generating Synthetic Data with Formal Privacy Guarantees: State of the Art and the Road Ahead Viktor Schlegel Anil A Bharath Zilong Zhao Kevin Yee 66 0 0 26 Mar 2025
DPImageBench: A Unified Benchmark for Differentially Private Image Synthesis Chen Gong Kecen Li Zinan Lin Tianhao Wang 47 3 0 18 Mar 2025
Synthesizing Privacy-Preserving Text Data via Finetuning without Finetuning Billion-Scale LLMs Bowen Tan Zheng Xu Eric P. Xing Zhiting Hu Shanshan Wu SyDa 85 0 0 16 Mar 2025
The Canary's Echo: Auditing Privacy Risks of LLM-Generated Synthetic Text Matthieu Meeus Lukas Wutschitz Santiago Zanella Béguelin Shruti Tople Reza Shokri 75 0 0 24 Feb 2025
RewardDS: Privacy-Preserving Fine-Tuning for Large Language Models via Reward Driven Data Synthesis Jianwei Wang Junyao Yang Haoran Li Huiping Zhuang Cen Chen Ziqian Zeng SyDa 38 0 0 23 Feb 2025
Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agents Ivoline Ngong Swanand Kadhe Hao Wang K. Murugesan Justin D. Weisz Amit Dhurandhar K. Ramamurthy 44 2 0 22 Feb 2025
PPC-GPT: Federated Task-Specific Compression of Large Language Models via Pruning and Chain-of-Thought Distillation Tao Fan Guoqiang Ma Yuanfeng Song Lixin Fan Kai Chen Qiang Yang 46 1 0 21 Feb 2025
Private Text Generation by Seeding Large Language Model Prompts Supriya Nagesh Justin Y. Chen Nina Mishra Tal Wagner SyDa SILM 62 1 0 20 Feb 2025
Differentially Private Synthetic Data via APIs 3: Using Simulators Instead of Foundation Model Zinan Lin Tadas Baltrusaitis Sergey Yekhanin SyDa 83 1 0 08 Feb 2025
Data-adaptive Differentially Private Prompt Synthesis for In-Context Learning Fengyu Gao Ruida Zhou T. Wang Cong Shen Jing Yang 29 2 0 15 Oct 2024
Evaluating Differentially Private Synthetic Data Generation in High-Stakes Domains Krithika Ramesh Nupoor Gandhi Pulkit Madaan Lisa Bauer Charith Peris Anjalie Field SyDa 20 1 0 10 Oct 2024
KnowledgeSG: Privacy-Preserving Synthetic Text Generation with Knowledge Distillation from Server Wenhao Wang Xiaoyu Liang Rui Ye Jingyi Chai Siheng Chen Yanfeng Wang SyDa 21 3 0 08 Oct 2024
NetDPSyn: Synthesizing Network Traces under Differential Privacy Danyu Sun Joann Qiongna Chen Chen Gong Tianhao Wang Zhou Li 34 1 0 08 Sep 2024
Differentially Private Kernel Density Estimation Erzhi Liu Jerry Yao-Chieh Hu Alex Reneau Zhao Song Han Liu 56 3 0 03 Sep 2024
Differentially Private Synthetic High-dimensional Tabular Stream Girish Kumar Thomas Strohmer Roman Vershynin 30 0 0 31 Aug 2024
LLM-PBE: Assessing Data Privacy in Large Language Models Qinbin Li Junyuan Hong Chulin Xie Jeffrey Tan Rachel Xin ... Dan Hendrycks Zhangyang Wang Bo Li Bingsheng He Dawn Song ELM PILM 36 12 0 23 Aug 2024
Private prediction for large-scale synthetic text generation Kareem Amin Alex Bie Weiwei Kong Alexey Kurakin Natalia Ponomareva Umar Syed Andreas Terzis Sergei Vassilvitskii SyDa SILM 36 3 0 16 Jul 2024
A Collocation-based Method for Addressing Challenges in Word-level Metric Differential Privacy Stephen Meisenbacher Maulik Chevli Florian Matthes 16 2 0 30 Jun 2024
Mind the Privacy Unit! User-Level Differential Privacy for Language Model Fine-Tuning Lynn Chua Badih Ghazi Yangsibo Huang Pritish Kamath Ravi Kumar Daogao Liu Pasin Manurangsi Amer Sinha Chiyuan Zhang 20 11 0 20 Jun 2024
The Fire Thief Is Also the Keeper: Balancing Usability and Privacy in Prompts Zhili Shen Zihang Xi Ying He Wei Tong Jingyu Hua Sheng Zhong SILM 40 7 0 20 Jun 2024
PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs Charlie Hou Akshat Shrivastava Hongyuan Zhan Rylan Conway Trang Le Adithya Sagar Giulia Fanti Daniel Lazar 24 8 0 05 Jun 2024
Differentially Private Tabular Data Synthesis using Large Language Models Toan V. Tran Li Xiong SyDa 38 6 0 03 Jun 2024
PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restoration Ziqian Zeng Jianwei Wang Zhengdong Lu Huiping Zhuang Cen Chen RALM KELM 30 7 0 03 Jun 2024
Text Generation: A Systematic Literature Review of Tasks, Evaluation, and Challenges Jonas Becker Jan Philip Wahle Bela Gipp Terry Ruas 23 9 0 24 May 2024
Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data Haoran Li Xinyuan Zhao Dadi Guo Hanlin Gu Ziqian Zeng Yuxing Han Yangqiu Song Lixin Fan Qiang Yang 21 1 0 23 May 2024
$1-Diffractor: Efficient and Utility-Preserving Text Obfuscation Leveraging Word-Level Metric Differential Privacy$ 1-Diffractor: Efficient and Utility-Preserving Text Obfuscation Leveraging Word-Level Metric Differential Privacy Stephen Meisenbacher Maulik Chevli Florian Matthes 18 6 0 02 May 2024
Privacy Preserving Prompt Engineering: A Survey Kennedy Edemacu Xintao Wu 39 18 0 09 Apr 2024
Prompt Public Large Language Models to Synthesize Data for Private On-device Applications Shanshan Wu Zheng Xu Yanxiang Zhang Yuanbo Zhang Daniel Ramage SyDa 21 9 0 05 Apr 2024
Efficiently Computing Similarities to Private Datasets A. Backurs Zinan Lin S. Mahabadi Sandeep Silwal Jakub Tarnawski 60 4 0 13 Mar 2024
Differentially Private Synthetic Data via Foundation Model APIs 2: Text Chulin Xie Zinan Lin A. Backurs Sivakanth Gopi Da Yu ... Haotian Jiang Huishuai Zhang Yin Tat Lee Bo-wen Li Sergey Yekhanin SyDa 57 33 0 04 Mar 2024
Differentially Private Knowledge Distillation via Synthetic Text Generation James Flemings Murali Annavaram SyDa 25 11 0 01 Mar 2024
LLM-based Privacy Data Augmentation Guided by Knowledge Distillation with a Distribution Tutor for Medical Text Classification Yiping Song Juhua Zhang Zhiliang Tian Yuxin Yang Minlie Huang Dongsheng Li 25 10 0 26 Feb 2024
Machine Unlearning of Pre-trained Large Language Models Jin Yao Eli Chien Minxin Du Xinyao Niu Tianhao Wang Zezhou Cheng Xiang Yue MU 50 34 0 23 Feb 2024
Privacy-Preserving Instructions for Aligning Large Language Models Da Yu Peter Kairouz Sewoong Oh Zheng Xu 32 17 0 21 Feb 2024
An Algorithm for Streaming Differentially Private Data Girish Kumar Thomas Strohmer Roman Vershynin 30 2 0 26 Jan 2024
A Comprehensive Survey of Attack Techniques, Implementation, and Mitigation Strategies in Large Language Models Aysan Esmradi Daniel Wankit Yip C. Chan AAML 25 11 0 18 Dec 2023
Grounding Foundation Models through Federated Transfer Learning: A General Framework Yan Kang Tao Fan Hanlin Gu Xiaojin Zhang Lixin Fan Qiang Yang AI4CE 68 19 0 29 Nov 2023
How Trustworthy are Open-Source LLMs? An Assessment under Malicious Demonstrations Shows their Vulnerabilities Lingbo Mo Boshi Wang Muhao Chen Huan Sun 29 27 0 15 Nov 2023
PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models Haoran Li Dadi Guo Donghao Li Wei Fan Qi Hu Xin Liu Chunkit Chan Duanyi Yao Yuan Yao Yangqiu Song PILM 19 24 0 07 Nov 2023
Privately Aligning Language Models with Reinforcement Learning Fan Wu Huseyin A. Inan A. Backurs Varun Chandrasekaran Janardhan Kulkarni Robert Sim 15 6 0 25 Oct 2023
InferDPT: Privacy-Preserving Inference for Black-box Large Language Model Meng Tong Kejiang Chen Jie Zhang Yuang Qi Weiming Zhang Neng H. Yu Tianwei Zhang Zhikun Zhang SILM 19 2 0 18 Oct 2023
Privacy in Large Language Models: Attacks, Defenses and Future Directions Haoran Li Yulin Chen Jinglong Luo Yan Kang Xiaojin Zhang Qi Hu Chunkit Chan Yangqiu Song PILM 38 40 0 16 Oct 2023
LatticeGen: A Cooperative Framework which Hides Generated Text in a Lattice for Privacy-Aware Generation on Cloud Mengke Zhang Tianxing He Tianle Wang Lu Mi Fatemehsadat Mireshghallah Binyi Chen Hao Wang Yulia Tsvetkov 22 0 0 29 Sep 2023
Recent Advances of Differential Privacy in Centralized Deep Learning: A Systematic Survey Lea Demelius Roman Kern Andreas Trügler SyDa FedML 30 6 0 28 Sep 2023