Privacy Side Channels in Machine Learning Systems

11 September 2023

Edoardo Debenedetti

Giorgio Severi

Nicholas Carlini

Christopher A. Choquette-Choo

Papers citing "Privacy Side Channels in Machine Learning Systems"

34 / 34 papers shown

Title
I Know What You Said: Unveiling Hardware Cache Side-Channels in Local Large Language Model Inference Zibo Gao J. Hu Feng Guo Yixin Zhang Yinglong Han Siyuan Liu Haiyang Li Zhiqiang Lv 21 0 0 10 May 2025
A Taxonomy of Attacks and Defenses in Split Learning Aqsa Shabbir Halil Ibrahim Kanpak Alptekin Küpçü Sinem Sav 28 0 0 09 May 2025
Unlearning Sensitive Information in Multimodal LLMs: Benchmark and Attack-Defense Evaluation Vaidehi Patil Yi-Lin Sung Peter Hase Jie Peng Tianlong Chen Mohit Bansal AAML MU 79 3 0 01 May 2025
UPCORE: Utility-Preserving Coreset Selection for Balanced Unlearning Vaidehi Patil Elias Stengel-Eskin Mohit Bansal MU CLL 73 2 0 20 Feb 2025
Synthetic Data Privacy Metrics Amy Steier Lipika Ramaswamy Andre Manoel Alexa Haushalter 38 0 0 08 Jan 2025
SoK: A Systems Perspective on Compound AI Threats and Countermeasures Sarbartha Banerjee Prateek Sahu Mulong Luo Anjo Vahldiek-Oberwagner N. Yadwadkar Mohit Tiwari AAML 60 0 0 20 Nov 2024
Measuring Non-Adversarial Reproduction of Training Data in Large Language Models Michael Aerni Javier Rando Edoardo Debenedetti Nicholas Carlini Daphne Ippolito F. Tramèr 37 3 0 15 Nov 2024
Establishing and Evaluating Trustworthy AI: Overview and Research Challenges Dominik Kowald S. Scher Viktoria Pammer-Schindler Peter Müllner Kerstin Waxnegger ... Andreas Truegler Eduardo E. Veas Roman Kern Tomislav Nad Simone Kopeinik 32 3 0 15 Nov 2024
NeurIPS 2023 Competition: Privacy Preserving Federated Learning Document VQA Marlon Tobaben Mohamed Ali Souibgui Rubèn Pérez Tito Khanh Nguyen Raouf Kerkouche ... Josep Lladós Ernest Valveny Antti Honkela Mario Fritz Dimosthenis Karatzas FedML 28 0 0 06 Nov 2024
Privacy Risks of Speculative Decoding in Large Language Models Jiankun Wei Abdulrahman Abdulrazzag Tianchen Zhang Adel Muursepp Gururaj Saileshwar 33 2 0 01 Nov 2024
Fine-tuning can Help Detect Pretraining Data from Large Language Models H. Zhang Songxin Zhang Bingyi Jing Hongxin Wei 34 0 0 09 Oct 2024
The Early Bird Catches the Leak: Unveiling Timing Side Channels in LLM Serving Systems Linke Song Zixuan Pang Wenhao Wang Zihao Wang XiaoFeng Wang Hongbo Chen Wei Song Yier Jin Dan Meng Rui Hou 43 7 0 30 Sep 2024
REVS: Unlearning Sensitive Information in Language Models via Rank Editing in the Vocabulary Space Tomer Ashuach Martin Tutek Yonatan Belinkov KELM MU 58 4 0 13 Jun 2024
Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition Edoardo Debenedetti Javier Rando Daniel Paleka Silaghi Fineas Florin Dragos Albastroiu ... Stefan Kraft Mario Fritz Florian Tramèr Sahar Abdelnabi Lea Schonherr 46 9 0 12 Jun 2024
"What do you want from theory alone?" Experimenting with Tight Auditing of Differentially Private Synthetic Data Generation Meenatchi Sundaram Muthu Selva Annamalai Georgi Ganev Emiliano De Cristofaro 35 9 0 16 May 2024
Privacy Backdoors: Enhancing Membership Inference through Poisoning Pre-trained Models Yuxin Wen Leo Marchyok Sanghyun Hong Jonas Geiping Tom Goldstein Nicholas Carlini SILM AAML 18 9 0 01 Apr 2024
Provable Privacy with Non-Private Pre-Processing Yaxian Hu Amartya Sanyal Bernhard Schölkopf 19 2 0 19 Mar 2024
Large language models in 6G security: challenges and opportunities Tri Nguyen Huong Nguyen Ahmad Ijaz Saeid Sheikhi Athanasios V. Vasilakos Panos Kostakos ELM 22 7 0 18 Mar 2024
What Was Your Prompt? A Remote Keylogging Attack on AI Assistants Roy Weiss Daniel Ayzenshteyn Guy Amit Yisroel Mirsky 55 12 0 14 Mar 2024
Stealing Part of a Production Language Model Nicholas Carlini Daniel Paleka Krishnamurthy Dvijotham Thomas Steinke Jonathan Hayase ... Arthur Conmy Itay Yona Eric Wallace David Rolnick Florian Tramèr MLAU AAML 20 71 0 11 Mar 2024
You Still See Me: How Data Protection Supports the Architecture of ML Surveillance Rui-Jie Yew Lucy Qin Suresh Venkatasubramanian 25 3 0 09 Feb 2024
A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Ugly Yifan Yao Jinhao Duan Kaidi Xu Yuanfang Cai Eric Sun Yue Zhang PILM ELM 24 468 0 04 Dec 2023
Can LLMs Follow Simple Rules? Norman Mu Sarah Chen Zifan Wang Sizhe Chen David Karamardian Lulwa Aljeraisy Basel Alomair Dan Hendrycks David A. Wagner ALM 18 26 0 06 Nov 2023
SoK: Memorization in General-Purpose Large Language Models Valentin Hartmann Anshuman Suri Vincent Bindschaedler David E. Evans Shruti Tople Robert West KELM LLMAG 16 20 0 24 Oct 2023
Privacy in Large Language Models: Attacks, Defenses and Future Directions Haoran Li Yulin Chen Jinglong Luo Yan Kang Xiaojin Zhang Qi Hu Chunkit Chan Yangqiu Song PILM 38 40 0 16 Oct 2023
User Inference Attacks on Large Language Models Nikhil Kandpal Krishna Pillutla Alina Oprea Peter Kairouz Christopher A. Choquette-Choo Zheng Xu SILM AAML 22 15 0 13 Oct 2023
Can Sensitive Information Be Deleted From LLMs? Objectives for Defending Against Extraction Attacks Vaidehi Patil Peter Hase Mohit Bansal KELM AAML 18 94 0 29 Sep 2023
Identifying and Mitigating Privacy Risks Stemming from Language Models: A Survey Victoria Smith Ali Shahin Shamsabadi Carolyn Ashurst Adrian Weller PILM 27 24 0 27 Sep 2023
MalProtect: Stateful Defense Against Adversarial Query Attacks in ML-based Malware Detection Aqib Rashid Jose Such AAML 25 7 0 21 Feb 2023
Deduplicating Training Data Makes Language Models Better Katherine Lee Daphne Ippolito A. Nystrom Chiyuan Zhang Douglas Eck Chris Callison-Burch Nicholas Carlini SyDa 237 588 0 14 Jul 2021
Stateful Detection of Model Extraction Attacks Soham Pal Yash Gupta Aditya Kanade S. Shevade MLAU 52 24 0 12 Jul 2021
Poisoning the Unlabeled Dataset of Semi-Supervised Learning Nicholas Carlini AAML 139 68 0 04 May 2021
The Pile: An 800GB Dataset of Diverse Text for Language Modeling Leo Gao Stella Biderman Sid Black Laurence Golding Travis Hoppe ... Horace He Anish Thite Noa Nabeshima Shawn Presser Connor Leahy AIMat 245 1,986 0 31 Dec 2020
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 267 1,808 0 14 Dec 2020