PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models

7 November 2023

Papers citing "PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models"

26 / 26 papers shown

Title
Toward a Human-Centered Evaluation Framework for Trustworthy LLM-Powered GUI Agents C. L. P. Chen Zhiping Zhang Ibrahim Khalilov Bingcan Guo Simret Araya Gebreegziabher Yanfang Ye Ziang Xiao Yaxing Yao Tianshi Li T. Li LLMAG ELM 87 0 0 24 Apr 2025
Safeguarding LLM Embeddings in End-Cloud Collaboration via Entropy-Driven Perturbation Shuaifan Jin Xiaoyi Pang Zhibo Wang He Wang Jiacheng Du Jiahui Hu Kui Ren SILM AAML 78 0 0 17 Mar 2025
RewardDS: Privacy-Preserving Fine-Tuning for Large Language Models via Reward Driven Data Synthesis Jianwei Wang Junyao Yang Haoran Li Huiping Zhuang Cen Chen Ziqian Zeng SyDa 38 0 0 23 Feb 2025
AIDBench: A benchmark for evaluating the authorship identification capability of large language models Zichen Wen Dadi Guo Huishuai Zhang 67 0 0 20 Nov 2024
LabSafety Bench: Benchmarking LLMs on Safety Issues in Scientific Labs Yujun Zhou Jingdong Yang Kehan Guo Pin-Yu Chen Tian Gao ... Tian Gao Werner Geyer Nuno Moniz Nitesh V Chawla Xiangliang Zhang 35 4 0 18 Oct 2024
Persona Knowledge-Aligned Prompt Tuning Method for Online Debate Chunkit Chan Cheng Jiayang Xin Liu Yauwai Yim Yuxin Jiang Zheye Deng Haoran Li Yangqiu Song Ginny Y. Wong Simon See 34 0 0 05 Oct 2024
ECon: On the Detection and Resolution of Evidence Conflicts Cheng Jiayang Chunkit Chan Qianqian Zhuang Lin Qiu Tianhang Zhang Tengxiao Liu Yangqiu Song Yue Zhang Pengfei Liu Zheng Zhang 36 1 0 05 Oct 2024
Constrained Reasoning Chains for Enhancing Theory-of-Mind in Large Language Models Zizheng Lin Chunkit Chan Yangqiu Song Xin Liu LRM 26 1 0 20 Sep 2024
Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Information Yauwai Yim Chunkit Chan Tianyu Shi Zheye Deng Wei Fan Tianshi Zheng Yangqiu Song LLMAG 23 9 0 05 Aug 2024
Is My Data in Your Retrieval Database? Membership Inference Attacks Against Retrieval Augmented Generation Maya Anderson Guy Amit Abigail Goldsteen AAML 37 13 0 30 May 2024
Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data Haoran Li Xinyuan Zhao Dadi Guo Hanlin Gu Ziqian Zeng Yuxing Han Yangqiu Song Lixin Fan Qiang Yang 21 1 0 23 May 2024
NegotiationToM: A Benchmark for Stress-testing Machine Theory of Mind on Negotiation Surrounding Chunkit Chan Cheng Jiayang Yauwai Yim Zheye Deng Wei Fan Haoran Li Xin Liu Hongming Zhang Weiqi Wang Yangqiu Song LLMAG 32 20 0 21 Apr 2024
EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphs Cheng Jiayang Lin Qiu Chunkit Chan Xin Liu Yangqiu Song Zheng-Wei Zhang 36 9 0 30 Mar 2024
SecFormer: Towards Fast and Accurate Privacy-Preserving Inference for Large Language Models Jinglong Luo Yehong Zhang Zhuo Zhang Jiaqi Zhang Xin Mu Hui Wang Yue Yu Zenglin Xu 18 9 0 01 Jan 2024
Privacy-Preserved Neural Graph Databases Qi Hu Haoran Li Jiaxin Bai Zihao W. Wang Yangqiu Song 11 2 0 25 Dec 2023
Privacy in Large Language Models: Attacks, Defenses and Future Directions Haoran Li Yulin Chen Jinglong Luo Yan Kang Xiaojin Zhang Qi Hu Chunkit Chan Yangqiu Song PILM 38 40 0 16 Oct 2023
Security and Privacy on Generative Data in AIGC: A Survey Tao Wang Yushu Zhang Shuren Qi Ruoyu Zhao Zhihua Xia Jian Weng 43 44 0 18 Sep 2023
Sentence Embedding Leaks More Information than You Expect: Generative Embedding Inversion Attack to Recover the Whole Sentence Haoran Li Mingshi Xu Yangqiu Song 77 43 0 04 May 2023
ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal, Causal, and Discourse Relations Chunkit Chan Cheng Jiayang Weiqi Wang Yuxin Jiang Tianqing Fang Xin Liu Yangqiu Song LRM 78 60 0 28 Apr 2023
Large Language Models are Zero-Shot Reasoners Takeshi Kojima S. Gu Machel Reid Yutaka Matsuo Yusuke Iwasawa ReLM LRM 291 4,048 0 24 May 2022
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 303 11,881 0 04 Mar 2022
Differentially Private Fine-tuning of Language Models Da Yu Saurabh Naik A. Backurs Sivakanth Gopi Huseyin A. Inan ... Y. Lee Andre Manoel Lukas Wutschitz Sergey Yekhanin Huishuai Zhang 134 344 0 13 Oct 2021
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,835 0 18 Apr 2021
Extracting Training Data from Large Language Models Nicholas Carlini Florian Tramèr Eric Wallace Matthew Jagielski Ariel Herbert-Voss ... Tom B. Brown D. Song Ulfar Erlingsson Alina Oprea Colin Raffel MLAU SILM 267 1,808 0 14 Dec 2020
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 404 2,576 0 03 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,943 0 20 Apr 2018