v1v2 (latest)

Tree of Attacks: Jailbreaking Black-Box LLMs Automatically

Neural Information Processing Systems (NeurIPS), 2023

4 December 2023

Papers citing "Tree of Attacks: Jailbreaking Black-Box LLMs Automatically"

50 / 165 papers shown

Title
Where to Start Alignment? Diffusion Large Language Model May Demand a Distinct Position Zhixin Xie Xurui Song Jun Luo 144 5 0 17 Aug 2025
Layer-Wise Perturbations via Sparse Autoencoders for Adversarial Text Generation Huizhen Shu Xuying Li Qirui Wang Yuji Kosuga Mengqiu Tian Zhuo Li AAML SILM 141 0 0 14 Aug 2025
Towards Effective MLLM Jailbreaking Through Balanced On-Topicness and OOD-Intensity Zuoou Li Weitong Zhang Jingyuan Wang Shuyuan Zhang Wenjia Bai Bernhard Kainz Mengyun Qiao AAML 125 0 0 11 Aug 2025
A Real-Time, Self-Tuning Moderator Framework for Adversarial Prompt Detection Ivan Zhang AAML 82 0 0 10 Aug 2025
Guardians and Offenders: A Survey on Harmful Content Generation and Safety Mitigation of LLM Chi Zhang Changjia Zhu Junjie Xiong Xiaoran Xu Jinkui Chi Yao Liu Zhuo Lu ELM 191 3 0 07 Aug 2025
ASTRA: Autonomous Spatial-Temporal Red-teaming for AI Software Assistants Xiangzhe Xu Guangyu Shen Zian Su Siyuan Cheng Hanxi Guo ... Jiasheng Jiang Xiaolong Jin Chengpeng Wang Zhuo Zhang Xiangyu Zhang 145 3 0 05 Aug 2025
The SMeL Test: A simple benchmark for media literacy in language models Gustaf Ahdritz Anat Kleiman 209 0 0 04 Aug 2025
Counterfactual Evaluation for Blind Attack Detection in LLM-based Evaluation Systems Lijia Liu Takumi Kondo Kyohei Atarashi Koh Takeuchi Jiyi Li Shigeru Saito H. Kashima 128 0 0 31 Jul 2025
Exploiting Synergistic Cognitive Biases to Bypass Safety in LLMs Xikang Yang Biyu Zhou Xuehai Tang Jizhong Han Songlin Hu AAML 128 0 0 30 Jul 2025
TRIDENT: Benchmarking LLM Safety in Finance, Medicine, and Law Zheng Hui Yijiang River Dong Ehsan Shareghi Nigel Collier AILaw ELM 221 1 0 22 Jul 2025
PII Jailbreaking in LLMs via Activation Steering Reveals Personal Information Leakage Krishna Kanth Nakka Xue Jiang Dmitrii Usynin Xuebing Zhou LLMSV 240 0 0 03 Jul 2025
Meta SecAlign: A Secure Foundation LLM Against Prompt Injection Attacks Sizhe Chen Arman Zharmagambetov David Wagner Chuan Guo AAML 230 22 0 03 Jul 2025
Adversarial Manipulation of Reasoning Models using Internal Representations Kureha Yamaguchi Benjamin Etheridge Andy Arditi AAML LRM 118 3 0 03 Jul 2025
VERA: Variational Inference Framework for Jailbreaking Large Language Models Anamika Lochab Lu Yan Patrick Pynadath Xiangyu Zhang Ruqi Zhang AAML VLM 341 1 0 27 Jun 2025
MIST: Jailbreaking Black-box Large Language Models via Iterative Semantic Tuning Muyang Zheng Yuanzhi Yao C. D. Lin Rui Wang Meng Han Zhiquan Liu AAML VLM 190 0 0 20 Jun 2025
From LLMs to MLLMs to Agents: A Survey of Emerging Paradigms in Jailbreak Attacks and Defenses within LLM Ecosystem Yanxu Mao Tiehan Cui Peipei Liu Datao You Hongsong Zhu AAML 321 3 0 18 Jun 2025
FORTRESS: Frontier Risk Evaluation for National Security and Public Safety Christina Q. Knight Kaustubh Deshpande Ved Sirdeshmukh Meher Mankikar Scale Red Team SEAL Research Team Julian Michael AAML ELM 291 3 0 17 Jun 2025
Exploiting AI for Attacks: On the Interplay between Adversarial AI and Offensive AIIEEE Intelligent Systems (IEEE Intell. Syst.), 2025 Saskia Laura Schröer Luca Pajola Alberto Castagnaro Giovanni Apruzzese Mauro Conti AAML 135 0 0 14 Jun 2025
LLMs Cannot Reliably Judge (Yet?): A Comprehensive Assessment on the Robustness of LLM-as-a-Judge Songze Li Chuokun Xu Jiaying Wang Xueluan Gong Chen Chen J. Zhang Jun Wang K. Lam R. Beyah AAML ELM 341 6 0 11 Jun 2025
Step-by-step Instructions and a Simple Tabular Output Format Improve the Dependency Parsing Accuracy of LLMs Hiroshi Matsuda Chunpeng Ma Masayuki Asahara 296 0 0 11 Jun 2025
Chasing Moving Targets with Online Self-Play Reinforcement Learning for Safer Language Models Mickel Liu L. Jiang Yancheng Liang S. Du Yejin Choi Tim Althoff Natasha Jaques AAML LRM 275 13 0 09 Jun 2025
Beyond Jailbreaks: Revealing Stealthier and Broader LLM Security Risks Stemming from Alignment Failures Yukai Zhou Sibei Yang Wenjie Wang AAML 139 1 0 09 Jun 2025
AdvSumm: Adversarial Training for Bias Mitigation in Text Summarization Mukur Gupta Nikhil Reddy Varimalla Nicholas Deas Melanie Subbiah Kathleen McKeown 258 2 0 06 Jun 2025
LLM Agents Should Employ Security Principles Kaiyuan Zhang Zian Su Pin-Yu Chen E. Bertino Xiangyu Zhang Ninghui Li LLMAG 262 12 0 29 May 2025
OMNIGUARD: An Efficient Approach for AI Safety Moderation Across Languages and Modalities Sahil Verma Keegan E. Hines J. Bilmes Charlotte Siska Luke Zettlemoyer Hila Gonen Chandan Singh AAML 449 5 0 29 May 2025
Permissioned LLMs: Enforcing Access Control in Large Language Models Bargav Jayaraman Virendra J. Marathe Hamid Mozaffari William F. Shen Krishnaram Kenthapadi 298 3 0 28 May 2025
Jailbreak Distillation: Renewable Safety Benchmarking Jingyu Zhang Ahmed Elgohary Xiawei Wang A S M Iftekhar Ahmed Magooda Benjamin Van Durme Daniel Khashabi Kyle Jackson AAML ALM 223 0 0 28 May 2025
PoisonSwarm: Universal Harmful Information Synthesis via Model Crowdsourcing Yu Yan Sheng Sun Zhifei Zheng Ziji Hao Teli Liu Min Liu AAML 361 0 0 27 May 2025
Benign-to-Toxic Jailbreaking: Inducing Harmful Responses from Harmless Prompts H. Kim Minbeom Kim Wonjun Lee Kihyun Kim Changick Kim 161 0 0 26 May 2025
SGM: A Framework for Building Specification-Guided Moderation FiltersLinguistics Vanguard (LV), 2024 M. Fatehkia Enes Altinisik Mohamed Osman Husrev Taha Sencar 228 2 0 26 May 2025
Exploring the Vulnerability of the Content Moderation Guardrail in Large Language Models via Intent Manipulation Jun Zhuang Haibo Jin Ye Zhang Zhengjian Kang Wenbin Zhang Gaby G. Dagher Haohan Wang AAML 258 3 0 24 May 2025
Security Concerns for Large Language Models: A Survey Miles Q. Li Benjamin C. M. Fung PILM ELM 689 15 0 24 May 2025
Chain-of-Lure: A Universal Jailbreak Attack Framework using Unconstrained Synthetic Narratives Wenhan Chang Tianqing Zhu Yu Zhao Shuangyong Song Ping Xiong Wanlei Zhou 265 0 0 23 May 2025
An Example Safety Case for Safeguards Against Misuse Joshua Clymer Jonah Weinbaum Robert Kirk Kimberly Mai Selena Zhang Xander Davies 173 2 0 23 May 2025
One Model Transfer to All: On Robust Jailbreak Prompts Generation against LLMsInternational Conference on Learning Representations (ICLR), 2025 Linbao Li Y. Liu Daojing He Yu Li AAML 277 3 0 23 May 2025
Three Minds, One Legend: Jailbreak Large Reasoning Model with Adaptive Stacked Ciphers Viet-Anh Nguyen Shiqian Zhao Gia Dao Runyi Hu Yi Xie Luu Anh Tuan AAML LRM 360 7 0 22 May 2025
MixAT: Combining Continuous and Discrete Adversarial Training for LLMs Csaba Dékány Stefan Balauca Robin Staab Dimitar I. Dimitrov Martin Vechev AAML 279 1 0 22 May 2025
Checkpoint-GCG: Auditing and Attacking Fine-Tuning-Based Prompt Injection Defenses Xiaoxue Yang Bozhidar Stevanoski Matthieu Meeus Yves-Alexandre de Montjoye AAML 274 1 0 21 May 2025
AudioJailbreak: Jailbreak Attacks against End-to-End Large Audio-Language Models Guangke Chen Fu Song Zhe Zhao Xiaojun Jia Yang Liu Yanchen Qiao Weizhe Zhang AuLLM AAML 409 3 0 20 May 2025
SAFEPATH: Preventing Harmful Reasoning in Chain-of-Thought via Early Alignment Wonje Jeung Sangyeon Yoon Minsuk Kahng Albert No LRM LLMSV 643 6 0 20 May 2025
One Trigger Token Is Enough: A Defense Strategy for Balancing Safety and Usability in Large Language Models Haoran Gu Handing Wang Yi Mei Mengjie Zhang Yaochu Jin 270 0 0 12 May 2025
OET: Optimization-based prompt injection Evaluation Toolkit Jinsheng Pan Xiaogeng Liu Chaowei Xiao AAML 332 0 0 01 May 2025
Token-Efficient Prompt Injection Attack: Provoking Cessation in LLM Reasoning via Adaptive Token Compression Yu Cui Yujun Cai Yijiao Wang SILM AAML LRM 245 3 0 29 Apr 2025
JailbreaksOverTime: Detecting Jailbreak Attacks Under Distribution Shift Julien Piet Xiao Huang Dennis Jacob Annabella Chow Maha Alrashed Geng Zhao Zhanhao Hu Chawin Sitawarin Basel Alomair David Wagner AAML 304 3 0 28 Apr 2025
A Cryptographic Perspective on Mitigation vs. Detection in Machine Learning Greg Gluch Shafi Goldwasser AAML 439 0 0 28 Apr 2025
Prompt Injection Attack to Tool Selection in LLM Agents Jiawen Shi Zenghui Yuan Guiyao Tie Pan Zhou Neil Zhenqiang Gong Lichao Sun LLMAG 397 29 0 28 Apr 2025
Graph of Attacks: Improved Black-Box and Interpretable Jailbreaks for LLMs Mohammad Akbar-Tajari Mohammad Taher Pilehvar Mohammad Mahmoody AAML 187 1 0 26 Apr 2025
WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks Ivan Evtimov Arman Zharmagambetov Aaron Grattafiori Chuan Guo Kamalika Chaudhuri ELM 415 36 0 22 Apr 2025
RainbowPlus: Enhancing Adversarial Prompt Generation via Evolutionary Quality-Diversity Search Quy-Anh Dang Chris Ngo Truong-Son Hy AAML SyDa 229 3 0 21 Apr 2025
The Jailbreak Tax: How Useful are Your Jailbreak Outputs? Kristina Nikolić Luze Sun Jie Zhang F. Tramèr 214 12 0 14 Apr 2025

All Papers

Tree of Attacks: Jailbreaking Black-Box LLMs Automatically

Papers citing "Tree of Attacks: Jailbreaking Black-Box LLMs Automatically"