Red Teaming Visual Language Models

Annual Meeting of the Association for Computational Linguistics (ACL), 2024

23 January 2024

Mukai Li

Lei Li

Yuwei Yin

Masood Ahmed

Zhenguang Liu

Qi Liu

VLM

ArXiv (abs)PDF HTML HuggingFace (3 upvotes)

Papers citing "Red Teaming Visual Language Models"

36 / 36 papers shown

Title
SaFeR-VLM: Toward Safety-aware Fine-grained Reasoning in Multimodal Models Huahui Yi Kun Wang Qiankun Li Miao Yu Liang Lin Gongli Xi H. Wu Xuming Hu Kang Li Yang-Yang Liu OffRL LRM 59 1 0 08 Oct 2025
Unveiling Trust in Multimodal Large Language Models: Evaluation, Analysis, and Mitigation Yichi Zhang Yao Huang Yifan Wang Yitong Sun Chang-rui Liu ... Xiao Yang Xingxing Wei Hang Su Yinpeng Dong Jun Zhu 58 1 0 21 Aug 2025
Learning to Steer: Input-dependent Steering for Multimodal LLMs Jayneel Parekh Pegah Khayatan Mustafa Shukor Arnaud Dapogny A. Newson Matthieu Cord LLMSV 116 2 0 18 Aug 2025
Understanding and Benchmarking the Trustworthiness in Multimodal LLMs for Video Understanding Youze Wang Zijun Chen Ruoyu Chen Shishen Gu Yinpeng Dong ... Jun Zhu Meng Wang Richang Hong Wenbo Hu Richang Hong 157 0 0 14 Jun 2025
DAVSP: Safety Alignment for Large Vision-Language Models via Deep Aligned Visual Safety Prompt Yitong Zhang Jia Li L. Cai Ge Li VLM 136 3 0 11 Jun 2025
Bootstrapping LLM Robustness for VLM Safety via Reducing the Pretraining Modality Gap Wenhan Yang Spencer Stice Ali Payani Baharan Mirzasoleiman MLLM 95 0 0 30 May 2025
USB: A Comprehensive and Unified Safety Evaluation Benchmark for Multimodal Large Language Models Baolin Zheng Guanlin Chen Hongqiong Zhong Qingyang Teng Yingshui Tan ... Jincheng Wei Yuchi Xu Xiaoyong Zhu Bo Zheng Kaifu Zhang ELM 92 2 0 26 May 2025
RvLLM: LLM Runtime Verification with Domain Knowledge Yedi Zhang Sun Yi Emma Annabelle Lee Jia En Jin Song Dong 139 2 0 24 May 2025
VLMGuard-R1: Proactive Safety Alignment for VLMs via Reasoning-Driven Prompt Optimization Menglan Chen Xianghe Pang Jingjing Dong Wenhao Wang Yaxin Du Siheng Chen LRM 197 4 0 17 Apr 2025
PiCo: Jailbreaking Multimodal Large Language Models via Pictorial Code Contextualization Aofan Liu Lulu Tang Ting Pan Yuguo Yin Bin Wang Ao Yang MLLM AAML 308 4 0 02 Apr 2025
Misaligned Roles, Misplaced Images: Structural Input Perturbations Expose Multimodal Alignment Blind Spots Erfan Shayegani G M Shahariar Sara Abdali Lei Yu Nael B. Abu-Ghazaleh Yue Dong AAML 218 0 0 01 Apr 2025
Aligning Multimodal LLM with Human Preference: A Survey Tao Yu Yujiao Shi Chaoyou Fu Junkang Wu Jinda Lu ... Qingsong Wen Zheng Zhang Yan Huang Liang Wang Tieniu Tan 669 12 0 18 Mar 2025
Safety Mirage: How Spurious Correlations Undermine VLM Safety Fine-Tuning and Can Be Mitigated by Machine Unlearning Yiwei Chen Yuguang Yao Yihua Zhang Bingquan Shen Gaowen Liu Sijia Liu AAML MU 197 5 0 14 Mar 2025
Safe Vision-Language Models via Unsafe Weights Manipulation Moreno DÍncà E. Peruzzo Xingqian Xu Humphrey Shi Andrii Zadaianchuk Goran Frehse MU 200 0 0 14 Mar 2025
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs Abdelrahman Abouelenin Atabak Ashfaq Adam Atkinson Hany Awadalla Nguyen Bach ... Ishmam Zabir Yunan Zhang Li Zhang Yanzhe Zhang Xiren Zhou MoE SyDa 208 210 0 03 Mar 2025
Playing Devil's Advocate: Unmasking Toxicity and Vulnerabilities in Large Vision-Language Models Abdulkadir Erol Trilok Padhi Agnik Saha Ugur Kursuncu Mehmet Emin Aktas 175 2 0 17 Jan 2025
Revealing and Reducing Gender Biases in Vision and Language Assistants (VLAs)International Conference on Learning Representations (ICLR), 2024 Leander Girrbach Yiran Huang Stephan Alaniz Trevor Darrell Zeynep Akata VLM 259 6 0 25 Oct 2024
Unraveling and Mitigating Safety Alignment Degradation of Vision-Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024 Qin Liu Chao Shang Ling Liu Nikolaos Pappas Jie Ma Neha Anna John Srikanth Doss Kadarundalagi Raghuram Doss Lluís Marquez Miguel Ballesteros Yassine Benajiba 140 13 0 11 Oct 2024
ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference TimeInternational Conference on Learning Representations (ICLR), 2024 Yi Ding Bolian Li Ruqi Zhang MLLM 183 37 0 09 Oct 2024
VLMGuard: Defending VLMs against Malicious Prompts via Unlabeled Data Xuefeng Du Reshmi Ghosh Robert Sim Ahmed Salem Vitor Carvalho Emily Lawton Yixuan Li Jack W. Stokes VLM AAML 151 13 0 01 Oct 2024
A Survey on Multimodal Benchmarks: In the Era of Large AI Models Lin Li Guikun Chen Hanrong Shi Jun Xiao Long Chen 215 20 0 21 Sep 2024
A Survey on Evaluation of Multimodal Large Language Models Jiaxing Huang Jingyi Zhang LM&MA ELM LRM 182 38 0 28 Aug 2024
The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspective Zhen Qin Daoyuan Chen Wenhao Zhang Liuyi Yao Yilun Huang Bolin Ding Yaliang Li Shuiguang Deng 211 10 0 11 Jul 2024
A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends Daizong Liu Mingyu Yang Xiaoye Qu Pan Zhou Yu Cheng Wei Hu ELM AAML 188 56 0 10 Jul 2024
SPA-VL: A Comprehensive Safety Preference Alignment Dataset for Vision Language Model Yongting Zhang Lu Chen Guodong Zheng Yifeng Gao Rui Zheng ... Yu Qiao Xuanjing Huang Feng Zhao Tao Gui Jing Shao VLM 322 53 0 17 Jun 2024
Visual-RolePlay: Universal Jailbreak Attack on MultiModal Large Language Models via Role-playing Image Character Siyuan Ma Weidi Luo Yu Wang Xiaogeng Liu 213 45 0 25 May 2024
Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone Marah Abdin Sam Ade Jacobs A. A. Awan J. Aneja Ahmed Hassan Awadallah ... Li Zhang Yi Zhang Yue Zhang Yunan Zhang Xiren Zhou LRM ALM 389 1,713 0 22 Apr 2024
Unbridled Icarus: A Survey of the Potential Perils of Image Inputs in Multimodal Large Language Model Security Yihe Fan Yuxin Cao Ziyu Zhao Ziyao Liu Shaofeng Li 149 21 0 08 Apr 2024
Images are Achilles' Heel of Alignment: Exploiting Visual Vulnerabilities for Jailbreaking Multimodal Large Language ModelsEuropean Conference on Computer Vision (ECCV), 2024 Yifan Li Hangyu Guo Kun Zhou Wayne Xin Zhao Ji-Rong Wen 245 77 0 14 Mar 2024
Eyes Closed, Safety On: Protecting Multimodal LLMs via Image-to-Text TransformationEuropean Conference on Computer Vision (ECCV), 2024 Yunhao Gou Kai Chen Zhili Liu Lanqing Hong Hang Xu Zhenguo Li Dit-Yan Yeung James T. Kwok Yu Zhang MLLM 197 81 0 14 Mar 2024
ImgTrojan: Jailbreaking Vision-Language Models with ONE Image Xijia Tao Shuai Zhong Lei Li Qi Liu Lingpeng Kong 220 40 0 05 Mar 2024
A Survey on Safe Multi-Modal Learning System Tianyi Zhao Liangliang Zhang Yao Ma Lu Cheng 292 20 0 08 Feb 2024
Safety of Multimodal Large Language Models on Images and Texts Xin Liu Yichen Zhu Yunshi Lan Chao Yang Yu Qiao 236 53 0 01 Feb 2024
GOAT-Bench: Safety Insights to Large Multimodal Models through Meme-Based Social AbuseACM Transactions on Intelligent Systems and Technology (ACM TIST), 2024 Hongzhan Lin Ziyang Luo Bo Wang Ruichao Yang Jing Ma 331 41 0 03 Jan 2024
A Survey on Multimodal Large Language ModelsNational Science Review (NSR), 2023 Xinglong Mao Chaoyou Fu Zhengye Zhang Ke Li Xing Sun Tong Xu Enhong Chen MLLM LRM 282 856 0 23 Jun 2023
Censoring chemical data to mitigate dual use risk Quintina Campbell J. Herington Andrew D. White AAML 166 8 0 20 Apr 2023