CleanCLIP: Mitigating Data Poisoning Attacks in Multimodal Contrastive Learning

6 March 2023

Papers citing "CleanCLIP: Mitigating Data Poisoning Attacks in Multimodal Contrastive Learning"

35 / 35 papers shown

Title
OCRT: Boosting Foundation Models in the Open World with Object-Concept-Relation Triad Luyao Tang Yuxuan Yuan C. L. P. Chen Zeyu Zhang Yue Huang Kun Zhang 48 0 0 24 Mar 2025
Neural Antidote: Class-Wise Prompt Tuning for Purifying Backdoors in Pre-trained Vision-Language Models Jiawei Kong Hao Fang Sihang Guo Chenxi Qing Bin Chen Bin Wang Shu-Tao Xia AAML VLM 85 0 0 26 Feb 2025
MM-PoisonRAG: Disrupting Multimodal RAG with Local and Global Poisoning Attacks Hyeonjeong Ha Qiusi Zhan Jeonghwan Kim Dimitrios Bralios Saikrishna Sanniboina Nanyun Peng Kai-Wei Chang Daniel Kang Heng Ji KELM AAML 57 1 0 25 Feb 2025
Defending Multimodal Backdoored Models by Repulsive Visual Prompt Tuning Zhifang Zhang Shuo He Bingquan Shen Lei Feng Lei Feng AAML 34 0 0 29 Dec 2024
DeDe: Detecting Backdoor Samples for SSL Encoders via Decoders Sizai Hou Songze Li Duanyi Yao AAML 61 0 0 25 Nov 2024
Semantic Shield: Defending Vision-Language Models Against Backdooring and Poisoning via Fine-grained Knowledge Alignment Alvi Md Ishmam Christopher Thomas AAML 107 3 0 23 Nov 2024
New Emerged Security and Privacy of Pre-trained Model: a Survey and Outlook Meng Yang Tianqing Zhu Chi Liu Wanlei Zhou Shui Yu Philip S. Yu AAML ELM PILM 45 1 0 12 Nov 2024
Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threats Kuanrong Liu Siyuan Liang Jiawei Liang Pengwen Dai Xiaochun Cao MU AAML 19 1 0 29 Sep 2024
Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysis Xianda Zhang Siyuan Liang AAML 18 0 0 24 Sep 2024
Adversarial Backdoor Defense in CLIP Junhao Kuang Siyuan Liang Jiawei Liang Kuanrong Liu Xiaochun Cao AAML 25 1 0 24 Sep 2024
Sim-CLIP: Unsupervised Siamese Adversarial Fine-Tuning for Robust and Semantically-Rich Vision-Language Models Md Zarif Hossain Ahmed Imteaj VLM AAML 27 4 0 20 Jul 2024
A Survey of Attacks on Large Vision-Language Models: Resources, Advances, and Future Trends Daizong Liu Mingyu Yang Xiaoye Qu Pan Zhou Yu Cheng Wei Hu ELM AAML 27 24 0 10 Jul 2024
TrojFM: Resource-efficient Backdoor Attacks against Very Large Foundation Models Yuzhou Nie Yanting Wang Jinyuan Jia Michael J. De Lucia Nathaniel D. Bastian Wenbo Guo Dawn Song SILM AAML 24 5 0 27 May 2024
Breaking the False Sense of Security in Backdoor Defense through Re-Activation Attack Mingli Zhu Siyuan Liang Baoyuan Wu AAML 26 14 0 25 May 2024
BDetCLIP: Multimodal Prompting Contrastive Test-Time Backdoor Detection Yuwei Niu Shuo He Qi Wei Feng Liu Lei Feng AAML 33 1 0 24 May 2024
Unlearning Backdoor Threats: Enhancing Backdoor Defense in Multimodal Contrastive Learning via Local Token Unlearning Siyuan Liang Kuanrong Liu Jiajun Gong Jiawei Liang Yuan Xun Ee-Chien Chang Xiaochun Cao AAML MU 16 12 0 24 Mar 2024
Threats, Attacks, and Defenses in Machine Unlearning: A Survey Ziyao Liu Huanyi Ye Chen Chen Yongsen Zheng K. Lam AAML MU 29 28 0 20 Mar 2024
VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models Jiawei Liang Siyuan Liang Man Luo Aishan Liu Dongchen Han Ee-Chien Chang Xiaochun Cao 30 37 0 21 Feb 2024
Exploiting Alpha Transparency In Language And Vision-Based AI Systems David A. Noever Forrest McKee AAML 21 0 0 15 Feb 2024
Test-Time Backdoor Attacks on Multimodal Large Language Models Dong Lu Tianyu Pang Chao Du Qian Liu Xianjun Yang Min-Bin Lin AAML 41 21 0 13 Feb 2024
Transparency Attacks: How Imperceptible Image Layers Can Fool AI Perception Forrest McKee David A. Noever AAML 21 2 0 29 Jan 2024
Defenses in Adversarial Machine Learning: A Survey Baoyuan Wu Shaokui Wei Mingli Zhu Meixi Zheng Zihao Zhu Mingda Zhang Hongrui Chen Danni Yuan Li Liu Qingshan Liu AAML 17 14 0 13 Dec 2023
Erasing Self-Supervised Learning Backdoor by Cluster Activation Masking Shengsheng Qian Yifei Wang Dizhan Xue Shengjie Zhang Huaiwen Zhang Changsheng Xu AAML 23 1 0 13 Dec 2023
BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP Jiawang Bai Kuofeng Gao Shaobo Min Shu-Tao Xia Zhifeng Li Wei Liu VLM 13 12 0 26 Nov 2023
Effective Backdoor Mitigation in Vision-Language Models Depends on the Pre-training Objective Sahil Verma Gantavya Bhatt Avi Schwarzschild Soumye Singhal Arnav M. Das Chirag Shah John P Dickerson Jeff Bilmes J. Bilmes AAML 48 1 0 25 Nov 2023
BadCLIP: Dual-Embedding Guided Backdoor Attack on Multimodal Contrastive Learning Siyuan Liang Mingli Zhu Aishan Liu Baoyuan Wu Xiaochun Cao Ee-Chien Chang 16 48 0 20 Nov 2023
Trustworthy Large Models in Vision: A Survey Ziyan Guo Li Xu Jun Liu MU 56 0 0 16 Nov 2023
Better Safe than Sorry: Pre-training CLIP against Targeted Data Poisoning and Backdoor Attacks Wenhan Yang Jingdong Gao Baharan Mirzasoleiman VLM 19 6 0 05 Oct 2023
FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning T. Shaik Xiaohui Tao Lin Li Haoran Xie Taotao Cai Xiaofeng Zhu Qingyuan Li MU 11 12 0 19 Sep 2023
Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy T. Shaik Xiaohui Tao Haoran Xie Lin Li Xiaofeng Zhu Qingyuan Li MU 22 25 0 10 May 2023
Detecting Backdoors in Pre-trained Encoders Shiwei Feng Guanhong Tao Shuyang Cheng Guangyu Shen Xiangzhe Xu Yingqi Liu Kaiyuan Zhang Shiqing Ma Xiangyu Zhang 63 45 0 23 Mar 2023
Robust Contrastive Language-Image Pre-training against Data Poisoning and Backdoor Attacks Wenhan Yang Jingdong Gao Baharan Mirzasoleiman VLM 97 17 0 13 Mar 2023
CyCLIP: Cyclic Contrastive Language-Image Pretraining Shashank Goel Hritik Bansal S. Bhatia Ryan A. Rossi Vishwa Vinay Aditya Grover CLIP VLM 160 131 0 28 May 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong S. Hoi MLLM BDL VLM CLIP 380 4,010 0 28 Jan 2022
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Chao Jia Yinfei Yang Ye Xia Yi-Ting Chen Zarana Parekh Hieu H. Pham Quoc V. Le Yun-hsuan Sung Zhen Li Tom Duerig VLM CLIP 293 2,875 0 11 Feb 2021