Text-to-Image Diffusion Models can be Easily Backdoored through Multimodal Data Poisoning

7 May 2023

Yinpeng Dong

Hang Su

Papers citing "Text-to-Image Diffusion Models can be Easily Backdoored through Multimodal Data Poisoning"

45 / 45 papers shown

Title
Towards Dataset Copyright Evasion Attack against Personalized Text-to-Image Diffusion Models Kuofeng Gao Yufei Zhu Yiming Li Jiawang Bai Yong-Liang Yang Z. Li Shu-Tao Xia 34 0 0 05 May 2025
Erased but Not Forgotten: How Backdoors Compromise Concept Erasure Jonas Henry Grebe Tobias Braun Marcus Rohrbach Anna Rohrbach AAML 77 0 0 29 Apr 2025
BadVideo: Stealthy Backdoor Attack against Text-to-Video Generation Ruotong Wang Mingli Zhu Jiarong Ou R. J. Chen Xin Tao Pengfei Wan Baoyuan Wu DiffM AAML VGen 45 0 0 23 Apr 2025
What Lurks Within? Concept Auditing for Shared Diffusion Models at Scale Xiaoyong Yuan Xiaolong Ma Linke Guo Lan Zhang DiffM 37 0 0 21 Apr 2025
Backdoor Defense in Diffusion Models via Spatial Attention Unlearning Abha Jha Ashwath Vaithinathan Aravindan Matthew Salaway Atharva Sandeep Bhide Duygu Nur Yaldiz AAML 70 0 0 21 Apr 2025
Parasite: A Steganography-based Backdoor Attack Framework for Diffusion Models J. Chen Yu Pan Yi Du Chunkai Wu Lin Wang DiffM 35 0 0 08 Apr 2025
Silent Branding Attack: Trigger-free Data Poisoning Attack on Text-to-Image Diffusion Models Sangwon Jang June Suk Choi Jaehyeong Jo Kimin Lee Sung Ju Hwang DiffM WIGM 79 1 0 12 Mar 2025
NaviDet: Efficient Input-level Backdoor Detection on Text-to-Image Synthesis via Neuron Activation Variation Shengfang Zhai Jiajun Li Yue Liu Huanran Chen Zhihua Tian Wenjie Qu Qingni Shen Ruoxi Jia Yinpeng Dong Jiaheng Zhang AAML 44 0 0 09 Mar 2025
A Dual-Purpose Framework for Backdoor Defense and Backdoor Amplification in Diffusion Models Vu Tuan Truong Long Bao Le DiffM AAML 114 0 0 26 Feb 2025
PersGuard: Preventing Malicious Personalization via Backdoor Attacks on Pre-trained Text-to-Image Diffusion Models Xinwei Liu X. Jia Yuan Xun Hua Zhang Xiaochun Cao DiffM AAML 47 0 0 22 Feb 2025
BackdoorDM: A Comprehensive Benchmark for Backdoor Learning in Diffusion Model Weilin Lin Nanjun Zhou Y. Wang Jianze Li Hui Xiong Li Liu AAML DiffM 101 0 0 17 Feb 2025
UIBDiffusion: Universal Imperceptible Backdoor Attack for Diffusion Models Yuning Han Bingyin Zhao Rui Chu Feng Luo Biplab Sikdar Yingjie Lao DiffM AAML 67 1 0 16 Dec 2024
Buster: Implanting Semantic Backdoor into Text Encoder to Mitigate NSFW Content Generation Xin Zhao Xiaojun Chen Yuexin Xuan Zhendong Zhao Xiaojun Jia Xinfeng Li Xiaofeng Wang 72 0 0 10 Dec 2024
On the Fairness, Diversity and Reliability of Text-to-Image Generative Models J. Vice Naveed Akhtar Richard I. Hartley Ajmal Saeed Mian EGVM 63 0 0 21 Nov 2024
SoK: Unifying Cybersecurity and Cybersafety of Multimodal Foundation Models with an Information Theory Approach Ruoxi Sun Jiamin Chang Hammond Pearce Chaowei Xiao B. Li Qi Wu Surya Nepal Minhui Xue 30 0 0 17 Nov 2024
Trustworthy Text-to-Image Diffusion Models: A Timely and Focused Survey Yi Zhang Zhen Chen Chih-Hong Cheng Wenjie Ruan Xiaowei Huang Dezong Zhao David Flynn Siddartha Khastgir Xingyu Zhao MedIm 30 3 0 26 Sep 2024
Understanding Implosion in Text-to-Image Generative Models Wenxin Ding Cathy Y. Li Shawn Shan Ben Y. Zhao Haitao Zheng 31 0 0 18 Sep 2024
TERD: A Unified Framework for Safeguarding Diffusion Models Against Backdoors Yichuan Mo Hui Huang Mingjie Li Ang Li Yisen Wang AAML DiffM 32 15 0 09 Sep 2024
Attacks and Defenses for Generative Diffusion Models: A Comprehensive Survey V. T. Truong Luan Ba Dang Long Bao Le DiffM MedIm 38 14 0 06 Aug 2024
WOMD-Reasoning: A Large-Scale Language Dataset for Interaction and Driving Intentions Reasoning Yiheng Li Chongjian Ge Chenran Li Chenfeng Xu M. Tomizuka Chen Tang Mingyu Ding Wei Zhan VGen LRM 31 0 0 05 Jul 2024
Repairing Catastrophic-Neglect in Text-to-Image Diffusion Models via Attention-Guided Feature Enhancement Zhiyuan Chang Mingyang Li Junjie Wang Yi Liu Qing Wang Yang Liu DiffM 18 1 0 24 Jun 2024
EmoAttack: Emotion-to-Image Diffusion Models for Emotional Backdoor Generation Tianyu Wei Shanmin Pang Qi Guo Yizhuo Ma Qing Guo Ming-Ming Cheng Qing Guo 64 2 0 22 Jun 2024
EnTruth: Enhancing the Traceability of Unauthorized Dataset Usage in Text-to-image Diffusion Models with Minimal and Robust Alterations Jie Ren Yingqian Cui Chen Chen Vikash Sehwag Yue Xing Jiliang Tang Lingjuan Lyu WIGM 27 1 0 20 Jun 2024
Membership Inference on Text-to-Image Diffusion Models via Conditional Likelihood Discrepancy Shengfang Zhai Huanran Chen Yinpeng Dong Jiajun Li Qingni Shen Yansong Gao Hang Su Yang Liu EGVM 54 9 0 23 May 2024
SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models Raghuveer Peri Sai Muralidhar Jayanthi S. Ronanki Anshu Bhatia Karel Mundnich ... Srikanth Vishnubhotla Daniel Garcia-Romero S. Srinivasan Kyu J. Han Katrin Kirchhoff AAML 32 3 0 14 May 2024
Lazy Layers to Make Fine-Tuned Diffusion Models More Traceable Haozhe Liu Wentian Zhang Bing Li Bernard Ghanem Jürgen Schmidhuber DiffM WIGM AAML 26 1 0 01 May 2024
ProTIP: Probabilistic Robustness Verification on Text-to-Image Diffusion Models against Stochastic Perturbation Yi Zhang Yun Tang Wenjie Ruan Xiaowei Huang Siddartha Khastgir P. Jennings Xingyu Zhao AAML 21 4 0 23 Feb 2024
The last Dance : Robust backdoor attack via diffusion models and bayesian approach Orson Mengara DiffM 32 4 0 05 Feb 2024
The Stronger the Diffusion Model, the Easier the Backdoor: Data Poisoning to Induce Copyright Breaches Without Adjusting Finetuning Pipeline Haonan Wang Qianli Shen Yao Tong Yang Zhang Kenji Kawaguchi 37 22 0 07 Jan 2024
Quantifying Bias in Text-to-Image Generative Models J. Vice Naveed Akhtar Richard I. Hartley Ajmal Saeed Mian 25 2 0 20 Dec 2023
VA3: Virtually Assured Amplification Attack on Probabilistic Copyright Protection for Text-to-Image Generative Models Xiang Li Qianli Shen Kenji Kawaguchi 27 3 0 29 Nov 2023
Elijah: Eliminating Backdoors Injected in Diffusion Models via Distribution Shift Shengwei An Sheng-Yen Chou Kaiyuan Zhang Qiuling Xu Guanhong Tao ... Shuyang Cheng Shiqing Ma Pin-Yu Chen Tsung-Yi Ho Xiangyu Zhang DiffM AAML 12 27 0 27 Nov 2023
Trustworthy Large Models in Vision: A Survey Ziyan Guo Li Xu Jun Liu MU 56 0 0 16 Nov 2023
From Trojan Horses to Castle Walls: Unveiling Bilateral Data Poisoning Effects in Diffusion Models Zhuoshi Pan Yuguang Yao Gaowen Liu Bingquan Shen H. V. Zhao Ramana Rao Kompella Sijia Liu DiffM AAML 17 2 0 04 Nov 2023
Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models Shawn Shan Wenxin Ding Josephine Passananti Stanley Wu Haitao Zheng Ben Y. Zhao SILM DiffM 24 44 0 20 Oct 2023
Defending Our Privacy With Backdoors Dominik Hintersdorf Lukas Struppek Daniel Neider Kristian Kersting SILM AAML 13 2 0 12 Oct 2023
Backdooring Textual Inversion for Concept Censorship Yutong Wu Jiehan Zhang Florian Kerschbaum Tianwei Zhang DiffM 32 7 0 21 Aug 2023
On the Trustworthiness Landscape of State-of-the-art Generative Models: A Survey and Outlook Mingyuan Fan Chengyu Wang Cen Chen Yang Liu Jun Huang HILM 31 3 0 31 Jul 2023
BAGM: A Backdoor Attack for Manipulating Text-to-Image Generative Models J. Vice Naveed Akhtar Richard I. Hartley Ajmal Saeed Mian SILM DiffM 24 18 0 31 Jul 2023
On the Design Fundamentals of Diffusion Models: A Survey Ziyi Chang G. Koulieris Hubert P. H. Shum DiffM 27 50 0 07 Jun 2023
Personalization as a Shortcut for Few-Shot Backdoor Attack against Text-to-Image Diffusion Models Yihao Huang Felix Juefei Xu Qing-Wu Guo Jie M. Zhang Yutong Wu Ming Hu Tianlin Li Geguang Pu Yang Liu DiffM 11 32 0 18 May 2023
A Recipe for Watermarking Diffusion Models Yunqing Zhao Tianyu Pang Chao Du Xiao Yang Ngai-man Cheung Min-Bin Lin WIGM 13 112 0 17 Mar 2023
NCL: Textual Backdoor Defense Using Noise-augmented Contrastive Learning Shengfang Zhai Qingni Shen Xiaoyi Chen Weilong Wang Cong Li Yuejian Fang Zhonghai Wu AAML 37 8 0 03 Mar 2023
Re-Imagen: Retrieval-Augmented Text-to-Image Generator Wenhu Chen Hexiang Hu Chitwan Saharia William W. Cohen VLM 114 161 0 29 Sep 2022
Diffusion Models: A Comprehensive Survey of Methods and Applications Ling Yang Zhilong Zhang Yingxia Shao Shenda Hong Runsheng Xu Yue Zhao Wentao Zhang Bin Cui Ming-Hsuan Yang DiffM MedIm 224 1,277 0 02 Sep 2022