Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models

9 November 2022

Papers citing "Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models"

50 / 211 papers shown

Title
Safeguarding Text-to-Image Generation via Inference-Time Prompt-Noise Optimization Jiangweizhi Peng Zhiwei Tang Gaowen Liu Charles Fleming Mingyi Hong 72 0 0 05 Dec 2024
LoyalDiffusion: A Diffusion Model Guarding Against Data Replication Chenghao Li Yuke Zhang Dake Chen Jingqi Xu P. Beerel 63 0 0 02 Dec 2024
Memories of Forgotten Concepts M. Rusanovsky Shimon Malnick Amir Jevnisek Ohad Fried S. Avidan DiffM 61 0 0 01 Dec 2024
Continuous Concepts Removal in Text-to-image Diffusion Models Tingxu Han Weisong Sun Yanrong Hu Chunrong Fang Yonglong Zhang Shiqing Ma Tao Zheng Zhenyu Chen Zhenting Wang DiffM 109 2 0 30 Nov 2024
Don't Let Your Robot be Harmful: Responsible Robotic Manipulation Minheng Ni Lei Zhang Z. Chen L. Zhang Wangmeng Zuo 67 1 0 27 Nov 2024
Contrastive CFG: Improving CFG in Diffusion Models by Contrasting Positive and Negative Concepts J. Chang Hyungjin Chung Jong Chul Ye FaML DiffM 92 0 0 26 Nov 2024
In-Context Experience Replay Facilitates Safety Red-Teaming of Text-to-Image Diffusion Models Zhi-Yi Chin Kuan-Chen Mu Mario Fritz Pin-Yu Chen DiffM 83 0 0 25 Nov 2024
MUNBa: Machine Unlearning via Nash Bargaining Jing Wu Mehrtash Harandi MU 71 3 0 23 Nov 2024
Safety Without Semantic Disruptions: Editing-free Safe Image Generation via Context-preserving Dual Latent Reconstruction J. Vice Naveed Akhtar Richard I. Hartley Ajmal Saeed Mian Ajmal Mian DiffM 82 0 0 21 Nov 2024
Jailbreak Attacks and Defenses against Multimodal Generative Models: A Survey Xuannan Liu Xing Cui Peipei Li Zekun Li Huaibo Huang Shuhan Xia Miaoxuan Zhang Yueying Zou Ran He AAML 60 6 0 14 Nov 2024
MegaPortrait: Revisiting Diffusion Control for High-fidelity Portrait Generation Han Yang Sotiris Anagnostidis Enis Simsar Thomas Hofmann DiffM 23 0 0 07 Nov 2024
From Fake Perfects to Conversational Imperfects: Exploring Image-Generative AI as a Boundary Object for Participatory Design of Public Spaces Jose A. Guridi Angel Hsing-Chi Hwang Duarte Santo Maria Goula Cristobal Cheyre Lee Humphreys Marco Rangel 33 0 0 01 Nov 2024
AdvI2I: Adversarial Image Attack on Image-to-Image Diffusion models Yaopei Zeng Yuanpu Cao Bochuan Cao Yurui Chang Jinghui Chen Lu Lin DiffM 29 3 0 28 Oct 2024
Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation Anh-Vu Bui L. Vuong Khanh Doan Trung Le Paul Montague Tamas Abraham Dinh Q. Phung KELM DiffM 26 8 0 21 Oct 2024
Text-to-Image Representativity Fairness Evaluation Framework Asma Z. Yamani Malak Baslyman 16 0 0 18 Oct 2024
Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts Hongcheng Gao Tianyu Pang Chao Du Taihang Hu Zhijie Deng Min-Bin Lin DiffM 40 8 0 16 Oct 2024
SAFREE: Training-Free and Adaptive Guard for Safe Text-to-Image And Video Generation Jaehong Yoon Shoubin Yu Vaidehi Patil Huaxiu Yao Mohit Bansal 64 14 0 16 Oct 2024
CtrlSynth: Controllable Image Text Synthesis for Data-Efficient Multimodal Learning Qingqing Cao Mahyar Najibi Sachin Mehta CLIP DiffM 25 1 0 15 Oct 2024
RealEra: Semantic-level Concept Erasure via Neighbor-Concept Mining Yufan Liu Jinyang An Wanqian Zhang Ming Li Dayan Wu Jingzi Gu Zheng-Shen Lin Weiping Wang 24 4 0 11 Oct 2024
Holistic Unlearning Benchmark: A Multi-Faceted Evaluation for Text-to-Image Diffusion Model Unlearning Saemi Moon M. Lee Sangdon Park Dongwoo Kim 37 1 0 08 Oct 2024
Attention Shift: Steering AI Away from Unsafe Content Shivank Garg Manyana Tiwari 21 0 0 06 Oct 2024
ShieldDiff: Suppressing Sexual Content Generation from Diffusion Models through Reinforcement Learning Dong Han Salaheldin Mohamed Yong Li 23 1 0 04 Oct 2024
SteerDiff: Steering towards Safe Text-to-Image Diffusion Models Hongxiang Zhang Yifeng He Hao Chen 23 2 0 03 Oct 2024
Textual Training for the Hassle-Free Removal of Unwanted Visual Data: Case Studies on OOD and Hateful Image Detection Saehyung Lee J. Mok Sangha Park Yongho Shin Dahuin Jung Sungroh Yoon 15 0 0 30 Sep 2024
T2Vs Meet VLMs: A Scalable Multimodal Dataset for Visual Harmfulness Recognition Chen Yeh You-Ming Chang Wei-Chen Chiu Ning Yu 35 1 0 29 Sep 2024
Unified Gradient-Based Machine Unlearning with Remain Geometry Enhancement Zhehao Huang Xinwen Cheng JingHao Zheng Haoran Wang Zhengbao He Tao Li X. Huang MU 40 4 0 29 Sep 2024
Conditional Image Synthesis with Diffusion Models: A Survey Zheyuan Zhan Defang Chen Jian-Ping Mei Zhenghe Zhao Jiawei Chen Chun Chen Siwei Lyu Can Wang VLM 38 5 0 28 Sep 2024
Multimodal Pragmatic Jailbreak on Text-to-image Models Tong Liu Zhixin Lai Gengyuan Zhang Philip H. S. Torr Vera Demberg Volker Tresp Jindong Gu 30 4 0 27 Sep 2024
Dark Miner: Defend against unsafe generation for text-to-image diffusion models Zheling Meng Bo Peng Xiaochuan Jin Yue Jiang Jing Dong Wei Wang Tieniu Tan DiffM 28 1 0 26 Sep 2024
Score Forgetting Distillation: A Swift, Data-Free Method for Machine Unlearning in Diffusion Models Tianqi Chen Shujian Zhang Mingyuan Zhou DiffM 69 3 0 17 Sep 2024
Image-Perfect Imperfections: Safety, Bias, and Authenticity in the Shadow of Text-To-Image Model Evolution Yixin Wu Yun Shen Michael Backes Yang Zhang 26 1 0 30 Aug 2024
MeshUp: Multi-Target Mesh Deformation via Blended Score Distillation Hyunwoo Kim Itai Lang Noam Aigerman Thibault Groueix Vladimir G. Kim Rana Hanocka AI4CE 43 3 0 27 Aug 2024
Perception-guided Jailbreak against Text-to-Image Models Yihao Huang Le Liang Tianlin Li Xiaojun Jia Run Wang Weikai Miao G. Pu Yang Liu 37 7 0 20 Aug 2024
DiffZOO: A Purely Query-Based Black-Box Attack for Red-teaming Text-to-Image Generative Model via Zeroth Order Optimization Pucheng Dang Xing Hu Dong Li Rui Zhang Qi Guo Kaidi Xu DiffM 31 5 0 18 Aug 2024
Attacks and Defenses for Generative Diffusion Models: A Comprehensive Survey V. T. Truong Luan Ba Dang Long Bao Le DiffM MedIm 38 16 0 06 Aug 2024
Machine Unlearning in Generative AI: A Survey Zheyuan Liu Guangyao Dou Zhaoxuan Tan Yijun Tian Meng-Long Jiang MU 31 13 0 30 Jul 2024
Towards Understanding Unsafe Video Generation Yan Pang Aiping Xiong Yang Zhang Tianhao Wang EGVM 27 2 0 17 Jul 2024
Reliable and Efficient Concept Erasure of Text-to-Image Diffusion Models Chao Gong Kai-xiang Chen Zhipeng Wei Jingjing Chen Yulong Jiang DiffM 42 23 0 17 Jul 2024
Generative Image as Action Models Mohit Shridhar Yat Long Lo Stephen James 38 9 0 10 Jul 2024
Adversarial Attacks and Defenses on Text-to-Image Diffusion Models: A Survey Chenyu Zhang Mingwang Hu Wenhui Li Lanjun Wang 37 15 0 10 Jul 2024
T2VSafetyBench: Evaluating the Safety of Text-to-Video Generative Models Yibo Miao Yifan Zhu Yinpeng Dong Lijia Yu Jun Zhu Xiao-Shan Gao EGVM 31 12 0 08 Jul 2024
Replication in Visual Diffusion Models: A Survey and Outlook Wenhao Wang Yifan Sun Zongxin Yang Zhengdong Hu Zhentao Tan Yi Yang 68 6 0 07 Jul 2024
MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation? Zhaorun Chen Yichao Du Zichen Wen Yiyang Zhou Chenhang Cui ... Jiawei Zhou Zhuokai Zhao Rafael Rafailov Chelsea Finn Huaxiu Yao EGVM MLLM 53 29 0 05 Jul 2024
"My Kind of Woman": Analysing Gender Stereotypes in AI through The Averageness Theory and EU Law Miriam Doh and Anastasia Karagianni 16 1 0 27 Jun 2024
EVALALIGN: Supervised Fine-Tuning Multimodal LLMs with Human-Aligned Data for Evaluating Text-to-Image Models Zhiyu Tan Xiaomeng Yang Luozheng Qin Mengping Yang Cheng Zhang Hao Li 42 7 0 24 Jun 2024
Six-CD: Benchmarking Concept Removals for Benign Text-to-image Diffusion Models Jie Ren Kangrui Chen Yingqian Cui Shenglai Zeng Hui Liu Yue Xing Jiliang Tang Lingjuan Lyu 40 1 0 21 Jun 2024
Stylebreeder: Exploring and Democratizing Artistic Styles through Text-to-Image Models Matthew Zheng Enis Simsar Hidir Yesiltepe Federico Tombari Joel Simon Pinar Yanardag 18 3 0 20 Jun 2024
PhyBench: A Physical Commonsense Benchmark for Evaluating Text-to-Image Models Fanqing Meng Wenqi Shao Lixin Luo Yahong Wang Yiran Chen ... Yue Yang Tianshuo Yang Kaipeng Zhang Yu Qiao Ping Luo EGVM 36 8 0 17 Jun 2024
Margin-aware Preference Optimization for Aligning Diffusion Models without Reference Jiwoo Hong Sayak Paul Noah Lee Kashif Rasul James Thorne Jongheon Jeong 31 13 0 10 Jun 2024
LlavaGuard: An Open VLM-based Framework for Safeguarding Vision Datasets and Models Lukas Helff Felix Friedrich Manuel Brack Kristian Kersting P. Schramowski VLM 43 1 0 07 Jun 2024