Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models

9 November 2022

Papers citing "Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models"

50 / 211 papers shown

Title
Style Vectors for Steering Generative Large Language Model Kai Konen Sophie Jentzsch Diaoulé Diallo Peer Schutt Oliver Bensch Roxanne El Baff Dominik Opitz Tobias Hecking LLMSV 8 14 0 02 Feb 2024
Harm Amplification in Text-to-Image Models Susan Hao Renee Shelby Yuchi Liu Hansa Srinivasan Mukul Bhutani Burcu Karagol Ayan Ryan Poplin Shivani Poddar Sarah Laszlo 34 7 0 01 Feb 2024
Beyond Numbers: Creating Analogies to Enhance Data Comprehension and Communication with Generative AI Qing Chen Wei Shuai Jiyao Zhang Zhida Sun Nana Cao 21 11 0 31 Jan 2024
Multilingual Text-to-Image Generation Magnifies Gender Stereotypes and Prompt Engineering May Not Help You Felix Friedrich Katharina Hämmerl P. Schramowski Manuel Brack Jindrich Libovický Kristian Kersting Alexander M. Fraser EGVM 22 10 0 29 Jan 2024
EraseDiff: Erasing Data Influence in Diffusion Models Jing Wu Trung Le Munawar Hayat Mehrtash Harandi DiffM 64 14 0 11 Jan 2024
Scissorhands: Scrub Data Influence via Connection Sensitivity in Networks Jing Wu Mehrtash Harandi 23 12 0 11 Jan 2024
One-Dimensional Adapter to Rule Them All: Concepts, Diffusion Models and Erasing Applications Mengyao Lyu Yuhong Yang Haiwen Hong Hui Chen Xuan Jin Yuan He Hui Xue Jungong Han Guiguang Ding DiffM 21 55 0 26 Dec 2023
RS-Corrector: Correcting the Racial Stereotypes in Latent Diffusion Models Yue Jiang Yueming Lyu Tianxiang Ma Bo Peng Jing Dong 43 3 0 08 Dec 2023
IMMA: Immunizing text-to-image Models against Malicious Adaptation Yijia Zheng Raymond A. Yeh 30 8 0 30 Nov 2023
Diffusion Models Without Attention Jing Nathan Yan Jiatao Gu Alexander M. Rush 22 60 0 30 Nov 2023
Receler: Reliable Concept Erasing of Text-to-Image Diffusion Models via Lightweight Erasers Chi-Pin Huang Kai-Po Chang Chung-Ting Tsai Yung-Hsuan Lai Fu-En Yang Yu-Chiang Frank Wang DiffM 11 46 0 29 Nov 2023
Fair Text-to-Image Diffusion via Fair Mapping Jia Li Lijie Hu Jingfeng Zhang Tianhang Zheng Hua Zhang Di Wang 36 13 0 29 Nov 2023
VA3: Virtually Assured Amplification Attack on Probabilistic Copyright Protection for Text-to-Image Generative Models Xiang Li Qianli Shen Kenji Kawaguchi 27 4 0 29 Nov 2023
MMA-Diffusion: MultiModal Attack on Diffusion Models Yijun Yang Ruiyuan Gao Xiaosen Wang Tsung-Yi Ho Nan Xu Qiang Xu 27 61 0 29 Nov 2023
Self-Discovering Interpretable Diffusion Latent Directions for Responsible Text-to-Image Generation Hang Li Chengzhi Shen Philip H. S. Torr Volker Tresp Jindong Gu 24 31 0 28 Nov 2023
LEDITS++: Limitless Image Editing using Text-to-Image Models Manuel Brack Felix Friedrich Katharina Kornmeier Linoy Tsaban P. Schramowski Kristian Kersting Apolinário Passos DiffM 27 69 0 28 Nov 2023
Safe-CLIP: Removing NSFW Concepts from Vision-and-Language Models Samuele Poppi Tobia Poppi Federico Cocchi Marcella Cornia Lorenzo Baraldi Rita Cucchiara VLM 19 8 0 27 Nov 2023
Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Models Rohit Gandikota Joanna Materzyñska Tingrui Zhou Antonio Torralba David Bau DiffM 35 61 0 20 Nov 2023
Trustworthy Large Models in Vision: A Survey Ziyan Guo Li Xu Jun Liu MU 56 0 0 16 Nov 2023
Finetuning Text-to-Image Diffusion Models for Fairness Xudong Shen Chao Du Tianyu Pang Min-Bin Lin Yongkang Wong Mohan S. Kankanhalli 13 49 0 11 Nov 2023
Holistic Evaluation of Text-To-Image Models Tony Lee Michihiro Yasunaga Chenlin Meng Yifan Mai Joon Sung Park ... Jun-Yan Zhu Fei-Fei Li Jiajun Wu Stefano Ermon Percy Liang 139 125 0 07 Nov 2023
On the Proactive Generation of Unsafe Images From Text-To-Image Models Using Benign Prompts Yixin Wu Ning Yu Michael Backes Yun Shen Yang Zhang DiffM 46 8 0 25 Oct 2023
SalUn: Empowering Machine Unlearning via Gradient-based Weight Saliency in Both Image Classification and Generation Chongyu Fan Jiancheng Liu Yihua Zhang Eric Wong Dennis Wei Sijia Liu MU 27 120 0 19 Oct 2023
To Generate or Not? Safety-Driven Unlearned Diffusion Models Are Still Easy To Generate Unsafe Images ... For Now Yimeng Zhang Jinghan Jia Xin Chen Aochuan Chen Yihua Zhang Jiancheng Liu Ke Ding Sijia Liu DiffM 17 80 0 18 Oct 2023
Ring-A-Bell! How Reliable are Concept Removal Methods for Diffusion Models? Yu-Lin Tsai Chia-Yi Hsu Chulin Xie Chih-Hsun Lin Jia-You Chen Bo-wen Li Pin-Yu Chen Chia-Mu Yu Chun-ying Huang DiffM 28 76 0 16 Oct 2023
Implicit Concept Removal of Diffusion Models Zhili Liu Kai Chen Yifan Zhang Jianhua Han Lanqing Hong Hang Xu Zhenguo Li Dit-Yan Yeung James T. Kwok 20 13 0 09 Oct 2023
SurrogatePrompt: Bypassing the Safety Filter of Text-To-Image Models via Substitution Zhongjie Ba Jieming Zhong Jiachen Lei Pengyu Cheng Qinglong Wang Zhan Qin Zhibo Wang Kui Ren 11 16 0 25 Sep 2023
NetDiffus: Network Traffic Generation by Diffusion Models through Time-Series Imaging Nirhoshan Sivaroopan Dumindu Bandara Chamara Madarasingha Guilluame Jourjon A. Jayasumana Kanchana Thilakarathna DiffM 18 17 0 23 Sep 2023
COCO-Counterfactuals: Automatically Constructed Counterfactual Examples for Image-Text Pairs Tiep Le Vasudev Lal Phillip Howard DiffM 26 21 0 23 Sep 2023
Distilling Adversarial Prompts from Safety Benchmarks: Report for the Adversarial Nibbler Challenge Manuel Brack P. Schramowski Kristian Kersting AAML EGVM 19 7 0 20 Sep 2023
DiffusionWorldViewer: Exposing and Broadening the Worldview Reflected by Generative Text-to-Image Models Zoe De Simone Angie Boggust Arvindmani Satyanarayan Ashia Wilson 26 1 0 18 Sep 2023
Security and Privacy on Generative Data in AIGC: A Survey Tao Wang Yushu Zhang Shuren Qi Ruoyu Zhao Zhihua Xia Jian Weng 43 44 0 18 Sep 2023
Prompting4Debugging: Red-Teaming Text-to-Image Diffusion Models by Finding Problematic Prompts Zhi-Yi Chin Chieh-Ming Jiang Ching-Chun Huang Pin-Yu Chen Wei-Chen Chiu DiffM 11 65 0 12 Sep 2023
Unified Concept Editing in Diffusion Models Rohit Gandikota Hadas Orgad Yonatan Belinkov Joanna Materzyñska David Bau DiffM 39 166 0 25 Aug 2023
Backdooring Textual Inversion for Concept Censorship Yutong Wu Jiehan Zhang Florian Kerschbaum Tianwei Zhang DiffM 32 7 0 21 Aug 2023
FLIRT: Feedback Loop In-context Red Teaming Ninareh Mehrabi Palash Goyal Christophe Dupuy Qian Hu Shalini Ghosh R. Zemel Kai-Wei Chang Aram Galstyan Rahul Gupta DiffM 16 55 0 08 Aug 2023
Circumventing Concept Erasure Methods For Text-to-Image Generative Models Minh Pham Kelly O. Marshall Niv Cohen Govind Mittal C. Hegde DiffM 14 37 0 03 Aug 2023
Degeneration-Tuning: Using Scrambled Grid shield Unwanted Concepts from Stable Diffusion Zixuan Ni Longhui Wei Jiacheng Li Siliang Tang Yueting Zhuang Qi Tian DiffM 23 21 0 02 Aug 2023
Don't be so negative! Score-based Generative Modeling with Oracle-assisted Guidance Saeid Naderiparizi Xiaoxuan Liang Berend Zwartsenberg Frank D. Wood DiffM 13 4 0 31 Jul 2023
Towards Safe Self-Distillation of Internet-Scale Text-to-Image Diffusion Models Sanghyun Kim Seohyeong Jung Balhae Kim Moonseok Choi Jinwoo Shin Juho Lee DiffM 26 29 0 12 Jul 2023
Towards Regulatable AI Systems: Technical Gaps and Policy Opportunities Xudong Shen H. Brown Jiashu Tao Martin Strobel Yao Tong Akshay Narayan Harold Soh Finale Doshi-Velez 16 3 0 22 Jun 2023
Extracting Reward Functions from Diffusion Models Felipe Nuti Tim Franzmeyer João F. Henriques 17 14 0 01 Jun 2023
T2IAT: Measuring Valence and Stereotypical Biases in Text-to-Image Generation Jialu Wang Xinyue Liu Zonglin Di Y. Liu Xin Eric Wang 14 32 0 01 Jun 2023
Understanding and Mitigating Copying in Diffusion Models Gowthami Somepalli Vasu Singla Micah Goldblum Jonas Geiping Tom Goldstein DiffM 16 125 0 31 May 2023
Mitigating Inappropriateness in Image Generation: Can there be Value in Reflecting the World's Ugliness? Manuel Brack Felix Friedrich P. Schramowski Kristian Kersting EGVM 18 13 0 28 May 2023
MultiFusion: Fusing Pre-Trained Models for Multi-Lingual, Multi-Modal Image Generation Marco Bellagente Manuel Brack H. Teufel Felix Friedrich Bjorn Deiseroth ... Koen Oostermeijer Andres Felipe Cruz Salinas P. Schramowski Kristian Kersting Samuel Weinbach 36 15 0 24 May 2023
Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Models Y. Qu Xinyue Shen Xinlei He Michael Backes Savvas Zannettou Yang Zhang 14 105 0 23 May 2023
Data Redaction from Conditional Generative Models Zhifeng Kong Kamalika Chaudhuri KELM 16 7 0 18 May 2023
Selective Amnesia: A Continual Learning Approach to Forgetting in Deep Generative Models Alvin Heng Harold Soh VLM KELM DiffM 29 105 0 17 May 2023
Let the Chart Spark: Embedding Semantic Context into Chart with Text-to-Image Generative Model Shishi Xiao Suizi Huang Yue Lin Yilin Ye Weizhen Zeng 36 30 0 28 Apr 2023