DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Models

21 March 2023

Weijia Wu

Chunhua Shen

Papers citing "DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Models"

50 / 111 papers shown

Title
FreeSeg-Diff: Training-Free Open-Vocabulary Segmentation with Diffusion Models Barbara Toniella Corradini Mustafa Shukor Paul Couairon Guillaume Couairon Franco Scarselli Matthieu Cord DiffM VLM 38 4 0 29 Mar 2024
SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation Aysim Toker Marvin Eisenberger Daniel Cremers Laura Leal-Taixé DiffM 27 19 0 25 Mar 2024
Open-Vocabulary Attention Maps with Token Optimization for Semantic Segmentation in Diffusion Models Pablo Marcos-Manchón Roberto Alcover-Couso Juan C. Sanmiguel Jose M. Martínez VLM 37 18 0 21 Mar 2024
DetDiffusion: Synergizing Generative and Perceptive Models for Enhanced Data Generation and Perception Yibo Wang Ruiyuan Gao Kai Chen Kaiqiang Zhou Yingjie Cai ... Zhenguo Li Lihui Jiang Dit-Yan Yeung Qiang Xu Kai Zhang DiffM 113 21 0 20 Mar 2024
Generative Enhancement for 3D Medical Images Lingting Zhu Noel Codella Dongdong Chen Zhenchao Jin Lu Yuan Lequan Yu DiffM MedIm 27 10 0 19 Mar 2024
DreamDA: Generative Data Augmentation with Diffusion Models Yunxiang Fu Chaoqi Chen Yu Qiao Yizhou Yu VLM DiffM 24 12 0 19 Mar 2024
Exploring Pre-trained Text-to-Video Diffusion Models for Referring Video Object Segmentation Zixin Zhu Xuelu Feng Dongdong Chen Junsong Yuan Chunming Qiao Gang Hua DiffM 26 7 0 18 Mar 2024
MaskDiffusion: Exploiting Pre-trained Diffusion Models for Semantic Segmentation Yasufumi Kawano Yoshimitsu Aoki DiffM 24 4 0 17 Mar 2024
Zippo: Zipping Color and Transparency Distributions into a Single Diffusion Model Kangyang Xie Binbin Yang Hao Chen Meng Wang Cheng Zou Hui Xue Ming Yang Chunhua Shen DiffM 22 1 0 17 Mar 2024
DragAnything: Motion Control for Anything using Entity Representation Wejia Wu Zhuang Li Yuchao Gu Rui Zhao Yefei He David Junhao Zhang Mike Zheng Shou Yan Li Tingting Gao Di Zhang VGen 71 51 0 12 Mar 2024
Distribution-Aware Data Expansion with Diffusion Models Haowei Zhu Ling Yang Jun-Hai Yong Hongzhi Yin Jiawei Jiang Meng Xiao Wentao Zhang Bin Wang 22 2 0 11 Mar 2024
DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotation Xiaobin Hu Xu Peng Donghao Luo Xiaozhong Ji Jinlong Peng Zhengkai Jiang Jiangning Zhang Taisong Jin Chengjie Wang Rongrong Ji DiffM 16 4 0 10 Mar 2024
RealCustom: Narrowing Real Text Word for Real-Time Open-Domain Text-to-Image Customization Mengqi Huang Zhendong Mao Mingcong Liu Qian He Yongdong Zhang DiffM 33 21 0 01 Mar 2024
Visual Concept-driven Image Generation with Text-to-Image Diffusion Model Tanzila Rahman Shweta Mahajan Hsin-Ying Lee Jian Ren Sergey Tulyakov Leonid Sigal 72 4 0 18 Feb 2024
MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesis Dewei Zhou You Li Fan Ma Zongxin Yang Yi Yang DiffM 18 57 0 08 Feb 2024
GEM: Boost Simple Network for Glass Surface Segmentation via Segment Anything Model and Data Synthesis Jing Hao Moyun Liu Kuo Feng Hung DiffM 19 2 0 27 Jan 2024
Exploring Simple Open-Vocabulary Semantic Segmentation Zihang Lai VLM 14 0 0 22 Jan 2024
EmerDiff: Emerging Pixel-level Semantic Knowledge in Diffusion Models Koichi Namekata Amirmojtaba Sabour Sanja Fidler Seung Wook Kim 42 17 0 22 Jan 2024
Prompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Models Shweta Mahajan Tanzila Rahman Kwang Moo Yi Leonid Sigal DiffM 15 17 0 19 Dec 2023
Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance P. Nguyen T.D. Ngo E. Kalogerakis Chuang Gan Anh Tran Cuong Pham Khoi Duc Minh Nguyen ISeg 16 51 0 17 Dec 2023
Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulation Qin Guo Tianwei Lin DiffM 13 28 0 15 Dec 2023
Reliability in Semantic Segmentation: Can We Use Synthetic Data? Thibaut Loiseau Tuan-Hung Vu Mickaël Chen Patrick Pérez Matthieu Cord UQCV 18 12 0 14 Dec 2023
DGInStyle: Domain-Generalizable Semantic Segmentation with Image Diffusion Models and Stylized Semantic Control Yuru Jia Lukas Hoyer Shengyu Huang Tianfu Wang Luc Van Gool Konrad Schindler Anton Obukhov DiffM 28 17 0 05 Dec 2023
Stable Diffusion Exposed: Gender Bias from Prompt to Image Yankun Wu Yuta Nakashima Noa Garcia 21 16 0 05 Dec 2023
UniGS: Unified Representation for Image Generation and Segmentation Lu Qi Lehan Yang Weidong Guo Yu-Syuan Xu Bo Du Varun Jampani Ming-Hsuan Yang 22 17 0 04 Dec 2023
ResEnsemble-DDPM: Residual Denoising Diffusion Probabilistic Models for Ensemble Learning Zhenning Shi Changsheng Dong Xueshuo Xie Bin Pan Along He Li Tao DiffM MedIm 26 0 0 04 Dec 2023
Unsupervised Keypoints from Pretrained Diffusion Models Eric Hedlin Gopal Sharma Shweta Mahajan Xingzhe He Hossam N. Isack Abhishek Kar Helge Rhodin Andrea Tagliasacchi Kwang Moo Yi 8 7 0 29 Nov 2023
DSText V2: A Comprehensive Video Text Spotting Dataset for Dense and Small Text Weijia Wu Yiming Zhang Yefei He Luoming Zhang Zhenyu Lou Hong Zhou Xiang Bai 27 5 0 29 Nov 2023
ScribbleGen: Generative Data Augmentation Improves Scribble-supervised Semantic Segmentation Jacob Schnell Jieke Wang Lu Qi Vincent Tao Hu Meng Tang DiffM 18 3 0 28 Nov 2023
Paragraph-to-Image Generation with Information-Enriched Diffusion Model Weijia Wu Zhuang Li Yefei He Mike Zheng Shou Chunhua Shen Lele Cheng Yan Li Tingting Gao Di Zhang VLM 123 24 0 24 Nov 2023
Enhancing Multimodal Compositional Reasoning of Visual Language Models with Generative Negative Mining U. Sahin Hang Li Qadeer Ahmad Khan Daniel Cremers Volker Tresp VLM CoGe 18 5 0 07 Nov 2023
SegGen: Supercharging Segmentation Models with Text2Mask and Mask2Img Synthesis Hanrong Ye Jason Kuen Qing Liu Zhe-nan Lin Brian L. Price Dan Xu VLM 18 10 0 06 Nov 2023
A General Protocol to Probe Large Vision Models for 3D Physical Understanding Guanqi Zhan Chuanxia Zheng Weidi Xie Andrew Zisserman DiffM 17 14 0 10 Oct 2023
AI-Generated Images as Data Source: The Dawn of Synthetic Era Zuhao Yang Fangneng Zhan Kunhao Liu Muyu Xu Shijian Lu EGVM 25 18 0 03 Oct 2023
Feedback-guided Data Synthesis for Imbalanced Classification Reyhane Askari Hemmat Mohammad Pezeshki Florian Bordes M. Drozdzal Adriana Romero Soriano SyDa 8 10 0 29 Sep 2023
Text-image Alignment for Diffusion-based Perception Neehar Kondapaneni Markus Marks Manuel Knott Rogério Guimarães Pietro Perona VLM DiffM 14 32 0 29 Sep 2023
Factorized Diffusion Architectures for Unsupervised Image Generation and Segmentation Xin Yuan Michael Maire DiffM 19 2 0 27 Sep 2023
Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentation Quang H. Nguyen T. Vu Anh Tran Kim Dan Nguyen DiffM 17 78 0 25 Sep 2023
Zero-Shot Object Counting with Language-Vision Models Jingyi Xu Hieu M. Le Dimitris Samaras VLM DiffM 16 4 0 22 Sep 2023
From Text to Mask: Localizing Entities Using the Attention of Text-to-Image Diffusion Models Changming Xiao Qi Yang Feng Zhou Changshui Zhang 17 17 0 08 Sep 2023
Diffusion Model is Secretly a Training-free Open Vocabulary Semantic Segmenter Jinglong Wang Xiawei Li Jing Zhang Qingyuan Xu Qin Zhou Qian Yu Lu Sheng Dong Xu VLM DiffM 19 45 0 06 Sep 2023
Exploring Limits of Diffusion-Synthetic Training with Weakly Supervised Semantic Segmentation Ryota Yoshihashi Yuya Otsuka Kenji Doi Tomohiro Tanaka Hirokatsu Kataoka 24 1 0 04 Sep 2023
DiffuGen: Adaptable Approach for Generating Labeled Image Datasets using Stable Diffusion Models Michael Shenoda Edward Kim 11 1 0 01 Sep 2023
Ref-Diff: Zero-shot Referring Image Segmentation with Generative Models Minheng Ni Yabo Zhang Kailai Feng Xiaoming Li Yiwen Guo W. Zuo DiffM 16 23 0 31 Aug 2023
Diffuse, Attend, and Segment: Unsupervised Zero-Shot Segmentation using Stable Diffusion Junjiao Tian Lavisha Aggarwal Andrea Colaco Z. Kira Mar González-Franco DiffM 22 71 0 23 Aug 2023
DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Models Wei Yu Wu Yuzhong Zhao Hao Chen Yuchao Gu Rui Zhao Yefei He Hong Zhou Mike Zheng Shou Chunhua Shen 28 96 0 11 Aug 2023
Leverage Weakly Annotation to Pixel-wise Annotation via Zero-shot Segment Anything Model for Molecular-empowered Learning Xueyuan Li Ruining Deng Yucheng Tang Shunxing Bao Haichun Yang Yuankai Huo 8 3 0 10 Aug 2023
DiffusePast: Diffusion-based Generative Replay for Class Incremental Semantic Segmentation Jingfan Chen Yuxi Wang P. Wang Xiao Chen Zhaoxiang Zhang Zhen Lei Qing Li DiffM 11 5 0 02 Aug 2023
Diffusion Model for Camouflaged Object Detection Zhe Chen Rongrong Gao Tian-Zhu Xiang Fanzhao Lin DiffM 19 19 0 01 Aug 2023
Generative Prompt Model for Weakly Supervised Object Localization Yuzhong Zhao QiXiang Ye Weijia Wu Chunhua Shen Fang Wan WSOL VLM DiffM 26 27 0 19 Jul 2023