DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models

28 November 2022

Zhengfu He

Tianxiang Sun

Kuan-Chieh Jackson Wang

Xuanjing Huang

Xipeng Qiu

DiffM

VLM

ArXiv PDF HTML

Papers citing "DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models"

50 / 72 papers shown

Title
Overcoming Dimensional Factorization Limits in Discrete Diffusion Models through Quantum Joint Distribution Learning Chuangtao Chen Qinglin Zhao Mengchu Zhou Zhimin He Haozhen Situ DiffM 44 0 0 08 May 2025
Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models Marianne Arriola Aaron Gokaslan Justin T Chiu Zhihan Yang Zhixuan Qi Jiaqi Han S. Sahoo Volodymyr Kuleshov DiffM 67 3 0 12 Mar 2025
Effective and Efficient Masked Image Generation Models Zebin You Jingyang Ou Xiaolu Zhang Jun Hu Jun Zhou Chongxuan Li DiffM VLM 54 1 0 10 Mar 2025
EdiText: Controllable Coarse-to-Fine Text Editing with Diffusion Language Models Che Hyun Lee Heeseung Kim Jiheum Yeom Sungroh Yoon DiffM 53 0 0 27 Feb 2025
GCDance: Genre-Controlled 3D Full Body Dance Generation Driven By Music Xinran Liu Xu Dong Diptesh Kanojia Wenwu Wang Zhenhua Feng DiffM 60 0 0 25 Feb 2025
Large Language Diffusion Models Shen Nie Fengqi Zhu Zebin You Xiaolu Zhang Jingyang Ou Jun Hu Jun Zhou Yankai Lin Ji-Rong Wen Chongxuan Li 100 12 0 14 Feb 2025
Theoretical Benefit and Limitation of Diffusion Language Model Guhao Feng Yihan Geng Jian-Yu Guan Wei Yu Wu Liwei Wang Di He DiffM 48 0 0 13 Feb 2025
JADE: Joint-aware Latent Diffusion for 3D Human Generative Modeling Haorui Ji Rong Wang Taojun Lin Hongdong Li 3DH 35 1 0 31 Dec 2024
DiffusionAttacker: Diffusion-Driven Prompt Manipulation for LLM Jailbreak Hao Wang Hao Li Junda Zhu Xinyuan Wang C. Pan Minlie Huang Lei Sha 71 0 0 23 Dec 2024
Discrete Modeling via Boundary Conditional Diffusion Processes Yuxuan Gu Xiaocheng Feng Lei Huang Yingsheng Wu Zekun Zhou Weihong Zhong Kun Zhu Bing Qin DiffM 28 0 0 29 Oct 2024
Scaling up Masked Diffusion Models on Text Shen Nie Fengqi Zhu Chao Du Tianyu Pang Qian Liu Guangtao Zeng Min-Bin Lin Chongxuan Li AI4CE 45 13 0 24 Oct 2024
Scaling Diffusion Language Models via Adaptation from Autoregressive Models Shansan Gong Shivam Agarwal Yizhe Zhang Jiacheng Ye Lin Zheng ... Peilin Zhao W. Bi Jiawei Han Hao Peng Lingpeng Kong AI4CE 70 14 0 23 Oct 2024
Text-Guided Multi-Property Molecular Optimization with a Diffusion Language Model Yida Xiong Kun Li Weiwei Liu Jia Wu Bo Du Shirui Pan Wenbin Hu 20 0 0 17 Oct 2024
Meta-DiffuB: A Contextualized Sequence-to-Sequence Text Diffusion Model with Meta-Exploration Yun-Yen Chuang Hung-Min Hsu Kevin Lin Chen-Sheng Gu Ling Zhen Li Ray-I Chang Hung-yi Lee DiffM VLM 21 0 0 17 Oct 2024
Latent Abstractions in Generative Diffusion Models Giulio Franzese Mattia Martini Giulio Corallo Paolo Papotti Pietro Michiardi DiffM 31 0 0 04 Oct 2024
How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Framework Yinuo Ren Haoxuan Chen Grant M. Rotskoff Lexing Ying 33 3 0 04 Oct 2024
Latent Diffusion Models for Controllable RNA Sequence Generation Kaixuan Huang Yukang Yang Kaidi Fu Yanyi Chu Le Cong Mengdi Wang 42 1 0 15 Sep 2024
An Effective Deployment of Diffusion LM for Data Augmentation in Low-Resource Sentiment Classification Zhuowei Chen Lianxi Wang Yuben Wu Xinfeng Liao Yujia Tian Junyang Zhong DiffM 17 0 0 05 Sep 2024
Instruction-Based Molecular Graph Generation with Unified Text-Graph Diffusion Model Yuran Xiang Haiteng Zhao Chang Ma Zhi-Hong Deng 26 0 0 19 Aug 2024
Unsupervised Composable Representations for Audio Giovanni Bindi P. Esling DiffM OCL CoGe 29 0 0 19 Aug 2024
Diffusion Models for Multi-Task Generative Modeling Changyou Chen Han Ding Bunyamin Sisman Yi Tian Xu Ouye Xie Benjamin Z. Yao Son Dinh Tran Belinda Zeng DiffM 35 4 0 24 Jul 2024
Discrete Flow Matching Itai Gat Tal Remez Neta Shaul Felix Kreuk Ricky T. Q. Chen Gabriel Synnaeve Yossi Adi Y. Lipman DiffM 34 56 0 22 Jul 2024
Simple and Effective Masked Diffusion Language Models S. Sahoo Marianne Arriola Yair Schiff Aaron Gokaslan Edgar Marroquin Justin T Chiu Alexander M. Rush Volodymyr Kuleshov DiffM 41 70 0 11 Jun 2024
Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data Jingyang Ou Shen Nie Kaiwen Xue Fengqi Zhu Jiacheng Sun Zhenguo Li Chongxuan Li DiffM 36 27 0 06 Jun 2024
Covariance-Adaptive Sequential Black-box Optimization for Diffusion Targeted Generation Yueming Lyu Kim yong Tan Yew-Soon Ong Ivor W. Tsang DiffM 28 1 0 02 Jun 2024
Glauber Generative Model: Discrete Diffusion Models via Binary Classification Harshit Varma Dheeraj M. Nagaraj Karthikeyan Shanmugam VLM 62 2 0 27 May 2024
LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-Text Generation? Yuchi Wang Shuhuai Ren Rundong Gao Linli Yao Qingyan Guo Kaikai An Jianhong Bai Xu Sun DiffM VLM 36 6 0 16 Apr 2024
3D Object Detection from Point Cloud via Voting Step Diffusion Haoran Hou Mingtao Feng Zijie Wu Weisheng Dong Qing Zhu Yaonan Wang Ajmal Saeed Mian DiffM 3DPC 30 4 0 21 Mar 2024
Unified Generation, Reconstruction, and Representation: Generalized Diffusion with Adaptive Latent Encoding-Decoding Guangyi Liu Yu Wang Zeyu Feng Qiyu Wu Liping Tang ... Shuguang Cui Julian McAuley Zichao Yang Eric P. Xing Zhiting Hu DiffM 62 3 0 29 Feb 2024
A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Data Antonio Sclocchi Alessandro Favero M. Wyart DiffM 36 25 0 26 Feb 2024
IPED: An Implicit Perspective for Relational Triple Extraction based on Diffusion Model Jianli Zhao Changhao Xu Bin Jiang 23 0 0 24 Feb 2024
Let's Rectify Step by Step: Improving Aspect-based Sentiment Analysis with Diffusion Models Shunyu Liu Jie Zhou Qunxi Zhu Qin Chen Qingchun Bai Junhua Xiao Liang He 24 2 0 23 Feb 2024
Text-Guided Molecule Generation with Diffusion Language Model Haisong Gong Qiang Liu Shu Wu Liang Wang 27 12 0 20 Feb 2024
Text Diffusion with Reinforced Conditioning Yuxuan Liu Tianchi Yang Shaohan Huang Zihan Zhang Haizhen Huang Furu Wei Weiwei Deng Feng Sun Qi Zhang 21 1 0 19 Feb 2024
Quantized Embedding Vectors for Controllable Diffusion Language Models Cheng Kang Xinye Chen Yong Hu Daniel Novak 15 0 0 15 Feb 2024
Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models Jiacheng Ye Shansan Gong Liheng Chen Lin Zheng Jiahui Gao ... Chuan Wu Xin Jiang Zhenguo Li Wei Bi Lingpeng Kong DiffM LRM AI4CE 38 12 0 12 Feb 2024
Diff-RNTraj: A Structure-aware Diffusion Model for Road Network-constrained Trajectory Generation Tonglong Wei Youfang Lin S. Guo Yan Lin Yiheng Huang Chenyang Xiang Yuqing Bai Menglu Ya Huaiyu Wan 25 10 0 12 Feb 2024
IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognition Xiaomeng Yang Zhi Qiao Yu Zhou DiffM 55 1 0 19 Dec 2023
Fast Sampling via Discrete Non-Markov Diffusion Models Zixiang Chen Huizhuo Yuan Yongqian Li Yiwen Kou Junkai Zhang Quanquan Gu DiffM 24 5 0 14 Dec 2023
DiffuVST: Narrating Fictional Scenes with Global-History-Guided Denoising Models Shengguang Wu Mei Yuan Qi Su DiffM 13 0 0 12 Dec 2023
DECap: Towards Generalized Explicit Caption Editing via Diffusion Mechanism Zhen Wang Xinyun Jiang Jun Xiao Tao Chen Long Chen DiffM 20 1 0 25 Nov 2023
Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution Aaron Lou Chenlin Meng Stefano Ermon DiffM 17 63 0 25 Oct 2023
InfoDiffusion: Information Entropy Aware Diffusion Process for Non-Autoregressive Text Generation Renzhi Wang Jing Li Piji Li DiffM 21 2 0 18 Oct 2023
DiffuSeq-v2: Bridging Discrete and Continuous Text Spaces for Accelerated Seq2Seq Diffusion Models Shansan Gong Mukai Li Jiangtao Feng Zhiyong Wu Lingpeng Kong 22 19 0 09 Oct 2023
Generative Design of inorganic compounds using deep diffusion language models Rongzhi Dong Nihang Fu dirisuriya M. D. Siriwardane Jianjun Hu DiffM 17 1 0 30 Sep 2023
Diffusion Augmentation for Sequential Recommendation Qidong Liu Fan Yan Xiangyu Zhao Zhaochen Du Huifeng Guo Ruiming Tang Feng Tian 17 36 0 22 Sep 2023
NADiffuSE: Noise-aware Diffusion-based Model for Speech Enhancement Wen Wang Dongchao Yang Qichen Ye Bowen Cao Yuexian Zou DiffM 24 3 0 03 Sep 2023
Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning Jiasheng Ye Zaixiang Zheng Yu Bao Lihua Qian Quanquan Gu DiffM 50 14 0 23 Aug 2023
How Does Diffusion Influence Pretrained Language Models on Out-of-Distribution Data? Huazheng Wang Daixuan Cheng Haifeng Sun Jingyu Wang Q. Qi Jianxin Liao Jing Wang Cong Liu 16 0 0 26 Jul 2023
DiffusEmp: A Diffusion Model-Based Framework with Multi-Grained Control for Empathetic Response Generation Guanqun Bi Lei Shen Yanan Cao Meng Chen Yuqiang Xie Zheng Lin Xiao-feng He DiffM 21 13 0 02 Jun 2023