DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models

28 November 2022

Zhengfu He

Tianxiang Sun

Kuan-Chieh Jackson Wang

Xuanjing Huang

Xipeng Qiu

DiffM

VLM

ArXiv PDF HTML

Papers citing "DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models"

22 / 72 papers shown

Title
David helps Goliath: Inference-Time Collaboration Between Small Specialized and Large General Diffusion LMs Xiaochuang Han Sachin Kumar Yulia Tsvetkov Marjan Ghazvininejad DiffM 25 3 0 24 May 2023
A Survey of Diffusion Models in Natural Language Processing Hao-Li Zou Zae Myung Kim Dongyeop Kang DiffM MedIm 16 12 0 24 May 2023
DiffusionNER: Boundary Diffusion for Named Entity Recognition Yongliang Shen Kaitao Song Xuejiao Tan Dongsheng Li Weiming Lu Y. Zhuang DiffM 45 33 0 22 May 2023
DiffuSIA: A Spiral Interaction Architecture for Encoder-Decoder Text Diffusion Chao-Hong Tan Jia-Chen Gu Zhen-Hua Ling DiffM 25 0 0 19 May 2023
Can Diffusion Model Achieve Better Performance in Text Generation? Bridging the Gap between Training and Inference! Zecheng Tang Pinzheng Wang Keyan Zhou Juntao Li Ziqiang Cao M. Zhang DiffM 6 11 0 08 May 2023
GlyphDiffusion: Text Generation as Image Generation Junyi Li Wayne Xin Zhao J. Nie Ji-Rong Wen DiffM 10 2 0 25 Apr 2023
BoDiffusion: Diffusing Sparse Observations for Full-Body Human Motion Synthesis Angela Castillo María Escobar Guillaume Jeanneret Albert Pumarola Pablo Arbelaez Ali K. Thabet A. Sanakoyeu DiffM VGen 24 30 0 21 Apr 2023
A Cheaper and Better Diffusion Language Model with Soft-Masked Noise Jiaao Chen Aston Zhang Mu Li Alexander J. Smola Diyi Yang DiffM 19 17 0 10 Apr 2023
Diffusion Models in NLP: A Survey Yuansong Zhu Yu Zhao DiffM VLM MedIm 22 23 0 14 Mar 2023
Diffusion Models for Non-autoregressive Text Generation: A Survey Yifan Li Kun Zhou Wayne Xin Zhao Ji-Rong Wen MedIm DiffM 37 31 0 12 Mar 2023
DINOISER: Diffused Conditional Sequence Learning by Manipulating Noises Jiasheng Ye Zaixiang Zheng Yu Bao Lihua Qian Mingxuan Wang DiffM 27 44 0 20 Feb 2023
DIFUSCO: Graph-based Diffusion Solvers for Combinatorial Optimization Zhiqing Sun Yiming Yang DiffM 22 116 0 16 Feb 2023
A Reparameterized Discrete Diffusion Model for Text Generation Lin Zheng Jianbo Yuan Lei Yu Lingpeng Kong DiffM 18 57 0 11 Feb 2023
SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers Hongyi Yuan Zheng Yuan Chuanqi Tan Fei Huang Songfang Huang DiffM 22 64 0 20 Dec 2022
Diffusion Glancing Transformer for Parallel Sequence to Sequence Learning Lihua Qian Mingxuan Wang Yang Liu Hao Zhou DiffM 22 0 0 20 Dec 2022
Latent Diffusion for Language Generation Justin Lovelace Varsha Kishore Chao-gang Wan Eliot Shekhtman Kilian Q. Weinberger DiffM 14 70 0 19 Dec 2022
A Survey on Generative Diffusion Model Hanqun Cao Cheng Tan Zhangyang Gao Yilun Xu Guangyong Chen Pheng-Ann Heng Stan Z. Li MedIm 37 195 0 06 Sep 2022
Diffusion-LM Improves Controllable Text Generation Xiang Lisa Li John Thickstun Ishaan Gulrajani Percy Liang Tatsunori B. Hashimoto AI4CE 171 768 0 27 May 2022
The Power of Scale for Parameter-Efficient Prompt Tuning Brian Lester Rami Al-Rfou Noah Constant VPVLM 280 3,835 0 18 Apr 2021
Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge Distillation Yunpeng Ren Ziao Wang Yiyuan Wang Xiaofeng Zhang 6 9 0 23 Oct 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 241 1,444 0 18 Mar 2020
Language GANs Falling Short Massimo Caccia Lucas Page-Caccia W. Fedus Hugo Larochelle Joelle Pineau Laurent Charlin 117 214 0 06 Nov 2018