v1v2 (latest)

Preference-Based Alignment of Discrete Diffusion Models

11 March 2025

Papers citing "Preference-Based Alignment of Discrete Diffusion Models"

27 / 27 papers shown

Title
PC-Diffusion: Aligning Diffusion Models with Human Preferences via Preference Classifier S. Wang He Wang X. Wei Longquan Dai Jinhui Tang 128 0 0 11 Nov 2025
Discrete Diffusion Trajectory Alignment via Stepwise Decomposition Jiaqi Han Austin Wang Minkai Xu Wenda Chu Meihua Dang Yisong Yue Stefano Ermon 115 4 0 07 Jul 2025
Inference-Time Scaling of Discrete Diffusion Models via Importance Weighting and Optimal Proposal Design Chinmay Pani Chinmay Pani Yingzhen Li DiffM 261 2 0 28 May 2025
LLaDA 1.5: Variance-Reduced Preference Optimization for Large Language Diffusion Models Fengqi Zhu Rongzhen Wang Shen Nie Xiaolu Zhang Chunwei Wu ... Jun Zhou Jianfei Chen Yankai Lin Ji-Rong Wen Chongxuan Li 377 85 0 25 May 2025
Steering Generative Models with Experimental Data for Protein Fitness Optimization Jason Yang Wenda Chu Daniel Khalil Raul Astudillo Bruce J. Wittmann Frances H. Arnold Yisong Yue 309 5 0 21 May 2025
Guide your favorite protein sequence generative model Junhao Xiong Hunter Nisonoff Maria Lukarska Ishan Gaur Luke M. Oltrogge David F. Savage Jennifer Listgarten DiffM 553 5 0 07 May 2025
Simplified and Generalized Masked Diffusion for Discrete DataNeural Information Processing Systems (NeurIPS), 2024 Jiaxin Shi Kehang Han Zehao Wang Arnaud Doucet Michalis K. Titsias DiffM 527 271 0 17 Jan 2025
Fine-Tuning Discrete Diffusion Models via Reward Optimization with Applications to DNA and Protein DesignInternational Conference on Learning Representations (ICLR), 2024 Chenyu Wang Masatoshi Uehara Yichun He Amy Wang Tommaso Biancalani Avantika Lal Tommi Jaakkola Sergey Levine Hanchen Wang Aviv Regev 233 39 0 17 Oct 2024
Simple and Effective Masked Diffusion Language Models Subham Sekhar Sahoo Marianne Arriola Yair Schiff Aaron Gokaslan Edgar Marroquin Justin T Chiu Alexander M. Rush Volodymyr Kuleshov DiffM 180 316 0 11 Jun 2024
Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data Jingyang Ou Shen Nie Kaiwen Xue Fengqi Zhu Jiacheng Sun Zhenguo Li Chongxuan Li DiffM 315 162 0 06 Jun 2024
Unlocking Guidance for Discrete State-Space Diffusion and Flow Models Hunter Nisonoff Junhao Xiong Stephan Allenspach Jennifer Listgarten 383 78 0 03 Jun 2024
Aligning Diffusion Models by Optimizing Human Utility Shufan Li Konstantinos Kallidromitis Akash Gokul Yusuke Kato Kazuki Kozuka 253 64 0 06 Apr 2024
Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design Andrew Campbell Jason Yim Regina Barzilay Tom Rainforth Tommi Jaakkola AI4CE 268 208 0 07 Feb 2024
KTO: Model Alignment as Prospect Theoretic Optimization Kawin Ethayarajh Winnie Xu Niklas Muennighoff Dan Jurafsky Douwe Kiela 682 790 0 02 Feb 2024
Using Human Feedback to Fine-tune Diffusion Models without Any Reward ModelComputer Vision and Pattern Recognition (CVPR), 2023 Kai Yang Jian Tao Jiafei Lyu Chunjiang Ge Jiaxin Chen Qimai Li Weihan Shen Xiaolong Zhu Xiu Li EGVM 394 169 0 22 Nov 2023
Diffusion Model Alignment Using Direct Preference OptimizationComputer Vision and Pattern Recognition (CVPR), 2023 Bram Wallace Meihua Dang Rafael Rafailov Linqi Zhou Aaron Lou Senthil Purushwalkam Stefano Ermon Caiming Xiong Shafiq Joty Nikhil Naik EGVM 397 474 0 21 Nov 2023
A General Theoretical Paradigm to Understand Learning from Human PreferencesInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2023 M. G. Azar Mark Rowland Bilal Piot Daniel Guo Daniele Calandriello Michal Valko Rémi Munos 485 813 0 18 Oct 2023
Direct Preference Optimization: Your Language Model is Secretly a Reward ModelNeural Information Processing Systems (NeurIPS), 2023 Rafael Rafailov Archit Sharma E. Mitchell Stefano Ermon Christopher D. Manning Chelsea Finn ALM 727 6,327 0 29 May 2023
Training Diffusion Models with Reinforcement LearningInternational Conference on Learning Representations (ICLR), 2023 Kevin Black Michael Janner Yilun Du Ilya Kostrikov Sergey Levine EGVM 426 591 0 22 May 2023
Adding Conditional Control to Text-to-Image Diffusion ModelsIEEE International Conference on Computer Vision (ICCV), 2023 Lvmin Zhang Anyi Rao Maneesh Agrawala AI4CE 820 5,549 1 10 Feb 2023
Classifier-Free Diffusion Guidance Jonathan Ho Tim Salimans FaML 410 5,117 0 26 Jul 2022
A Continuous Time Framework for Discrete Denoising ModelsNeural Information Processing Systems (NeurIPS), 2022 Andrew Campbell Joe Benton Valentin De Bortoli Tom Rainforth George Deligiannidis Arnaud Doucet DiffM 430 270 0 30 May 2022
Structured Denoising Diffusion Models in Discrete State-Spaces Jacob Austin Daniel D. Johnson Jonathan Ho Daniel Tarlow Rianne van den Berg DiffM 573 1,299 0 07 Jul 2021
Diffusion Models Beat GANs on Image SynthesisNeural Information Processing Systems (NeurIPS), 2021 Prafulla Dhariwal Alex Nichol 1.3K 10,009 0 11 May 2021
Denoising Diffusion Implicit ModelsInternational Conference on Learning Representations (ICLR), 2020 Jiaming Song Chenlin Meng Stefano Ermon VLM DiffM 1.2K 9,859 0 06 Oct 2020
Denoising Diffusion Probabilistic Models Jonathan Ho Ajay Jain Pieter Abbeel DiffM 4.0K 24,746 0 19 Jun 2020
Fine-Tuning Language Models from Human Preferences Daniel M. Ziegler Nisan Stiennon Jeff Wu Tom B. Brown Alec Radford Dario Amodei Paul Christiano G. Irving ALM 1.4K 2,136 0 18 Sep 2019