Analyzing and Improving the Training Dynamics of Diffusion Models

5 December 2023

Papers citing "Analyzing and Improving the Training Dynamics of Diffusion Models"

50 / 123 papers shown

Title
Understanding Galaxy Morphology Evolution Through Cosmic Time via Redshift Conditioned Diffusion Models Andrew Lizarraga Eric Hanchen Jiang Jacob Nowack Yun Qi Li Ying Nian Wu Bernie Boscoe Tuan Do DiffM 90 0 0 27 Nov 2024
Comparison of Generative Learning Methods for Turbulence Modeling Claudia Drygala Edmund Ross F. Mare Hanno Gottschalk AI4CE 66 0 0 25 Nov 2024
Geometry Distributions Biao Zhang Jing Ren Peter Wonka 3DH AI4CE 87 0 0 25 Nov 2024
The Unreasonable Effectiveness of Guidance for Diffusion Models Tim Kaiser Nikolas Adaloglou M. Kollmann DiffM 30 0 0 15 Nov 2024
AsCAN: Asymmetric Convolution-Attention Networks for Efficient Recognition and Generation Anil Kag Huseyin Coskun Jierun Chen Junli Cao Willi Menapace Aliaksandr Siarohin Sergey Tulyakov Jian Ren 51 3 0 07 Nov 2024
On Improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models Tariq Berrada Ifriqi Pietro Astolfi Melissa Hall Reyhane Askari Hemmat Yohann Benchetrit ... Matthew Muckley Karteek Alahari Adriana Romero Soriano Jakob Verbeek M. Drozdzal AI4CE VLM 57 2 0 05 Nov 2024
Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers Gavia Gray Aman Tiwari Shane Bergsma Joel Hestness 30 1 0 01 Nov 2024
Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training Atli Kosson Bettina Messmer Martin Jaggi AI4CE 20 2 0 31 Oct 2024
Disentangling Disentangled Representations: Towards Improved Latent Units via Diffusion Models Youngjun Jun Jiwoo Park Kyobin Choo Tae Eun Choi Seong Jae Hwang CoGe 41 0 0 31 Oct 2024
How Does Critical Batch Size Scale in Pre-training? Hanlin Zhang Depen Morwani Nikhil Vyas Jingfeng Wu Difan Zou Udaya Ghai Dean Phillips Foster Sham Kakade 77 8 0 29 Oct 2024
Simpler Diffusion (SiD2): 1.5 FID on ImageNet512 with pixel-space diffusion Emiel Hoogeboom Thomas Mensink Jonathan Heek Kay Lamerigts Ruiqi Gao Tim Salimans 125 6 0 25 Oct 2024
Rectified Diffusion Guidance for Conditional Generation Mengfei Xia Nan Xue Yujun Shen Ran Yi Tieliang Gong Yong-Jin Liu DiffM 33 3 0 24 Oct 2024
Non-intrusive Speech Quality Assessment with Diffusion Models Trained on Clean Speech Danilo de Oliveira Julius Richter Jean-Marie Lemercier Simon Welker Timo Gerkmann DiffM 18 2 0 23 Oct 2024
Adversarial Training: A Survey Mengnan Zhao Lihe Zhang Jingwen Ye Huchuan Lu Baocai Yin Xinchao Wang AAML 28 1 0 19 Oct 2024
Adversarial Score identity Distillation: Rapidly Surpassing the Teacher in One Step Mingyuan Zhou Huangjie Zheng Yi Gu Zhendong Wang Hai Huang DiffM 52 4 0 19 Oct 2024
Truncated Consistency Models Sangyun Lee Yilun Xu Tomas Geffner Giulia Fanti Karsten Kreis Arash Vahdat Weili Nie 57 3 0 18 Oct 2024
JAMUN: Transferable Molecular Conformational Ensemble Generation with Walk-Jump Sampling Ameya Daigavane Bodhi P. Vani Saeed Saremi J. Kleinhenz Joshua Rackers 47 1 0 18 Oct 2024
Simple ReFlow: Improved Techniques for Fast Flow Models Beomsu Kim Yu-Guan Hsieh Michal Klein Marco Cuturi Jong Chul Ye Bahjat Kawar James Thornton VLM 33 7 0 10 Oct 2024
F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching Yushen Chen Zhikang Niu Ziyang Ma Keqi Deng Chunhui Wang Jian Zhao Kai Yu Xie Chen 33 52 0 09 Oct 2024
Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think Sihyun Yu Sangkyung Kwak Huiwon Jang Jongheon Jeong Jonathan Huang Jinwoo Shin Saining Xie OCL 76 64 0 09 Oct 2024
Sparse Repellency for Shielded Generation in Text-to-image Diffusion Models Michael Kirchhof James Thornton Pierre Ablin Louis Béthune Eugène Ndiaye Marco Cuturi 51 2 0 08 Oct 2024
Zero-Shot Learning of Causal Models Divyat Mahajan Jannes Gladrow Agrin Hilmkil Cheng Zhang M. Scetbon 42 1 0 08 Oct 2024
Presto! Distilling Steps and Layers for Accelerating Music Generation Zachary Novack Ge Zhu Jonah Casebeer Julian McAuley Taylor Berg-Kirkpatrick Nicholas J. Bryan 45 5 0 07 Oct 2024
FINE: Factorizing Knowledge for Initialization of Variable-sized Diffusion Models Yucheng Xie Fu Feng Ruixiao Shi Jing Wang Xin Geng AI4CE 36 2 0 28 Sep 2024
DeBaRA: Denoising-Based 3D Room Arrangement Generation Léopold Maillard Nicolas Sereyjol-Garros Tom Durand Maks Ovsjanikov DiffM 3DV 37 2 0 26 Sep 2024
Improvements to SDXL in NovelAI Diffusion V3 Juan Ossa Eren Doğan Alex Birch F. Johnson 37 1 0 24 Sep 2024
Playground v3: Improving Text-to-Image Alignment with Deep-Fusion Large Language Models Bingchen Liu Ehsan Akhgari Alexander Visheratin Aleks Kamko Linmiao Xu Shivam Shrirao Joao Souza Suhail Doshi Daiqing Li Daiqing Li DiffM MLLM 31 47 0 16 Sep 2024
HJ-sampler: A Bayesian sampler for inverse problems of a stochastic process by leveraging Hamilton-Jacobi PDEs and score-based generative models Tingwei Meng Zongren Zou Jérome Darbon George Karniadakis DiffM 40 2 0 15 Sep 2024
E1 TTS: Simple and Fast Non-Autoregressive TTS Zhijun Liu Shuai Wang Pengcheng Zhu Mengxiao Bi Haizhou Li VLM DiffM 38 3 0 14 Sep 2024
FLUX that Plays Music Zhengcong Fei Mingyuan Fan Changqian Yu Junshi Huang 84 7 0 01 Sep 2024
Self-Improving Diffusion Models with Synthetic Data Sina Alemohammad Ahmed Imtiaz Humayun S. Agarwal John Collomosse Richard G. Baraniuk 30 11 0 29 Aug 2024
Approaching Deep Learning through the Spectral Dynamics of Weights David Yunis Kumar Kshitij Patel Samuel Wheeler Pedro H. P. Savarese Gal Vardi Karen Livescu Michael Maire Matthew R. Walter 52 3 0 21 Aug 2024
$u-$\mu$P: The Unit-Scaled Maximal Update Parametrization$ u- $\mu$ P: The Unit-Scaled Maximal Update Parametrization Charlie Blake C. Eichenberg Josef Dean Lukas Balles Luke Y. Prince Bjorn Deiseroth Andres Felipe Cruz Salinas Carlo Luschi Samuel Weinbach Douglas Orr 55 9 0 24 Jul 2024
Improved Noise Schedule for Diffusion Training Tiankai Hang Shuyang Gu DiffM 18 9 0 03 Jul 2024
No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Models Seyedmorteza Sadat Manuel Kansy Otmar Hilliges Romann M. Weber 36 10 0 02 Jul 2024
Improving Diffusion Inverse Problem Solving with Decoupled Noise Annealing Bingliang Zhang Wenda Chu Julius Berner Chenlin Meng Anima Anandkumar Yang Song DiffM 41 27 0 01 Jul 2024
Consistency Models Made Easy Zhengyang Geng Ashwini Pokle William Luo Justin Lin J. Zico Kolter 43 24 0 20 Jun 2024
Evaluating the design space of diffusion-based generative models Yuqing Wang Ye He Molei Tao DiffM 36 5 0 18 Jun 2024
Immiscible Diffusion: Accelerating Diffusion Training with Noise Assignment Yiheng Li Heyang Jiang Akio Kodaira M. Tomizuka Kurt Keutzer Chenfeng Xu DiffM 39 7 0 18 Jun 2024
Autoregressive Image Generation without Vector Quantization Tianhong Li Yonglong Tian He Li Mingyang Deng Kaiming He DiffM 53 178 0 17 Jun 2024
Lift Your Molecules: Molecular Graph Generation in Latent Euclidean Space Mohamed Amine Ketata Nicholas Gao Johanna Sommer Tom Wollschlager Stephan Günnemann DiffM 38 1 0 15 Jun 2024
Guiding a Diffusion Model with a Bad Version of Itself Tero Karras M. Aittala Tuomas Kynkaanniemi J. Lehtinen Timo Aila S. Laine 28 58 0 04 Jun 2024
LiteVAE: Lightweight and Efficient Variational Autoencoders for Latent Diffusion Models Seyedmorteza Sadat Jakob Buhmann Derek Bradley Otmar Hilliges Romann M. Weber 49 9 0 23 May 2024
Distilling Diffusion Models into Conditional GANs Minguk Kang Richard Zhang Connelly Barnes Sylvain Paris Suha Kwak Jaesik Park Eli Shechtman Jun-Yan Zhu Taesung Park 43 37 0 09 May 2024
Customizing Text-to-Image Diffusion with Camera Viewpoint Control Nupur Kumari Grace Su Richard Zhang Taesung Park Eli Shechtman Jun-Yan Zhu DiffM 44 3 0 18 Apr 2024
Neural Shrödinger Bridge Matching for Pansharpening Zihan Cao Xiao Wu Liang-Jian Deng DiffM 58 2 0 17 Apr 2024
Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Models Tuomas Kynkaanniemi M. Aittala Tero Karras S. Laine Timo Aila J. Lehtinen 19 58 0 11 Apr 2024
Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better En-hao Liu Junyi Zhu Zinan Lin Xuefei Ning Shuaiqi Wang ... Sergey Yekhanin Guohao Dai Huazhong Yang Yu-Xiang Wang Yu Wang MoMe 57 4 0 02 Apr 2024
Bidirectional Consistency Models Liangchen Li Jiajun He DiffM 67 11 0 26 Mar 2024
Denoising Task Difficulty-based Curriculum for Training Diffusion Models Jin-Young Kim Hyojun Go Soonwoo Kwon Hyun-Gyoon Kim DiffM 54 6 0 15 Mar 2024