Faster Diffusion: Rethinking the Role of UNet Encoder in Diffusion Models

Neural Information Processing Systems (NeurIPS), 2023

15 December 2023

Ming-Ming Cheng

Jian Yang

DiffM

ArXiv (abs)PDF HTML HuggingFace (16 upvotes)Github (334★)

Papers citing "Faster Diffusion: Rethinking the Role of UNet Encoder in Diffusion Models"

26 / 26 papers shown

Title
LeMiCa: Lexicographic Minimax Path Caching for Efficient Diffusion-Based Video Generation Huanlin Gao Ping Chen Fuyuan Shi C. Tan Zhaoxiang Liu Fang Zhao Kai Wang Shiguo Lian DiffM VGen 321 0 0 30 Oct 2025
FreqCa: Accelerating Diffusion Models via Frequency-Aware Caching Jiacheng Liu Peiliang Cai Qinming Zhou Yuqi Lin Deyang Kong ... Haowen Xu Chang Zou J. Tang S. Zheng Linfeng Zhang 102 1 0 09 Oct 2025
Let Features Decide Their Own Solvers: Hybrid Feature Caching for Diffusion Transformers Shikang Zheng Guantao Chen Qinming Zhou Yuqi Lin Lixuan He Chang Zou Peiliang Cai Jiacheng Liu Linfeng Zhang 124 2 0 05 Oct 2025
FlashOmni: A Unified Sparse Attention Engine for Diffusion Transformers Liang Qiao Yue Dai Y. Huang Hongyu Kan Jun Shi Hong An 124 0 0 29 Sep 2025
SpeCa: Accelerating Diffusion Transformers with Speculative Feature Caching Jiacheng Liu Chang Zou Yuanhuiyi Lyu Fei Ren Shaobo Wang Kaixin Li Linfeng Zhang DiffM 166 5 0 15 Sep 2025
DiCache: Let Diffusion Model Determine Its Own Cache Jiazi Bu Pengyang Ling Yujie Zhou Yibin Wang Yuhang Zang Tong Wu Dahua Lin DiffM 261 1 0 24 Aug 2025
Compact Attention: Exploiting Structured Spatio-Temporal Sparsity for Fast Video Generation Qirui Li Guangcong Zheng Qi Zhao Jie Li Bin Dong Jing Lin Xi Li VGen 133 1 0 18 Aug 2025
MixCache: Mixture-of-Cache for Video Diffusion Transformer Acceleration Yuanxin Wei Lansong Diao B. Chen Shenggan Cheng Zhengping Qian Wenyuan Yu Nong Xiao W. Lin Jiangsu Du DiffM VGen 105 0 0 18 Aug 2025
From Cradle to Cane: A Two-Pass Framework for High-Fidelity Lifespan Face Aging Tao Liu Dafeng Zhang Gengchen Li Shizhuo Liu Yongqi Song S. Li Shiqi Yang Boqian Li Kai Wang Yaxing Wang 275 1 0 26 Jun 2025
Evolutionary Caching to Accelerate Your Off-the-Shelf Diffusion Model Anirud Aggarwal Abhinav Shrivastava M. Gwilliam 368 0 0 18 Jun 2025
MagCache: Fast Video Generation with Magnitude-Aware Cache Zehong Ma Longhui Wei Feng Wang Shiliang Zhang Q. Tian 245 8 0 10 Jun 2025
One-Way Ticket:Time-Independent Unified Encoder for Distilling Text-to-Image Diffusion ModelsComputer Vision and Pattern Recognition (CVPR), 2025 S. Li Lei Wang Kai Wang Tao Liu J. Xie Joost van de Weijer Fahad Shahbaz Khan Shiqi Yang Yaxing Wang Zhiqiang Wang 251 4 0 28 May 2025
Attend to Not Attended: Structure-then-Detail Token Merging for Post-training DiT AccelerationComputer Vision and Pattern Recognition (CVPR), 2025 Haipeng Fang Sheng Tang Juan Cao Enshuo Zhang Fan Tang Tong-Yee Lee 285 3 0 16 May 2025
FastVAR: Linear Visual Autoregressive Modeling via Cached Token Pruning Hang Guo Yawei Li Taolin Zhang Jiadong Wang Tao Dai Shu-Tao Xia Luca Benini 387 16 0 30 Mar 2025
FasterCache: Training-Free Video Diffusion Model Acceleration with High QualityInternational Conference on Learning Representations (ICLR), 2024 Zhengyao Lv Chenyang Si Junhao Song Zhenyu Yang Ping Luo Yu Qiao Kwan-Yee K. Wong VGen DiffM 394 46 0 13 Mar 2025
From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers Jiacheng Liu Chang Zou Yuanhuiyi Lyu Junjie Chen Linfeng Zhang DiffM 403 29 0 10 Mar 2025
FEB-Cache: Frequency-Guided Exposure Bias Reduction for Enhancing Diffusion Transformer Caching Zhen Zou Hu Yu 277 0 0 10 Mar 2025
Accelerating Diffusion Transformers with Token-wise Feature CachingInternational Conference on Learning Representations (ICLR), 2024 Chang Zou Xuyang Liu Ting Liu Siteng Huang Linfeng Zhang 391 58 0 20 Feb 2025
Accelerate High-Quality Diffusion Models with Inner Loop Feedback M. Gwilliam Han Cai Di Wu Abhinav Shrivastava Zhiyu Cheng 477 1 0 22 Jan 2025
Cached Adaptive Token Merging: Dynamic Token Reduction and Redundant Computation Elimination in Diffusion Model Omid Saghatchian Atiyeh Gh. Moghadam Ahmad Nickabadi MoMe 294 6 0 03 Jan 2025
Timestep Embedding Tells: It's Time to Cache for Video Diffusion ModelComputer Vision and Pattern Recognition (CVPR), 2024 Feng Liu Shiwei Zhang Xiaofeng Wang Yujie Wei Haonan Qiu Yuzhong Zhao Yingya Zhang Qixiang Ye Fang Wan VGen AI4TS 484 82 0 28 Nov 2024
Real-Time Video Generation with Pyramid Attention BroadcastInternational Conference on Learning Representations (ICLR), 2024 Xuanlei Zhao Xiaolong Jin Kai Wang Yang You VGen DiffM 470 75 0 22 Aug 2024
Pixel Is Not a Barrier: An Effective Evasion Attack for Pixel-Domain Diffusion ModelsAAAI Conference on Artificial Intelligence (AAAI), 2024 Chun-Yen Shih Li-Xuan Peng Jia-Wei Liao Ernie Chu Cheng-Fu Chou Jun-Cheng Chen AAML DiffM 384 1 0 21 Aug 2024
LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Models Dingkun Zhang Sijia Li Chen Chen Qingsong Xie H. Lu 526 44 0 17 Apr 2024
FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Models Junhyuk So Jungwon Lee Eunhyeok Park DiffM 294 14 0 06 Dec 2023
DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic ModelsMachine Intelligence Research (MIR), 2022 Cheng Lu Yuhao Zhou Fan Bao Jianfei Chen Chongxuan Li Jun Zhu DiffM 750 814 0 02 Nov 2022