Optimizing Diffusion Noise Can Serve As Universal Motion Priors

19 December 2023

Korrawe Karunratanakul

Konpat Preechakul

Emre Aksan

Thabo Beeler

Supasorn Suwajanakorn

Siyu Tang

DiffM

ArXiv PDF HTML

Papers citing "Optimizing Diffusion Noise Can Serve As Universal Motion Priors"

31 / 31 papers shown

Title
Model See Model Do: Speech-Driven Facial Animation with Style Control Yifang Pan Karan Singh Luiz Gustavo Hafemann DiffM 48 0 0 02 May 2025
UniPhys: Unified Planner and Controller with Diffusion for Flexible Physics-Based Character Control Y. Wu Korrawe Karunratanakul Zhengyi Luo Siyu Tang DiffM VGen AI4CE 41 0 0 17 Apr 2025
ARFlow: Human Action-Reaction Flow Matching with Physical Guidance Wentao Jiang Jingya Wang Haotao Lu Kaiyang Ji Baoxiong Jia Siyuan Huang Ye-ling Shi 39 0 0 21 Mar 2025
Motion Synthesis with Sparse and Flexible Keyjoint Control I. Hwang Jinseok Bae Donggeun Lim Y. Kim 56 0 0 18 Mar 2025
SALAD: Skeleton-aware Latent Diffusion for Text-driven Motion Generation and Editing Seokhyeon Hong Chaelin Kim Serin Yoon Junghyun Nam Sihun Cha Junyong Noh DiffM VGen 68 0 0 18 Mar 2025
Generative Motion Infilling From Imprecisely Timed Keyframes Purvi Goel Haotian Zhang Chenyang Liu Kayvon Fatahalian VGen 42 0 0 02 Mar 2025
CoMA: Compositional Human Motion Generation with Multi-modal Agents Shanlin Sun Gabriel De Araujo Jiaqi Xu S. Kevin Zhou Hanwen Zhang Ziheng Huang Chenyu You Xiaohui Xie 85 4 0 10 Dec 2024
SMGDiff: Soccer Motion Generation using diffusion probabilistic models Hongdi Yang Chengyang Li Zhenxuan Wu Gaozheng Li Jingya Wang Jingyi Yu Zhuo Su Lan Xu DiffM VGen 68 1 0 25 Nov 2024
Recovering Complete Actions for Cross-dataset Skeleton Action Recognition Hanchao Liu Yujiang Li Tai-Jiang Mu Shi-Min Hu 25 0 0 31 Oct 2024
Lodge++: High-quality and Long Dance Generation with Vivid Choreography Patterns Ronghui Li Hongwen Zhang Yachao Zhang Yuxiang Zhang Youliang Zhang Jie Guo Yan Zhang Xiu Li Yebin Liu 25 6 0 27 Oct 2024
Focused ReAct: Improving ReAct through Reiterate and Early Stop Shuoqiu Li Han Xu Haipeng Chen ReLM LRM 28 4 0 14 Oct 2024
AFlow: Automating Agentic Workflow Generation Jiayi Zhang Jinyu Xiang Zhaoyang Yu Fengwei Teng Xionghui Chen ... Jinlin Wang Bingnan Zheng Bang Liu Yuyu Luo Chenglin Wu AIFin AI4CE 18 29 0 14 Oct 2024
CLoSD: Closing the Loop between Simulation and Diffusion for multi-task character control Guy Tevet Sigal Raab S. Cohan Daniele Reda Zhengyi Luo Xue Bin Peng Amit H. Bermano M. van de Panne 24 15 0 04 Oct 2024
COIN: Control-Inpainting Diffusion Prior for Human and Camera Motion Estimation Jiefeng Li Ye Yuan Davis Rempe Haotian Zhang Pavlo Molchanov Cewu Lu Jan Kautz Umar Iqbal DiffM VGen 29 2 0 29 Aug 2024
SMooDi: Stylized Motion Diffusion Model Lei Zhong Yiming Xie Varun Jampani Deqing Sun Huaizu Jiang DiffM 42 15 0 17 Jul 2024
ReNO: Enhancing One-step Text-to-Image Models through Reward-based Noise Optimization L. Eyring Shyamgopal Karthik Karsten Roth Alexey Dosovitskiy Zeynep Akata 68 16 0 06 Jun 2024
MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Training Kengo Uchida Takashi Shibuya Yuhta Takida Naoki Murata Shusuke Takahashi Shusuke Takahashi Yuki Mitsufuji VGen 40 4 0 04 Jun 2024
DITTO-2: Distilled Diffusion Inference-Time T-Optimization for Music Generation Zachary Novack Julian McAuley Taylor Berg-Kirkpatrick Nicholas J. Bryan 23 7 0 30 May 2024
RectifID: Personalizing Rectified Flow with Anchored Classifier Guidance Zhicheng Sun Zhenhao Yang Yang Jin Haozhe Chi Kun Xu ... Hao Jiang Di Zhang Yang Song Kun Gai Yadong Mu 21 3 0 23 May 2024
Gradient Guidance for Diffusion Models: An Optimization Perspective Yingqing Guo Hui Yuan Yukang Yang Minshuo Chen Mengdi Wang 18 20 0 23 Apr 2024
A Unified Editing Method for Co-Speech Gesture Generation via Diffusion Inversion Zeyu Zhao Nan Gao Zhi Zeng Guixuan Zhang Jie Liu Shuwu Zhang DiffM 29 0 0 03 Apr 2024
GPT-Connect: Interaction between Text-Driven Human Motion Generator and 3D Scenes in a Training-free Manner Haoxuan Qu Ziyan Guo Jun Liu VGen 34 3 0 22 Mar 2024
DITTO: Diffusion Inference-Time T-Optimization for Music Generation Zachary Novack Julian McAuley Taylor Berg-Kirkpatrick Nicholas J. Bryan DiffM 13 32 0 22 Jan 2024
RoHM: Robust Human Motion Reconstruction via Diffusion Siwei Zhang Bharat Lal Bhatnagar Yuanlu Xu Alexander Winkler Petr Kadlecek Siyu Tang Federica Bogo DiffM 17 17 0 16 Jan 2024
Iterative Motion Editing with Natural Language Purvi Goel Kuan-Chieh Wang C. Karen Liu Kayvon Fatahalian DiffM 19 22 0 15 Dec 2023
End-to-End Diffusion Latent Optimization Improves Classifier Guidance Bram Wallace Akash Gokul Stefano Ermon Nikhil Naik 113 53 0 23 Mar 2023
Human Motion Diffusion Model Guy Tevet Sigal Raab Brian Gordon Yonatan Shafir Daniel Cohen-Or Amit H. Bermano DiffM VGen 180 713 0 29 Sep 2022
TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Texts Chuan Guo Xinxin Xuo Sen Wang Li Cheng VGen 60 225 0 04 Jul 2022
Planning with Diffusion for Flexible Behavior Synthesis Michael Janner Yilun Du J. Tenenbaum Sergey Levine DiffM 202 622 0 20 May 2022
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++ Ruilong Li Sha Yang David A. Ross Angjoo Kanazawa ViT 198 467 0 21 Jan 2021
Perpetual Motion: Generating Unbounded Human Motion Yan Zhang Michael J. Black Siyu Tang 3DH 45 47 0 27 Jul 2020