A Unified Approach for Text- and Image-guided 4D Scene Generation

28 November 2023

Otmar Hilliges

Papers citing "A Unified Approach for Text- and Image-guided 4D Scene Generation"

43 / 43 papers shown

Title
STP4D: Spatio-Temporal-Prompt Consistent Modeling for Text-to-4D Gaussian Splatting Yunze Deng Haijun Xiong Bin Feng X. Wang W. Liu 3DGS 42 0 0 25 Apr 2025
WorldScore: A Unified Evaluation Benchmark for World Generation Haoyi Duan Hong-Xing Yu Sirui Chen L. Fei-Fei Jiajun Wu VGen 62 1 0 01 Apr 2025
Articulated Kinematics Distillation from Video Diffusion Models Xuan Li Qianli Ma Tsung-Yi Lin Yongxin Chen Chenfanfu Jiang Ming-Yu Liu Donglai Xiang VGen 31 0 0 01 Apr 2025
Free4D: Tuning-free 4D Scene Generation with Spatial-Temporal Consistency T. Liu Z. Huang Zhaoxi Chen Guangcong Wang Shoukang Hu Liao Shen Huiqiang Sun Z. Cao Wei Li Z. Liu VGen 3DGS 79 0 0 26 Mar 2025
Advances in 4D Generation: A Survey Qiaowei Miao Kehan Li Jinsheng Quan Zhiyuan Min Shaojie Ma Yichao Xu Yi Yang Yawei Luo 51 0 0 18 Mar 2025
Motion Anything: Any to Motion Generation Zeyu Zhang Yiran Wang Wei Mao Danning Li Rui Zhao Biao Wu Zirui Song Bohan Zhuang Ian Reid Richard I. Hartley DiffM VGen 51 1 0 13 Mar 2025
FuseChat-3.0: Preference Optimization Meets Heterogeneous Model Fusion Ziyi Yang Fanqi Wan Longguang Zhong Canbin Huang Guosheng Liang Xiaojun Quan MoMe 90 0 0 06 Mar 2025
4Real-Video: Learning Generalizable Photo-Realistic 4D Video Diffusion Chaoyang Wang Peiye Zhuang Tuan Duc Ngo Willi Menapace Aliaksandr Siarohin Michael Vasilkovsky Ivan Skorokhodov Sergey Tulyakov Peter Wonka Hsin-Ying Lee DiffM VGen 90 3 0 05 Dec 2024
PaintScene4D: Consistent 4D Scene Generation from Text Prompts Vinayak Gupta Yunze Man Yu-Xiong Wang VGen 81 0 0 05 Dec 2024
CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models Rundi Wu Ruiqi Gao Ben Poole Alex Trevithick Changxi Zheng Jonathan T. Barron Aleksander Holyñski VGen 76 24 0 27 Nov 2024
Phys4DGen: Physics-Compliant 4D Generation with Multi-Material Composition Perception Jiajing Lin Zhenzhong Wang Shu Jiang Yongjie Hou Min Jiang Min Jiang VGen 64 0 0 25 Nov 2024
Towards motion from video diffusion models Paul Janson Tiberiu Popa Eugene Belilovsky DiffM VGen 62 0 0 19 Nov 2024
Joker: Conditional 3D Head Synthesis with Extreme Facial Expressions Malte Prinzler Egor Zakharov V. Sklyarova Berna Kabadayi Justus Thies DiffM 26 5 0 21 Oct 2024
Enhancing JEPAs with Spatial Conditioning: Robust and Efficient Representation Learning Etai Littwin Vimal Thilak Anand Gopalakrishnan 37 8 0 14 Oct 2024
AvatarGO: Zero-shot 4D Human-Object Interaction Generation and Animation Yukang Cao Liang Pan Kai Han Kwan-Yee K. Wong Ziwei Liu VGen 32 6 0 09 Oct 2024
Trans4D: Realistic Geometry-Aware Transition for Compositional Text-to-4D Synthesis Bohan Zeng Ling Yang Siyu Li Jiaming Liu Zixiang Zhang ... Yongzhen Guo Fu-Yun Wang Minkai Xu Stefano Ermon Wentao Zhang VGen AI4CE 23 6 0 09 Oct 2024
Phy124: Fast Physics-Driven 4D Content Generation from a Single Image Jiajing Lin Zhenzhong Wang Yongjie Hou Yuzhou Tang Min Jiang VGen 24 6 0 11 Sep 2024
CT4D: Consistent Text-to-4D Generation with Animatable Meshes Ce Chen Shaoli Huang Xuelin Chen Guangyi Chen Xiaoguang Han Kun Zhang Mingming Gong 30 4 0 15 Aug 2024
4Dynamic: Text-to-4D Generation with Hybrid Priors Yu-Jie Yuan Leif Kobbelt Jiwen Liu Yuan Zhang Pengfei Wan Yu-Kun Lai Lin Gao 40 3 0 17 Jul 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 80 42 0 17 Jul 2024
Animate3D: Animating Any 3D Model with Multi-view Video Diffusion Yanqin Jiang Chaohui Yu Chenjie Cao Fan Wang Weiming Hu Jin Gao VGen 46 16 0 16 Jul 2024
DisCo-Diff: Enhancing Continuous Diffusion Models with Discrete Latents Yilun Xu Gabriele Corso Tommi Jaakkola Arash Vahdat Karsten Kreis 29 12 0 03 Jul 2024
L4GM: Large 4D Gaussian Reconstruction Model Jiawei Ren Kevin Xie Ashkan Mirzaei Hanxue Liang Xiaohui Zeng ... Ziwei Liu Antonio Torralba Sanja Fidler Seung Wook Kim Huan Ling 3DGS 22 37 0 14 Jun 2024
4Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models Heng Yu Chaoyang Wang Peiye Zhuang Willi Menapace Aliaksandr Siarohin Junli Cao László A. Jeni Sergey Tulyakov Hsin-Ying Lee VGen 43 23 0 11 Jun 2024
4Diffusion: Multi-view Video Diffusion Model for 4D Generation Haiyu Zhang Xinyuan Chen Yaohui Wang Xihui Liu Yunhong Wang Yu Qiao VGen 67 27 0 31 May 2024
VividDream: Generating 3D Scene with Ambient Dynamics Yao-Chih Lee Yi-Ting Chen Andrew Wang Ting-Hsuan Liao Brandon Y. Feng Jia-Bin Huang VGen 32 10 0 30 May 2024
MotionDreamer: Zero-Shot 3D Mesh Animation from Video Diffusion Models Lukas Uzolas E. Eisemann Petr Kellnhofer 35 1 0 30 May 2024
PLA4D: Pixel-Level Alignments for Text-to-4D Gaussian Splatting Qiaowei Miao Yawei Luo Yi Yang 3DGS DiffM 36 7 0 30 May 2024
EG4D: Explicit Generation of 4D Object without Score Distillation Qi Sun Zhiyang Guo Ziyu Wan Jing Nathan Yan Shengming Yin Wen-gang Zhou Jing Liao Houqiang Li VGen 3DGS 32 13 0 28 May 2024
Sync4D: Video Guided Controllable Dynamics for Physics-Based 4D Generation Zhoujie Fu Jiacheng Wei Wenhao Shen Chaoyue Song Xiaofeng Yang Fayao Liu Xulei Yang Guosheng Lin 3DGS 40 5 0 27 May 2024
MagicPose4D: Crafting Articulated Models with Appearance and Motion Control Hao Zhang Di Chang Fang Li Mohammad Soleymani Narendra Ahuja 36 6 0 22 May 2024
A Survey on Personalized Content Synthesis with Diffusion Models Xu-Lu Zhang Xiao Wei Wengyu Zhang Jinlin Wu Zhaoxiang Zhang Zhen Lei Qing Li Zhen Lei Qing Li EGVM 131 19 0 09 May 2024
DreamScene4D: Dynamic Multi-Object Scene Generation from Monocular Videos Wen-Hsuan Chu Lei Ke Katerina Fragkiadaki 3DGS VGen 21 29 0 03 May 2024
RefFusion: Reference Adapted Diffusion Models for 3D Scene Inpainting Ashkan Mirzaei Riccardo de Lutio Seungryong Kim David Acuna J. Kelly Sanja Fidler Igor Gilitschenski Zan Gojcic DiffM 45 10 0 16 Apr 2024
SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfer Zijie Wu Chaohui Yu Yanqin Jiang Chenjie Cao Fan Wang Xiang Bai 3DGS 33 22 0 04 Apr 2024
TC4D: Trajectory-Conditioned Text-to-4D Generation Sherwin Bahmani Xian Liu Yifan Wang Ivan Skorokhodov Victor Rong ... Jeong Joon Park Sergey Tulyakov Gordon Wetzstein Andrea Tagliasacchi David B. Lindell 97 35 0 26 Mar 2024
Comp4D: LLM-Guided Compositional 4D Scene Generation Dejia Xu Hanwen Liang N. Bhatt Hezhen Hu Hanxue Liang Konstantinos N. Plataniotis Zhangyang Wang 34 23 0 25 Mar 2024
STAG4D: Spatial-Temporal Anchored Generative 4D Gaussians Yifei Zeng Yanqin Jiang Siyu Zhu Yuanxun Lu Youtian Lin Hao Zhu Weiming Hu Xun Cao Yao Yao 3DGS 71 45 0 22 Mar 2024
DreamGaussian4D: Generative 4D Gaussian Splatting Jiawei Ren Liang Pan Jiaxiang Tang Chi Zhang Ang Cao Gang Zeng Ziwei Liu 3DGS 19 102 0 28 Dec 2023
Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models Huan Ling Seung Wook Kim Antonio Torralba Sanja Fidler Karsten Kreis DiffM 3DGS 32 112 0 21 Dec 2023
4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling Sherwin Bahmani Ivan Skorokhodov Victor Rong Gordon Wetzstein Leonidas J. Guibas Peter Wonka Sergey Tulyakov Jeong Joon Park Andrea Tagliasacchi David B. Lindell DiffM 41 103 0 29 Nov 2023
Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior Junshu Tang Tengfei Wang Bo Zhang Ting Zhang Ran Yi Lizhuang Ma Dong Chen DiffM 187 307 0 24 Mar 2023
RealFusion: 360° Reconstruction of Any Object from a Single Image Luke Melas-Kyriazi Christian Rupprecht Iro Laina Andrea Vedaldi 85 290 0 21 Feb 2023