RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion

10 April 2024

Papers citing "RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion"

47 / 47 papers shown

Title
Digital Twin Generation from Visual Data: A Survey Andrew Melnik Benjamin Alt Giang Hoang Nguyen Artur Wilkowski Maciej Stefańczyk Qirui Wu Sinan Harms Helge Rhodin Manolis Savva Michael Beetz 3DGS VGen 33 0 0 17 Apr 2025
GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting Junlin Hao Peiheng Wang Haoyang Wang Xinggong Zhang Zongming Guo 3DGS VGen 50 0 0 14 Apr 2025
Flash Sculptor: Modular 3D Worlds from Objects Yujia Hu Songhua Liu Xingyi Yang Xinchao Wang 25 0 0 08 Apr 2025
Scene Splatter: Momentum 3D Scene Generation from Single Image with Video Diffusion Model Shengjun Zhang Jinzhao Li Xin Fei Hao Liu Yueqi Duan DiffM 3DGS VGen 59 0 0 03 Apr 2025
WonderTurbo: Generating Interactive 3D World in 0.72 Seconds Chaojun Ni Xiaofeng Wang Zheng Zhu W. Wang Haoyun Li Guosheng Zhao Jie Li Wenkang Qin Guan Huang Wenjun Mei 3DGS ViT VGen 57 1 0 03 Apr 2025
WorldPrompter: Traversable Text-to-Scene Generation Zhaoyang Zhang Yannick Hold-Geoffroy Miloš Hašan Chen Ziwen Fujun Luan Julie Dorsey Yiwei Hu VGen 41 0 0 02 Apr 2025
Scene4U: Hierarchical Layered 3D Scene Reconstruction from Single Panoramic Image for Your Immerse Exploration Zilong Huang Jun-Jian He Junyan Ye Lihan Jiang Weijia Li Y. Chen Ting Han 31 0 0 01 Apr 2025
SuperDec: 3D Scene Decomposition with Superquadric Primitives Elisabetta Fedele Boyang Sun Leonidas J. Guibas Marc Pollefeys Francis Engelmann 3DPC 41 1 0 01 Apr 2025
ExScene: Free-View 3D Scene Reconstruction with Gaussian Splatting from a Single Image Tianyi Gong Boyan Li Yifei Zhong Fangxin Wang 3DGS VGen 30 0 0 31 Mar 2025
VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modeling Hyojun Go Byeongjun Park Hyelin Nam Byung-Hoon Kim Hyungjin Chung Changick Kim 3DGS VGen 89 1 0 20 Mar 2025
NuiScene: Exploring Efficient Generation of Unbounded Outdoor Scenes Han-Hung Lee Qinghong Han Angel X. Chang 77 0 0 20 Mar 2025
SynCity: Training-Free Generation of 3D Worlds Paul Engstler Aleksandar Shtedritski Iro Laina Christian Rupprecht Andrea Vedaldi 3DGS 98 0 0 20 Mar 2025
A Recipe for Generating 3D Worlds From a Single Image Katja Schwarz Denys Rozumnyi Samuel Rota Buló Lorenzo Porzi Peter Kontschieder VGen 69 1 0 20 Mar 2025
Bolt3D: Generating 3D Scenes in Seconds Stanislaw Szymanowicz Jason Y. Zhang P. Srinivasan Ruiqi Gao Arthur Brussee Aleksander Holynski Ricardo Martín Brualla Jonathan T. Barron Philipp Henzler 90 4 0 18 Mar 2025
Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors Katja Schwarz Norman Mueller Peter Kontschieder 3DGS 93 2 0 17 Mar 2025
Towards Affordance-Aware Articulation Synthesis for Rigged Objects Yu-Chu Yu C. Lin Hsin-Ying Lee Chaoyang Wang Y. Wang Ming Yang DiffM AI4CE 32 0 0 21 Jan 2025
Survey on Monocular Metric Depth Estimation Jiuling Zhang VLM 57 0 0 21 Jan 2025
A Critical Synthesis of Uncertainty Quantification and Foundation Models in Monocular Depth Estimation S. Landgraf Rongjun Qin Markus Ulrich UQCV 56 0 0 14 Jan 2025
Pointmap-Conditioned Diffusion for Consistent Novel View Synthesis Thang-Anh-Quan Nguyen Nathan Piasco Luis Roldão Moussâb Bennehar D. Tsishkou Laurent Caraffa J. Tarel R. Brémond DiffM 33 1 0 06 Jan 2025
Wonderland: Navigating 3D Scenes from a Single Image Hanwen Liang Junli Cao Vidit Goel Guocheng Qian Sergei Korolev Demetri Terzopoulos Konstantinos N. Plataniotis Sergey Tulyakov Jian Ren VGen 125 11 0 16 Dec 2024
You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale Baorui Ma Huachen Gao Haoge Deng Zhengxiong Luo Tiejun Huang Lulu Tang Xinlong Wang DiffM VGen 92 14 0 09 Dec 2024
FiffDepth: Feed-forward Transformation of Diffusion-Based Generators for Detailed Depth Estimation Yunpeng Bai Qixing Huang DiffM 81 0 0 01 Dec 2024
MVGenMaster: Scaling Multi-View Generation from Any Image via 3D Priors Enhanced Diffusion Model Chenjie Cao Chaohui Yu Shang Liu Fan Wang Xiangyang Xue Yanwei Fu 68 1 0 25 Nov 2024
SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis Hyojun Go Byeongjun Park Jiho Jang Jin-Young Kim Soonwoo Kwon Changick Kim 3DGS 105 2 0 25 Nov 2024
SCube: Instant Large-Scale Scene Reconstruction using VoxSplats Xuanchi Ren Y. Lu Hanxue Liang Zhangjie Wu Huan Ling Mike Chen Sanja Fidler Francis Williams Jiahui Huang 3DGS 25 8 0 26 Oct 2024
VistaDream: Sampling multiview consistent images for single-view scene reconstruction Haiping Wang Yuan-Bin Liu Ziwei Liu Wenping Wang Z. Dong Bisheng Yang 33 11 0 22 Oct 2024
ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis Wangbo Yu Jinbo Xing Li Yuan Wenbo Hu Xiaoyu Li Zhipeng Huang Xiangjun Gao T. Wong Ying Shan Yonghong Tian VGen DiffM 28 77 0 03 Sep 2024
SceneDreamer360: Text-Driven 3D-Consistent Scene Generation with Panoramic Gaussian Splatting Wenrui Li Yapeng Mi Fucheng Cai Zhe Yang Wangmeng Zuo Xingtao Wang Xiaopeng Fan 3DGS 22 3 0 25 Aug 2024
Diffusion-Based Visual Art Creation: A Survey and New Perspectives Bingyuan Wang Qifeng Chen Zeyu Wang 26 7 0 22 Aug 2024
Pano2Room: Novel View Synthesis from a Single Indoor Panorama Guo Pu Yiming Zhao Zhouhui Lian 3DV 23 4 0 21 Aug 2024
Scene123: One Prompt to 3D Scene Generation via Video-Assisted and Consistency-Enhanced MAE Yiying Yang Fukun Yin Jiayuan Fan Xin Chen Wanzhang Li Gang Yu VGen 26 0 0 10 Aug 2024
Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketches Yongzhi Xu Yonhon Ng Yifu Wang Inkyu Sa Yunfei Duan Yang Li Pan Ji Hongdong Li VGen 3DV 21 4 0 08 Aug 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 62 41 0 17 Jul 2024
HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Model Hieu T. Nguyen Yiwen Chen Vikram S. Voleti Varun Jampani Huaizu Jiang 39 0 0 28 Jun 2024
Director3D: Real-world Camera Trajectory and 3D Scene Generation from Text Xinyang Li Zhangyu Lai Linning Xu Yansong Qu Liujuan Cao Shengchuan Zhang Bo Dai Rongrong Ji VGen 35 5 0 25 Jun 2024
4K4DGen: Panoramic 4D Generation at 4K Resolution Renjie Li Panwang Pan Bangbang Yang Dejia Xu Shijie Zhou Xuanyang Zhang Zeming Li A. Kadambi Zhangyang Wang Zhiwen Fan VGen 37 16 0 19 Jun 2024
Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models Paul Henderson Melonie de Almeida D. Ivanova Titas Anciukevicius 3DGS 23 2 0 18 Jun 2024
Depth Anything V2 Lihe Yang Bingyi Kang Zilong Huang Zhen Zhao Xiaogang Xu Jiashi Feng Hengshuang Zhao DiffM VLM MDE 44 194 0 13 Jun 2024
WonderWorld: Interactive 3D Scene Generation from a Single Image Hong-Xing Yu Haoyi Duan Charles Herrmann William T. Freeman Jiajun Wu 3DGS VGen 21 37 0 13 Jun 2024
GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping Junyoung Seo Kazumi Fukuda Takashi Shibuya Takuya Narihira Naoki Murata Shoukang Hu Chieh-Hsin Lai Seungryong Kim Yuki Mitsufuji 35 12 0 27 May 2024
DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling Xuening Yuan Hongyu Yang Yueming Zhao Di Huang 3DGS 39 3 0 14 Apr 2024
Recent Advances in 3D Gaussian Splatting Tong Wu Yu-Jie Yuan Ling-Xiao Zhang Jie Yang Yan-Pei Cao Ling-Qi Yan Lin Gao 3DGS 60 84 0 17 Mar 2024
LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation Jiaxiang Tang Zhaoxi Chen Xiaokang Chen Tengfei Wang Gang Zeng Ziwei Liu 3DGS 3DV 79 97 0 07 Feb 2024
Depth Anything: Unleashing the Power of Large-Scale Unlabeled Data Lihe Yang Bingyi Kang Zilong Huang Xiaogang Xu Jiashi Feng Hengshuang Zhao VLM 130 681 0 19 Jan 2024
Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models Jiarui Xu Sifei Liu Arash Vahdat Wonmin Byeon Xiaolong Wang Shalini De Mello VLM 198 318 0 08 Mar 2023
RealFusion: 360° Reconstruction of Any Object from a Single Image Luke Melas-Kyriazi Christian Rupprecht Iro Laina Andrea Vedaldi 85 288 0 21 Feb 2023
PixelSynth: Generating a 3D-Consistent Experience from a Single Image C. Rockwell David Fouhey Justin Johnson VGen 42 83 0 12 Aug 2021