Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models

21 March 2023

Matthias Nießner

Papers citing "Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models"

50 / 146 papers shown

Title
DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priors Zizheng Yan Jiapeng Zhou Fanpeng Meng Yushuang Wu Lingteng Qiu Zisheng Ye Shuguang Cui Guanying Chen Xiaoguang Han DiffM 31 4 0 23 Jul 2024
HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions Haiyang Zhou Xinhua Cheng Wangbo Yu Yonghong Tian Li-ming Yuan 3DGS DiffM 44 10 0 21 Jul 2024
GenRC: Generative 3D Room Completion from Sparse Image Collections Ming-feng Li Yueh-Feng Ku Hong-Xuan Yen Chi Liu Yu-Lun Liu Albert Y. C. Chen Cheng-Hao Kuo Min Sun 3DV VGen 34 4 0 17 Jul 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 72 41 0 17 Jul 2024
InstructLayout: Instruction-Driven 2D and 3D Layout Synthesis with Semantic Graph Prior Chenguo Lin Yuchen Lin Panwang Pan Xuanyang Zhang Yadong Mu 3DV 38 1 0 10 Jul 2024
SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrix Peng Dai Feitong Tan Qiangeng Xu David Futschik Ruofei Du S. Fanello Xiaojuan Qi Yinda Zhang VGen 21 4 0 29 Jun 2024
HouseCrafter: Lifting Floorplans to 3D Scenes with 2D Diffusion Model Hieu T. Nguyen Yiwen Chen Vikram S. Voleti Varun Jampani Huaizu Jiang 51 0 0 28 Jun 2024
MultiDiff: Consistent Novel View Synthesis from a Single Image Norman Muller Katja Schwarz Barbara Roessle Lorenzo Porzi Samuel Rota Buló Matthias Nießner Peter Kontschieder DiffM 34 22 0 26 Jun 2024
Director3D: Real-world Camera Trajectory and 3D Scene Generation from Text Xinyang Li Zhangyu Lai Linning Xu Yansong Qu Liujuan Cao Shengchuan Zhang Bo Dai Rongrong Ji VGen 47 8 0 25 Jun 2024
WonderWorld: Interactive 3D Scene Generation from a Single Image Hong-Xing Yu Haoyi Duan Charles Herrmann William T. Freeman Jiajun Wu 3DGS VGen 41 37 0 13 Jun 2024
CityCraft: A Real Crafter for 3D City Generation Jie Deng Wenhao Chai Junsheng Huang Zhonghan Zhao Qixuan Huang ... Shengyu Hao Wenhao Hu Jenq-Neng Hwang X. Li Gaoang Wang 28 12 0 07 Jun 2024
3D-GRAND: A Million-Scale Dataset for 3D-LLMs with Better Grounding and Less Hallucination Jianing Yang Xuweiyi Chen Nikhil Madaan Madhavan Iyengar Shengyi Qian David Fouhey Joyce Chai 3DV 61 11 0 07 Jun 2024
Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Image Stanislaw Szymanowicz Eldar Insafutdinov Chuanxia Zheng Dylan Campbell João F. Henriques Christian Rupprecht Andrea Vedaldi 3DGS 24 49 0 06 Jun 2024
RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting Qi Wang Ruijie Lu Xudong Xu Jingbo Wang Michael Yu Wang Bo Dai Gang Zeng Dan Xu DiffM 33 6 0 04 Jun 2024
L-MAGIC: Language Model Assisted Generation of Images with Coherence Zhipeng Cai Matthias Mueller R. Birkl Diana Wofk Shaoyen Tseng JunDa Cheng Gabriela Ben-Melech Stan Vasudev Lal Michael Paulitsch DiffM MLLM 32 6 0 03 Jun 2024
Lay-A-Scene: Personalized 3D Object Arrangement Using Text-to-Image Priors Ohad Rahamim Hilit Segev Idan Achituve Y. Atzmon Yoni Kasten Gal Chechik 44 4 0 02 Jun 2024
VividDream: Generating 3D Scene with Ambient Dynamics Yao-Chih Lee Yi-Ting Chen Andrew Wang Ting-Hsuan Liao Brandon Y. Feng Jia-Bin Huang VGen 32 10 0 30 May 2024
GECO: Generative Image-to-3D within a SECOnd Chen Wang Jiatao Gu Xiaoxiao Long Yuan Liu Lingjie Liu 31 5 0 30 May 2024
3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting Qihang Zhang Yinghao Xu Chaoyang Wang Hsin-Ying Lee Gordon Wetzstein Bolei Zhou Ceyuan Yang 3DGS 30 6 0 28 May 2024
Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Control Zhengfei Kuang Shengqu Cai Hao He Yinghao Xu Hongsheng Li Leonidas J. Guibas Gordon Wetzstein VGen DiffM 30 18 0 27 May 2024
Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis Basile Van Hoorick Rundi Wu Ege Ozguroglu Kyle Sargent Ruoshi Liu P. Tokmakov Achal Dave Changxi Zheng Carl Vondrick DiffM VGen 44 29 0 23 May 2024
Images that Sound: Composing Images and Sounds on a Single Canvas Ziyang Chen Daniel Geng Andrew Owens DiffM 41 8 0 20 May 2024
ART3D: 3D Gaussian Splatting for Text-Guided Artistic Scenes Generation Pengzhi Li Chengshuai Tang Qinxuan Huang Zhiheng Li 3DGS 41 12 0 17 May 2024
CAT3D: Create Anything in 3D with Multi-View Diffusion Models Ruiqi Gao Aleksander Holynski Philipp Henzler Arthur Brussee Ricardo Martín Brualla Pratul P. Srinivasan Jonathan T. Barron Ben Poole 26 149 0 16 May 2024
FastScene: Text-Driven Fast 3D Indoor Scene Generation via Panoramic Gaussian Splatting Yikun Ma Dandan Zhan Zhi Jin 3DGS 14 8 0 09 May 2024
Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpainting Paul Engstler Andrea Vedaldi Iro Laina Christian Rupprecht MDE 29 9 0 30 Apr 2024
Enhancing Prompt Following with Visual Control Through Training-Free Mask-Guided Diffusion Hongyu Chen Yi-Meng Gao Min Zhou Peng Wang Xubin Li Tiezheng Ge Bo Zheng DiffM 23 4 0 23 Apr 2024
Taming Latent Diffusion Model for Neural Radiance Field Inpainting C. Lin Changil Kim Jia-Bin Huang Qinbo Li Chih-Yao Ma Johannes Kopf Ming-Hsuan Yang Hung-Yu Tseng AI4CE DiffM 19 10 0 15 Apr 2024
DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling Xuening Yuan Hongyu Yang Yueming Zhao Di Huang 3DGS 49 3 0 14 Apr 2024
Taming Stable Diffusion for Text to 360° Panorama Image Generation Cheng Zhang Qianyi Wu Camilo Cruz Gambardella Xiaoshui Huang Dinh Q. Phung Wanli Ouyang Jianfei Cai MDE 19 8 0 11 Apr 2024
Urban Architect: Steerable 3D Urban Scene Generation with Layout Prior Fan Lu Kwan-Yee Lin Yan Xu Hongsheng Li Guang Chen Changjun Jiang 27 7 0 10 Apr 2024
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion Jaidev Shriram Alex Trevithick Lingjie Liu Ravi Ramamoorthi DiffM 3DGS 62 54 0 10 Apr 2024
DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Sampling Haoran Li Haolin Shi Wenli Zhang Wenjun Wu Yong Liao Lin Wang Lik-hang Lee Pengyuan Zhou 3DGS 16 30 0 04 Apr 2024
MatAtlas: Text-driven Consistent Geometry Texturing and Material Assignment Duygu Ceylan Valentin Deschaintre Thibault Groueix Rosalie Martin C. Huang Romain Rouffet Vladimir G. Kim Gaetan Lassagne DiffM 16 8 0 03 Apr 2024
I-Design: Personalized LLM Interior Designer Ata cCelen Guo Han Konrad Schindler Luc Van Gool Iro Armeni Anton Obukhov Xi Wang 3DV 24 4 0 03 Apr 2024
MaGRITTe: Manipulative and Generative 3D Realization from Image, Topview and Text T. Hara Tatsuya Harada DiffM 14 3 0 30 Mar 2024
CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussians Avinash Paliwal Wei Ye Jinhui Xiong Dmytro Kotovenko Rakesh Ranjan Vikas Chandra N. Kalantari 21 0 0 28 Mar 2024
Frankenstein: Generating Semantic-Compositional 3D Scenes in One Tri-Plane Han Yan Yang Li Zhennan Wu Shenzhou Chen Weixuan Sun ... Tian Chen Xiaqiang Dai Chao Ma Hongdong Li Pan Ji DiffM VGen 50 8 0 24 Mar 2024
SceneX:Procedural Controllable Large-scale Scene Generation via Large-language Models Mengqi Zhou Jun Hou Chuanchen Luo Yuxi Wang Zhaoxiang Zhang Junran Peng 50 0 0 23 Mar 2024
SyncTweedies: A General Generative Framework Based on Synchronized Diffusions Jaihoon Kim Juil Koo Kyeongmin Yeo Minhyuk Sung DiffM 3DGS 27 9 0 21 Mar 2024
Text-to-3D Shape Generation Han-Hung Lee Manolis Savva Angel X. Chang 32 11 0 20 Mar 2024
Urban Scene Diffusion through Semantic Occupancy Map Junge Zhang Qihang Zhang Li Zhang Ramana Rao Kompella Gaowen Liu Bolei Zhou 29 4 0 18 Mar 2024
3D-SceneDreamer: Text-Driven 3D-Consistent Scene Generation Frank Zhang Yibo Zhang Quan Zheng R. Ma W. Hua Hujun Bao Weiwei Xu Changqing Zou 44 9 0 14 Mar 2024
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models Lukas Höllein Aljavz Bovzivc Norman Muller David Novotny Hung-Yu Tseng Christian Richardt Michael Zollhöfer Matthias Nießner DiffM 36 39 0 04 Mar 2024
FrameNeRF: A Simple and Efficient Framework for Few-shot Novel View Synthesis Yan Xing Pan Wang Ligang Liu Daolun Li Li Zhang 28 2 0 22 Feb 2024
GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering Abdullah Hamdi Luke Melas-Kyriazi Jinjie Mai Guocheng Qian Ruoshi Liu Carl Vondrick Bernard Ghanem Andrea Vedaldi 3DGS 9 43 0 15 Feb 2024
HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting Zhen Zhou Fan Ma Hehe Fan Yi Yang 3DGS 27 26 0 09 Feb 2024
InstructScene: Instruction-Driven 3D Indoor Scene Synthesis with Semantic Graph Prior Chenguo Lin Yadong Mu 3DV 8 32 0 07 Feb 2024
Denoising Diffusion via Image-Based Rendering Titas Anciukevicius Fabian Manhardt Federico Tombari Paul Henderson 40 11 0 05 Feb 2024
Open-Universe Indoor Scene Generation using LLM Program Synthesis and Uncurated Object Databases Rio Aguina-Kang Maxim Gumin Do Heon Han Stewart Morris Seung Jean Yoo Aditya Ganeshan R. K. Jones Qiuhong Anna Wei Kailiang Fu Daniel E. Ritchie 3DV 37 24 0 05 Feb 2024