Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models

21 March 2023

Matthias Nießner

Papers citing "Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models"

46 / 146 papers shown

Title
A Comprehensive Survey on 3D Content Generation Jian Liu Xiaoshui Huang Tianyu Huang Lu Chen Yuenan Hou ... Ziwei Liu Wanli Ouyang Wangmeng Zuo Junjun Jiang Xianming Liu 56 19 0 02 Feb 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 37 38 0 31 Jan 2024
Style-Consistent 3D Indoor Scene Synthesis with Decoupled Objects Yunfan Zhang Hong Huang Zhiwei Xiong Zhiqi Shen Guosheng Lin Hao Wang Nicholas Vun 16 0 0 24 Jan 2024
GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation Tong Wu Guandao Yang Zhibing Li Kai Zhang Ziwei Liu Leonidas J. Guibas Dahua Lin Gordon Wetzstein EGVM VGen 15 87 0 08 Jan 2024
SteinDreamer: Variance Reduction for Text-to-3D Score Distillation via Stein Identity Peihao Wang Zhiwen Fan Dejia Xu Dilin Wang Sreyas Mohan ... Rakesh Ranjan Yilei Li Qiang Liu Zhangyang Wang Vikas Chandra 16 21 0 31 Dec 2023
ShowRoom3D: Text to High-Quality 3D Room Generation Using 3D Priors Weijia Mao Yan-Pei Cao Jia-Wei Liu Zhongcong Xu Mike Zheng Shou DiffM 43 3 0 20 Dec 2023
Text2Immersion: Generative Immersive Scene with 3D Gaussians Ouyang Hao Kathryn Heal Stephen Lombardi Tiancheng Sun 3DGS 22 16 0 14 Dec 2023
Holodeck: Language Guided Generation of 3D Embodied AI Environments Yue Yang Fan-Yun Sun Luca Weihs Eli VanderBilt Alvaro Herrasti ... Lingjie Liu Chris Callison-Burch Mark Yatskar Aniruddha Kembhavi Christopher Clark LM&Ro 20 77 0 14 Dec 2023
SceneWiz3D: Towards Text-guided 3D Scene Composition Qihang Zhang Chaoyang Wang Aliaksandr Siarohin Peiye Zhuang Yinghao Xu Ceyuan Yang Dahua Lin Bolei Zhou Sergey Tulyakov Hsin-Ying Lee 12 31 0 13 Dec 2023
AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homes Rao Fu Zehao Wen Zichen Liu Srinath Sridhar 24 30 0 11 Dec 2023
ControlRoom3D: Room Generation using Semantic Proxy Rooms Jonas Schult Sam S. Tsai Lukas Höllein Bichen Wu Jialiang Wang ... Zijian He Peizhao Zhang Bastian Leibe Peter Vajda Ji Hou 17 31 0 08 Dec 2023
Gen2Det: Generate to Detect Saksham Suri Fanyi Xiao Animesh Sinha Sean Culatana Raghuraman Krishnamoorthi Chenchen Zhu Abhinav Shrivastava VLM DiffM 15 3 0 07 Dec 2023
NeRFiller: Completing Scenes via Generative 3D Inpainting Ethan Weber Aleksander Holyñski Varun Jampani Saurabh Saxena Noah Snavely Abhishek Kar Angjoo Kanazawa 60 30 0 07 Dec 2023
WonderJourney: Going from Anywhere to Everywhere Hong-Xing Yu Haoyi Duan Junhwa Hur Kyle Sargent Michael Rubinstein ... Forrester Cole Deqing Sun Noah Snavely Jiajun Wu Charles Herrmann VGen 14 51 0 06 Dec 2023
Alchemist: Parametric Control of Material Properties with Diffusion Models Prafull Sharma Varun Jampani Yuanzhen Li Xuhui Jia Dmitry Lagun Frédo Durand William T. Freeman Mark J. Matthews DiffM 31 21 0 05 Dec 2023
Generative Rendering: Controllable 4D-Guided Video Generation with 2D Diffusion Models Shengqu Cai Duygu Ceylan Matheus Gadelha C. Huang Tuanfeng Y. Wang Gordon Wetzstein VGen 14 16 0 03 Dec 2023
FSGS: Real-Time Few-shot View Synthesis using Gaussian Splatting Zehao Zhu Zhiwen Fan Yifan Jiang Zhangyang Wang 3DGS 12 143 0 01 Dec 2023
GenZI: Zero-Shot 3D Human-Scene Interaction Generation Lei Li Angela Dai VGen 13 21 0 29 Nov 2023
SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors Dave Zhenyu Chen Haoxuan Li Hsin-Ying Lee Sergey Tulyakov Matthias Nießner DiffM 14 28 0 28 Nov 2023
Deceptive-Human: Prompt-to-NeRF 3D Human Generation with 3D-Consistent Synthetic Images Shiu-hong Kao Xinhang Liu Yu-Wing Tai Chi-Keung Tang 13 0 0 27 Nov 2023
Animate124: Animating One Image to 4D Dynamic Scene Yuyang Zhao Zhiwen Yan Enze Xie Lanqing Hong Zhenguo Li Gim Hee Lee VGen 19 62 0 24 Nov 2023
The Chosen One: Consistent Characters in Text-to-Image Diffusion Models Omri Avrahami Amir Hertz Yael Vinker Moab Arar Shlomi Fruchter Ohad Fried Daniel Cohen-Or Dani Lischinski DiffM 34 32 0 16 Nov 2023
Real-time Animation Generation and Control on Rigged Models via Large Language Models Han Huang Fernanda De La Torre Cathy Mengying Fang Andrzej Banburski-Fahey Judith Amores Jaron Lanier AI4CE 19 8 0 27 Oct 2023
Recent Advances in Multi-modal 3D Scene Understanding: A Comprehensive Survey and Evaluation Yinjie Lei Zixuan Wang Feng Chen Guoqing Wang Peng Wang Yang Yang 27 8 0 24 Oct 2023
DreamSpace: Dreaming Your Room Space with Text-Driven Panoramic Texture Propagation Bangbang Yang Wenqi Dong Lin Ma Wenbo Hu Xiao Liu Zhaopeng Cui Yuewen Ma DiffM 27 16 0 19 Oct 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 22 101 0 11 Oct 2023
Ctrl-Room: Controllable Text-to-3D Room Meshes Generation with Layout Constraints Chuan Fang Yuan Dong Kunming Luo Xiaotao Hu Rakesh Shrestha Ping Tan DiffM 26 33 0 05 Oct 2023
LLMR: Real-time Prompting of Interactive Worlds using Large Language Models Fernanda De La Torre Cathy Mengying Fang Han Huang Andrzej Banburski-Fahey Judith Amores Fernandez Jaron Lanier 21 45 0 21 Sep 2023
$360$^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting$ 360 $^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting Nuri Ryu Minsu Gong Geon-Yeong Kim Joo-Haeng Lee Sunghyun Cho 3DGS 16 1 0 19 Sep 2023
DREAMWALKER: Mental Planning for Continuous Vision-Language Navigation Hanqing Wang Wei Liang Luc Van Gool Wenguan Wang LM&Ro 15 28 0 14 Aug 2023
MiDaS v3.1 -- A Model Zoo for Robust Monocular Relative Depth Estimation R. Birkl Diana Wofk Matthias Muller MDE 16 133 0 26 Jul 2023
MVDiffusion: Enabling Holistic Multi-view Image Generation with Correspondence-Aware Diffusion Shitao Tang Fuyang Zhang Jiacheng Chen Peng Wang Yasutaka Furukawa 8 150 0 03 Jul 2023
Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors Guocheng Qian Jinjie Mai Abdullah Hamdi Jian Ren Aliaksandr Siarohin ... Hsin-Ying Lee Ivan Skorokhodov Peter Wonka Sergey Tulyakov Bernard Ghanem DiffM 25 355 0 30 Jun 2023
Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision A. Tewari Tianwei Yin George Cazenavette Semon Rezchikov J. Tenenbaum F. Durand William T. Freeman Vincent Sitzmann DiffM 30 88 0 20 Jun 2023
Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptions Ian Huang Vrishab Krishna Omoruyi E. Atekha Leonidas J. Guibas DiffM VGen 10 7 0 09 Jun 2023
A survey of Generative AI Applications Roberto Gozalo-Brizuela Eduardo C. Garrido-Merchán 3DV MedIm 16 40 0 05 Jun 2023
DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generation Xiaoliang Ju Zhaoyang Huang Yijin Li Guofeng Zhang Yu Qiao Hongsheng Li 13 7 0 01 Jun 2023
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation Zhengyi Wang Cheng Lu Yikai Wang Fan Bao Chongxuan Li Hang Su Jun Zhu DiffM 28 518 0 25 May 2023
Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields Jingbo Zhang Xiaoyu Li Ziyu Wan Can Wang Jing Liao VGen DiffM 6 83 0 19 May 2023
RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture Liangchen Song Liangliang Cao Hongyu Xu Kai Kang Feng Tang Junsong Yuan Yang Zhao VGen DiffM 19 44 0 18 May 2023
Towards Generalist Robots: A Promising Paradigm via Generative Simulation Zhou Xian Théophile Gervet Zhenjia Xu Yi-Ling Qiao Tsun-Hsuan Wang Yian Wang LM&Ro 46 6 0 17 May 2023
Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era Chenghao Li Chaoning Zhang Atish Waghwase Lik-Hang Lee François Rameau Yang Yang Sung-Ho Bae Choong Seon Hong 44 68 0 10 May 2023
CLIP-Layout: Style-Consistent Indoor Scene Synthesis with Semantic Furniture Embedding Jingyu Liu Wenhan Xiong Ian Jones Yixin Nie Anchit Gupta Barlas Ouguz 3DV 40 14 0 07 Mar 2023
RealFusion: 360° Reconstruction of Any Object from a Single Image Luke Melas-Kyriazi Christian Rupprecht Iro Laina Andrea Vedaldi 85 288 0 21 Feb 2023
SceneScape: Text-Driven Consistent Scene Generation Rafail Fridman Amit Abecasis Yoni Kasten Tali Dekel VGen 33 110 0 02 Feb 2023
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 175 350 0 06 Dec 2021