HoloDiffusion: Training a 3D Diffusion Model using 2D Images

29 March 2023

Animesh Karnewar

Andrea Vedaldi

David Novotny

Niloy Mitra

ArXiv PDF HTML

Papers citing "HoloDiffusion: Training a 3D Diffusion Model using 2D Images"

47 / 97 papers shown

Title
SPAD : Spatially Aware Multiview Diffusers Yash Kant Ziyi Wu Michael Vasilkovsky Guocheng Qian Jian Ren R. A. Guler Bernard Ghanem Sergey Tulyakov Igor Gilitschenski Aliaksandr Siarohin DiffM 22 34 0 07 Feb 2024
Denoising Diffusion via Image-Based Rendering Titas Anciukevicius Fabian Manhardt Federico Tombari Paul Henderson 40 11 0 05 Feb 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 23 15 0 31 Jan 2024
TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion Yu-Ying Yeh Jia-Bin Huang Changil Kim Lei Xiao Thu Nguyen-Phuoc ... Cheng Zhang Manmohan Chandraker Carl S. Marshall Zhao Dong Zhengqin Li DiffM 14 30 0 17 Jan 2024
AGG: Amortized Generative 3D Gaussians for Single Image to 3D Dejia Xu Ye Yuan Morteza Mardani Sifei Liu Jiaming Song Zhangyang Wang Arash Vahdat 3DGS 27 44 0 08 Jan 2024
What You See is What You GAN: Rendering Every Pixel for High-Fidelity Geometry in 3D GANs Alex Trevithick Matthew Chan Towaki Takikawa Umar Iqbal Shalini De Mello Manmohan Chandraker Ravi Ramamoorthi Koki Nagano 3DV 41 6 0 04 Jan 2024
iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views Chin-Hsuan Wu Yen-Chun Chen Bolivar Solarte Lu Yuan Min Sun 8 9 0 28 Dec 2023
VolumeDiffusion: Flexible Text-to-3D Generation with Efficient Volumetric Encoder Zhicong Tang Shuyang Gu Chunyu Wang Ting Zhang Jianmin Bao Dongdong Chen Baining Guo DiffM 19 12 0 18 Dec 2023
Text2Immersion: Generative Immersive Scene with 3D Gaussians Ouyang Hao Kathryn Heal Stephen Lombardi Tiancheng Sun 3DGS 20 16 0 14 Dec 2023
Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers Zi-Xin Zou Zhipeng Yu Yuanchen Guo Yangguang Li Ding Liang Yan-Pei Cao Song-Hai Zhang 3DGS 23 168 0 14 Dec 2023
PI3D: Efficient Text-to-3D Generation with Pseudo-Image Diffusion Ying-Tian Liu Yuanchen Guo Guan Luo Heyi Sun Wei Yin Song-Hai Zhang 16 18 0 14 Dec 2023
GOEmbed: Gradient Origin Embeddings for Representation Agnostic 3D Feature Learning Animesh Karnewar Roman Shapovalov Tom Monnier Andrea Vedaldi Niloy J. Mitra David Novotny 42 0 0 14 Dec 2023
NViST: In the Wild New View Synthesis from a Single Image with Transformers Wonbong Jang Lourdes Agapito ViT 17 9 0 13 Dec 2023
NVS-Adapter: Plug-and-Play Novel View Synthesis from a Single Image Yoonwoo Jeong Jinwoo Lee Chiheon Kim Minsu Cho Doyup Lee 17 3 0 12 Dec 2023
Disentangled Clothed Avatar Generation from Text Descriptions Jiong-Qi Wang Yuan Liu Zhiyang Dou Zhengming Yu Yongqing Liang Xin Li Wenping Wang Rong Xie Li-Na Song 17 21 0 08 Dec 2023
Free3D: Consistent Novel View Synthesis without 3D Representation Chuanxia Zheng Andrea Vedaldi 3DV 35 48 0 07 Dec 2023
Multi-View Unsupervised Image Generation with Cross Attention Guidance L. Cerkezi A. Davtyan Sepehr Sameni Paolo Favaro DiffM 20 0 0 07 Dec 2023
ReconFusion: 3D Reconstruction with Diffusion Priors Rundi Wu B. Mildenhall Philipp Henzler Keunhong Park Ruiqi Gao ... Pratul P. Srinivasan Dor Verbin Jonathan T. Barron Ben Poole Aleksander Holynski 76 168 0 05 Dec 2023
ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation Peng Wang Yichun Shi 11 165 0 02 Dec 2023
FSGS: Real-Time Few-shot View Synthesis using Gaussian Splatting Zehao Zhu Zhiwen Fan Yifan Jiang Zhangyang Wang 3DGS 12 143 0 01 Dec 2023
GeoDream: Disentangling 2D and Geometric Priors for High-Fidelity and Consistent 3D Generation Baorui Ma Haoge Deng Junsheng Zhou Yu-Shen Liu Tiejun Huang Xinlong Wang DiffM 19 28 0 29 Nov 2023
DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model Yinghao Xu Hao Tan Fujun Luan Sai Bi Peng Wang ... Zifan Shi Kalyan Sunkavalli Gordon Wetzstein Zexiang Xu Kai Zhang 19 153 0 15 Nov 2023
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion Minghua Liu Ruoxi Shi Linghao Chen Zhuoyang Zhang Chao Xu Xinyue Wei Hansheng Chen Chong Zeng Jiayuan Gu Hao Su 20 186 0 14 Nov 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 13 101 0 11 Oct 2023
LLMR: Real-time Prompting of Interactive Worlds using Large Language Models Fernanda De La Torre Cathy Mengying Fang Han Huang Andrzej Banburski-Fahey Judith Amores Fernandez Jaron Lanier 19 45 0 21 Sep 2023
Light Field Diffusion for Single-View Novel View Synthesis Yifeng Xiong Haoyu Ma Shanlin Sun Kun Han Hao Tang Xiaohui Xie DiffM 31 2 0 20 Sep 2023
$360$^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting$ 360 $^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting Nuri Ryu Minsu Gong Geon-Yeong Kim Joo-Haeng Lee Sunghyun Cho 3DGS 14 1 0 19 Sep 2023
Viewpoint Textual Inversion: Unleashing Novel View Synthesis with Pretrained 2D Diffusion Models James Burgess Kuan-Chieh Wang Serena Yeung-Levy DiffM 14 6 0 14 Sep 2023
SyncDreamer: Generating Multiview-consistent Images from a Single-view Image Yuan-Bin Liu Chu-Hsing Lin Zijiao Zeng Xiaoxiao Long Lingjie Liu Taku Komura Wenping Wang DiffM 34 232 0 07 Sep 2023
MVDream: Multi-view Diffusion for 3D Generation Yichun Shi Peng Wang Jianglong Ye Mai Long Kejie Li X. Yang 12 587 0 31 Aug 2023
HoloFusion: Towards Photo-realistic 3D Generative Modeling Animesh Karnewar Niloy J. Mitra Andrea Vedaldi David Novotny DiffM 17 31 0 28 Aug 2023
FreeDrag: Feature Dragging for Reliable Point-based Image Editing Pengyang Ling Lin Chen Pan Zhang H. Chen Yi Jin Jinjin Zheng DiffM 11 13 0 10 Jul 2023
Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision A. Tewari Tianwei Yin George Cazenavette Semon Rezchikov J. Tenenbaum F. Durand William T. Freeman Vincent Sitzmann DiffM 27 88 0 20 Jun 2023
Edit-DiffNeRF: Editing 3D Neural Radiance Fields using 2D Diffusion Model Lu Yu Weikang Xiang Kang Han DiffM 10 15 0 15 Jun 2023
Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data Stanislaw Szymanowicz Christian Rupprecht Andrea Vedaldi 17 99 0 13 Jun 2023
Towards Visual Foundational Models of Physical Scenes Chethan Parameshwara Alessandro Achille Matthew Trager Xiaolong Li Jiawei Mo ... A. Swaminathan C. Taylor D. Venkatraman Xiaohan Fei Stefano Soatto DiffM 17 4 0 06 Jun 2023
Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shape Rundi Wu Ruoshi Liu Carl Vondrick Changxi Zheng DiffM 22 24 0 24 May 2023
Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction Xinhang Liu Jiaben Chen Shiu-hong Kao Yu-Wing Tai Chi-Keung Tang DiffM 10 16 0 24 May 2023
Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond Mohammadreza Armandpour A. Sadeghian Huangjie Zheng Amir Sadeghian Mingyuan Zhou DiffM 8 123 0 11 Apr 2023
3D-aware Image Generation using 2D Diffusion Models Jianfeng Xiang Jiaolong Yang Binbin Huang Xin Tong DiffM 24 65 0 31 Mar 2023
A Survey on Deep Generative 3D-aware Image Synthesis Weihao Xia Jing-Hao Xue 3DV 8 20 0 25 Oct 2022
Neural Wavelet-domain Diffusion for 3D Shape Generation Ka-Hei Hui Ruihui Li Jingyu Hu Chi-Wing Fu DiffM 50 123 0 19 Sep 2022
ReLU Fields: The Little Non-linearity That Could Animesh Karnewar Tobias Ritschel Oliver Wang Niloy J. Mitra 126 100 0 22 May 2022
BANMo: Building Animatable 3D Neural Models from Many Casual Videos Gengshan Yang Minh Vo Natalia Neverova Deva Ramanan Andrea Vedaldi Hanbyul Joo 3DH 116 183 0 23 Dec 2021
Palette: Image-to-Image Diffusion Models Chitwan Saharia William Chan Huiwen Chang Chris A. Lee Jonathan Ho Tim Salimans David J. Fleet Mohammad Norouzi DiffM VLM 320 1,570 0 10 Nov 2021
Diffusion Probabilistic Models for 3D Point Cloud Generation Shitong Luo Wei Hu 3DPC 164 711 0 02 Mar 2021
Image-to-Image Translation with Conditional Adversarial Networks Phillip Isola Jun-Yan Zhu Tinghui Zhou Alexei A. Efros SSeg 203 19,191 0 21 Nov 2016