Novel View Synthesis with Diffusion Models

6 October 2022

Daniel Watson

William Chan

Ricardo Martín Brualla

Papers citing "Novel View Synthesis with Diffusion Models"

50 / 229 papers shown

Title
Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Models Jianglong Ye Peng Wang Kejie Li Yichun Shi Heng Wang DiffM 27 72 0 04 Oct 2023
Efficient-3DiM: Learning a Generalizable Single-image Novel-view Synthesizer in One Day Yifan Jiang Hao Tang Jen-Hao Rick Chang Liangchen Song Zhangyang Wang Liangliang Cao DiffM 23 10 0 04 Oct 2023
SweetDreamer: Aligning Geometric Priors in 2D Diffusion for Consistent Text-to-3D Weiyu Li Rui Chen Xuelin Chen Ping Tan 18 115 0 04 Oct 2023
Dream the Impossible: Outlier Imagination with Diffusion Models Xuefeng Du Yiyou Sun Xiaojin Zhu Yixuan Li 18 52 0 23 Sep 2023
Light Field Diffusion for Single-View Novel View Synthesis Yifeng Xiong Haoyu Ma Shanlin Sun Kun Han Hao Tang Xiaohui Xie DiffM 36 2 0 20 Sep 2023
ReShader: View-Dependent Highlights for Single Image View-Synthesis Avinash Paliwal Brandon Nguyen Andrii Tsarov N. Kalantari 21 3 0 19 Sep 2023
$360$^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting$ 360 $^\circ$ Reconstruction From a Single Image Using Space Carved Outpainting Nuri Ryu Minsu Gong Geon-Yeong Kim Joo-Haeng Lee Sunghyun Cho 3DGS 22 1 0 19 Sep 2023
Breathing New Life into 3D Assets with Generative Repainting Tianfu Wang Menelaos Kanakis Konrad Schindler Luc Van Gool Anton Obukhov AI4CE 19 13 0 15 Sep 2023
Viewpoint Textual Inversion: Unleashing Novel View Synthesis with Pretrained 2D Diffusion Models James Burgess Kuan-Chieh Wang Serena Yeung-Levy DiffM 22 6 0 14 Sep 2023
Generative Image Dynamics Zhengqi Li Richard Tucker Noah Snavely Aleksander Holynski DiffM 29 63 0 14 Sep 2023
Diffusion-Guided Reconstruction of Everyday Hand-Object Interaction Clips Yufei Ye Poorvi Hebbar Abhinav Gupta Shubham Tulsiani DiffM 26 42 0 11 Sep 2023
SimNP: Learning Self-Similarity Priors Between Neural Points Christopher Wewer Eddy Ilg Bernt Schiele J. E. Lenssen 3DPC 22 10 0 07 Sep 2023
SyncDreamer: Generating Multiview-consistent Images from a Single-view Image Yuan-Bin Liu Chu-Hsing Lin Zijiao Zeng Xiaoxiao Long Lingjie Liu Taku Komura Wenping Wang DiffM 45 416 0 07 Sep 2023
SMPLitex: A Generative Model and Dataset for 3D Human Texture Estimation from Single Image Dan Casas M. C. Trinidad 3DH 3DGS 14 20 0 04 Sep 2023
VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation Xin Li Wenqing Chu Ye Wu Weihang Yuan Fanglong Liu Qi Zhang Fu Li Haocheng Feng Errui Ding Jingdong Wang VGen 35 51 0 01 Sep 2023
MVDream: Multi-view Diffusion for 3D Generation Yichun Shi Peng Wang Jianglong Ye Mai Long Kejie Li X. Yang 20 588 0 31 Aug 2023
HoloFusion: Towards Photo-realistic 3D Generative Modeling Animesh Karnewar Niloy J. Mitra Andrea Vedaldi David Novotny DiffM 26 31 0 28 Aug 2023
TADA! Text to Animatable Digital Avatars Tingting Liao Hongwei Yi Yuliang Xiu Jiaxaing Tang Yangyi Huang Justus Thies Michael J. Black 66 94 0 21 Aug 2023
HumanLiff: Layer-wise 3D Human Generation with Diffusion Model Shou-Yong Hu Fangzhou Hong Tao Hu Liang Pan Haiyi Mei Weiye Xiao Lei Yang Ziwei Liu 23 19 0 18 Aug 2023
TeCH: Text-guided Reconstruction of Lifelike Clothed Humans Yangyi Huang Hongwei Yi Yuliang Xiu Tingting Liao Jiaxiang Tang Deng Cai Justus Thies DiffM 44 81 0 16 Aug 2023
CLE Diffusion: Controllable Light Enhancement Diffusion Model Yuyang Yin Dejia Xu Chuangchuang Tan P. Liu Yao-Min Zhao Yunchao Wei DiffM 32 40 0 13 Aug 2023
RGB-D-Fusion: Image Conditioned Depth Diffusion of Humanoid Subjects Sascha Kirch Valeria Olyunina Jan Ondřej Rafael Pagés Sergio Martín Clara Pérez-Molina 9 2 0 29 Jul 2023
Car-Studio: Learning Car Radiance Fields from Single-View and Endless In-the-wild Images Tianyu Liu Hao Zhao Yang Yu Guyue Zhou Ming-Yu Liu 29 3 0 26 Jul 2023
Reference-based Painterly Inpainting via Diffusion: Crossing the Wild Reference Domain Gap Dejia Xu Xingqian Xu Wenyan Cong Humphrey Shi Zhangyang Wang DiffM 27 4 0 20 Jul 2023
Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animation Tserendorj Adiya Jae Shin Yoon Jungeun Lee Sang-hyeon Kim Hwasup Lim DiffM 15 0 0 02 Jul 2023
Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors Guocheng Qian Jinjie Mai Abdullah Hamdi Jian Ren Aliaksandr Siarohin ... Hsin-Ying Lee Ivan Skorokhodov Peter Wonka Sergey Tulyakov Bernard Ghanem DiffM 36 355 0 30 Jun 2023
Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision A. Tewari Tianwei Yin George Cazenavette Semon Rezchikov J. Tenenbaum F. Durand William T. Freeman Vincent Sitzmann DiffM 36 88 0 20 Jun 2023
TryOnDiffusion: A Tale of Two UNets Luyang Zhu Dawei Yang Tyler Lixuan Zhu F. Reda William Chan Chitwan Saharia Mohammad Norouzi Ira Kemelmacher-Shlizerman DiffM 23 103 0 14 Jun 2023
DORSal: Diffusion for Object-centric Representations of Scenes et al Allan Jabri Sjoerd van Steenkiste Emiel Hoogeboom Mehdi S. M. Sajjadi Thomas Kipf 19 17 0 13 Jun 2023
Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data Stanislaw Szymanowicz Christian Rupprecht Andrea Vedaldi 28 99 0 13 Jun 2023
DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Views Paul D. Yoo Jiaxian Guo Yutaka Matsuo S. Gu 8 24 0 06 Jun 2023
Guided Motion Diffusion for Controllable Human Motion Synthesis Korrawe Karunratanakul Konpat Preechakul Supasorn Suwajanakorn Siyu Tang DiffM 24 122 0 21 May 2023
Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models Byungjun Kim Patrick Kwon K. Lee Myunggi Lee Sookwan Han Daesik Kim Hanbyul Joo DiffM 29 20 0 19 May 2023
Shap-E: Generating Conditional 3D Implicit Functions Heewoo Jun Alex Nichol DiffM 192 309 0 03 May 2023
Ray Conditioning: Trading Photo-consistency for Photo-realism in Multi-view Image Generation Eric Chen Sidhanth Holalkere Ruyu Yan Kai Zhang Abe Davis 14 5 0 26 Apr 2023
Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models Jason J. Yu Fereshteh Forghani Konstantinos G. Derpanis Marcus A. Brubaker DiffM 19 45 0 21 Apr 2023
Expressive Text-to-Image Generation with Rich Text Songwei Ge Taesung Park Jun-Yan Zhu Jia-Bin Huang DiffM 77 79 0 13 Apr 2023
Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstruction Hansheng Chen Jiatao Gu Anpei Chen Wei Tian Z. Tu Lingjie Liu Haoran Su VGen DiffM 34 146 0 13 Apr 2023
Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Images Jiatao Gu Qingzhe Gao Shuangfei Zhai Baoquan Chen Lingjie Liu J. Susskind 28 29 0 13 Apr 2023
DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion J. Karras Aleksander Holynski Ting-Chun Wang Ira Kemelmacher-Shlizerman DiffM VGen 16 136 0 12 Apr 2023
Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond Mohammadreza Armandpour A. Sadeghian Huangjie Zheng Amir Sadeghian Mingyuan Zhou DiffM 13 123 0 11 Apr 2023
Generative Novel View Synthesis with 3D-Aware Diffusion Models E. R. Chan Koki Nagano Matthew A. Chan Alexander W. Bergman Jeong Joon Park A. Levy M. Aittala Shalini De Mello Tero Karras Gordon Wetzstein DiffM 19 233 0 05 Apr 2023
3D-aware Image Generation using 2D Diffusion Models Jianfeng Xiang Jiaolong Yang Binbin Huang Xin Tong DiffM 30 65 0 31 Mar 2023
Consistent View Synthesis with Pose-Guided Diffusion Models Hung-Yu Tseng Qinbo Li Changil Kim Suhib Alsisan Jia-Bin Huang Johannes Kopf DiffM 22 101 0 30 Mar 2023
HoloDiffusion: Training a 3D Diffusion Model using 2D Images Animesh Karnewar Andrea Vedaldi David Novotny Niloy Mitra 25 109 0 29 Mar 2023
Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior Junshu Tang Tengfei Wang Bo Zhang Ting Zhang Ran Yi Lizhuang Ma Dong Chen DiffM 187 307 0 24 Mar 2023
TEGLO: High Fidelity Canonical Texture Mapping from Single-View Images Vishal Vinod Tanmay Shah Dmitry Lagun 24 4 0 24 Mar 2023
NOPE: Novel Object Pose Estimation from a Single Image Van Nguyen Nguyen Thibault Groueix Yinlin Hu Mathieu Salzmann Vincent Lepetit 29 25 0 23 Mar 2023
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models Lukas Höllein Ang Cao Andrew Owens Justin Johnson Matthias Nießner DiffM 25 177 0 21 Mar 2023
Few-shot Neural Radiance Fields Under Unconstrained Illumination Seok-Kun Lee Jun-woo Choi Seungryong Kim Ig-Jae Kim Junghyun Cho 21 7 0 21 Mar 2023