Novel View Synthesis with Diffusion Models

6 October 2022

Daniel Watson

William Chan

Ricardo Martín Brualla

Papers citing "Novel View Synthesis with Diffusion Models"

50 / 229 papers shown

Title
HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3D Sangmin Woo Byeongjun Park Hyojun Go Jin-Young Kim Changick Kim 38 23 0 26 Dec 2023
SyncDreamer for 3D Reconstruction of Endangered Animal Species with NeRF and NeuS A. H. Ornek Deniz Sen Esmanur Civil 28 2 0 21 Dec 2023
ZeroShape: Regression-based Zero-shot Shape Reconstruction Zixuan Huang Stefan Stojanov Anh Thai Varun Jampani James M. Rehg 3DV 17 22 0 21 Dec 2023
Splatter Image: Ultra-Fast Single-View 3D Reconstruction Stanislaw Szymanowicz Christian Rupprecht Andrea Vedaldi 3DGS 40 176 0 20 Dec 2023
Optimizing Diffusion Noise Can Serve As Universal Motion Priors Korrawe Karunratanakul Konpat Preechakul Emre Aksan Thabo Beeler Supasorn Suwajanakorn Siyu Tang DiffM 19 37 0 19 Dec 2023
Text-Image Conditioned Diffusion for Consistent Text-to-3D Generation Yuze He Yushi Bai M. Lin Jenny Sheng Yubin Hu Qi Wang Yu-Hui Wen Yong-Jin Liu 34 1 0 19 Dec 2023
SinMPI: Novel View Synthesis from a Single Image with Expanded Multiplane Images Guo Pu Peng-Shuai Wang Zhouhui Lian 18 7 0 18 Dec 2023
Exploring the Feasibility of Generating Realistic 3D Models of Endangered Species Using DreamGaussian: An Analysis of Elevation Angle's Impact on Model Generation Selcuk Anil Karatopak Deniz Sen 50 0 0 15 Dec 2023
Text2Immersion: Generative Immersive Scene with 3D Gaussians Ouyang Hao Kathryn Heal Stephen Lombardi Tiancheng Sun 3DGS 28 27 0 14 Dec 2023
VaLID: Variable-Length Input Diffusion for Novel View Synthesis Shijie Li F. G. Zanjani H. Yahia Yuki M. Asano Juergen Gall A. Habibian DiffM 11 5 0 14 Dec 2023
NViST: In the Wild New View Synthesis from a Single Image with Transformers Wonbong Jang Lourdes Agapito ViT 25 9 0 13 Dec 2023
Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Models Liangchen Song Liangliang Cao Jiatao Gu Yifan Jiang Junsong Yuan Hao Tang DiffM 21 13 0 13 Dec 2023
NVS-Adapter: Plug-and-Play Novel View Synthesis from a Single Image Yoonwoo Jeong Jinwoo Lee Chiheon Kim Minsu Cho Doyup Lee 19 3 0 12 Dec 2023
CAD: Photorealistic 3D Generation via Adversarial Distillation Ziyu Wan Despoina Paschalidou Ian Huang Hongyu Liu Bokui Shen Xiaoyu Xiang Jing Liao Leonidas J. Guibas DiffM 74 11 0 11 Dec 2023
EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion Zehuan Huang Hao Wen Junting Dong Yaohui Wang Yangguang Li ... Yan-Pei Cao Ding Liang Yu Qiao Bo Dai Lu Sheng 28 33 0 11 Dec 2023
Optimized View and Geometry Distillation from Multi-view Diffuser Youjia Zhang Zikai Song Junqing Yu Yawei Luo Wei Yang 21 0 0 11 Dec 2023
SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation Thuan Hoang Nguyen Anh Tran DiffM 18 55 0 08 Dec 2023
Disentangled Clothed Avatar Generation from Text Descriptions Jiong-Qi Wang Yuan Liu Zhiyang Dou Zhengming Yu Yongqing Liang Xin Li Wenping Wang Rong Xie Li-Na Song 23 22 0 08 Dec 2023
RL Dreams: Policy Gradient Optimization for Score Distillation based 3D Generation Aradhya Neeraj Mathur Phu-Cuong Pham Aniket Bera Ojaswa Sharma 28 0 0 08 Dec 2023
NeRFiller: Completing Scenes via Generative 3D Inpainting Ethan Weber Aleksander Holyñski Varun Jampani Saurabh Saxena Noah Snavely Abhishek Kar Angjoo Kanazawa 60 31 0 07 Dec 2023
Free3D: Consistent Novel View Synthesis without 3D Representation Chuanxia Zheng Andrea Vedaldi 3DV 37 48 0 07 Dec 2023
Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion Kira Prabhu Jane Wu Lynn Tsai Peter Hedman Dan B. Goldman Ben Poole Michael Broxton DiffM 26 7 0 06 Dec 2023
DreamComposer: Controllable 3D Object Generation via Multi-View Conditions Yu-nuo Yang Yukun Huang Xiaoyang Wu Yuanchen Guo Song-Hai Zhang Hengshuang Zhao Tong He Xihui Liu DiffM 34 12 0 06 Dec 2023
ReconFusion: 3D Reconstruction with Diffusion Priors Rundi Wu B. Mildenhall Philipp Henzler Keunhong Park Ruiqi Gao ... Pratul P. Srinivasan Dor Verbin Jonathan T. Barron Ben Poole Aleksander Holynski 79 171 0 05 Dec 2023
Slice3D: Multi-Slice, Occlusion-Revealing, Single View 3D Reconstruction Yizhi Wang Wallace P. Lira Wenqi Wang Ali Mahdavi-Amiri Hao Zhang 13 11 0 03 Dec 2023
ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models Jeong-gi Kwak Erqun Dong Yuhe Jin Hanseok Ko Shweta Mahajan Kwang Moo Yi DiffM VGen 72 38 0 03 Dec 2023
ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation Peng Wang Yichun Shi 16 165 0 02 Dec 2023
RefinedFields: Radiance Fields Refinement for Unconstrained Scenes Karim Kassab Antoine Schnepf Jean-Yves Franceschi Laurent Caraffa Jeremie Mary Valérie Gouet-Brunet VGen 23 7 0 01 Dec 2023
ElasticDiffusion: Training-free Arbitrary Size Image Generation through Global-Local Content Separation Moayed Haji-Ali Guha Balakrishnan Vicente Ordonez 38 24 0 30 Nov 2023
SODA: Bottleneck Diffusion Models for Representation Learning Drew A. Hudson Daniel Zoran Mateusz Malinowski Andrew Kyle Lampinen Andrew Jaegle James L. McClelland Loic Matthey Felix Hill Alexander Lerchner DiffM 20 47 0 29 Nov 2023
RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3D Lingteng Qiu Guanying Chen Xiaodong Gu Qi Zuo Mutian Xu Yushuang Wu Weihao Yuan Zilong Dong Liefeng Bo Xiaoguang Han 30 113 0 28 Nov 2023
Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets A. Blattmann Tim Dockhorn Sumith Kulal Daniel Mendelevitch Maciej Kilian ... Zion English Vikram S. Voleti Adam Letts Varun Jampani Robin Rombach VGen 150 1,012 0 25 Nov 2023
MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation Zhiqi Li Yiming Chen Lingzhe Zhao Peidong Liu 18 7 0 24 Nov 2023
WildFusion: Learning 3D-Aware Latent Diffusion Models in View Space Katja Schwarz Seung Wook Kim Jun Gao Sanja Fidler Andreas Geiger Karsten Kreis 24 6 0 22 Nov 2023
Improved DDIM Sampling with Moment Matching Gaussian Mixtures Prasad Gabbur DiffM 18 1 0 08 Nov 2023
3DiffTection: 3D Object Detection with Geometry-Aware Diffusion Features Chenfeng Xu Huan Ling Sanja Fidler Or Litany 8 14 0 07 Nov 2023
Consistent Video-to-Video Transfer Using Synthetic Dataset Jiaxin Cheng Tianjun Xiao Tong He VGen DiffM 31 14 0 01 Nov 2023
CustomNet: Zero-shot Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Models Ziyang Yuan Mingdeng Cao Xintao Wang Zhongang Qi Chun Yuan Ying Shan DiffM 22 23 0 30 Oct 2023
ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image Kyle Sargent Zizhang Li Tanmay Shah Charles Herrmann Hong-Xing Yu ... Eric Ryan Chan Dmitry Lagun Fei-Fei Li Deqing Sun Jiajun Wu DiffM VGen 29 40 0 27 Oct 2023
DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior Jingxiang Sun Bo Zhang Ruizhi Shao Lizhen Wang Wen Liu Zhenda Xie Yebin Liu 23 132 0 25 Oct 2023
iNVS: Repurposing Diffusion Inpainters for Novel View Synthesis Yash Kant Aliaksandr Siarohin Michael Vasilkovsky R. A. Guler Jian Ren Sergey Tulyakov Igor Gilitschenski DiffM 19 12 0 24 Oct 2023
Wonder3D: Single Image to 3D using Cross-Domain Diffusion Xiaoxiao Long Yuanchen Guo Cheng Lin Yuan-Bin Liu Zhiyang Dou ... Yuexin Ma Song-Hai Zhang Marc Habermann Christian Theobalt Wenping Wang 38 405 0 23 Oct 2023
Closed-Form Diffusion Models Christopher Scarvelis Haitz Sáez de Ocáriz Borde Justin Solomon DiffM 90 9 0 19 Oct 2023
TOSS:High-quality Text-guided Novel View Synthesis from a Single Image Yukai Shi Jianan Wang He Cao Boshi Tang Xianbiao Qi Tianyu Yang Yukun Huang Shilong Liu Lei Zhang H. Shum DiffM 14 20 0 16 Oct 2023
GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers Takeru Miyato Bernhard Jaeger Max Welling Andreas Geiger ViT 30 14 0 16 Oct 2023
Pseudo-Generalized Dynamic View Synthesis from a Video Xiaoming Zhao Alex Colburn Fangchang Ma Miguel Angel Bautista J. Susskind A. Schwing 37 11 0 12 Oct 2023
Consistent123: Improve Consistency for One Image to 3D Object Synthesis Haohan Weng Tianyu Yang Jianan Wang Yu Li Tong Zhang C. L. P. Chen Lei Zhang DiffM 19 72 0 12 Oct 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 22 101 0 11 Oct 2023
HiFi-123: Towards High-fidelity One Image to 3D Content Generation Wangbo Yu Li-ming Yuan Yan-Pei Cao Xiangjun Gao Xiaoyu Li Wenbo Hu Long Quan Ying Shan Yonghong Tian DiffM 26 29 0 10 Oct 2023
Locality-Aware Generalizable Implicit Neural Representation Doyup Lee Chiheon Kim Minsu Cho Wook-Shin Han 30 12 0 09 Oct 2023