Novel View Synthesis with Diffusion Models

6 October 2022

Daniel Watson

William Chan

Ricardo Martín Brualla

Papers citing "Novel View Synthesis with Diffusion Models"

50 / 229 papers shown

Title
ACT-R: Adaptive Camera Trajectories for 3D Reconstruction from Single Image Y. Wang Mingrui Zhao Ali Mahdavi Amiri Hao Zhang 11 0 0 13 May 2025
Regression is all you need for medical image translation Sebastian Rassmann David Kügler Christian Ewert Martin Reuter DiffM MedIm 94 0 0 04 May 2025
Eval3D: Interpretable and Fine-grained Evaluation for 3D Generation Shivam Duggal Yushi Hu Oscar Michel Aniruddha Kembhavi William T. Freeman Noah A. Smith Ranjay Krishna Antonio Torralba Ali Farhadi Wei-Chiu Ma EGVM ELM 70 0 0 25 Apr 2025
ZeroGrasp: Zero-Shot Shape Reconstruction Enabled Robotic Grasping Shun Iwase Zubair Irshad Katherine Liu Vitor Campagnolo Guizilini Robert Lee ... Ayako Amma Koichi Nishiwaki Kris M. Kitani Rares Ambrus Sergey Zakharov 29 0 0 15 Apr 2025
Geometric Consistency Refinement for Single Image Novel View Synthesis via Test-Time Adaptation of Diffusion Models Josef Bengtson David Nilsson Fredrik Kahl DiffM 37 0 0 11 Apr 2025
Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction Zeren Jiang Chuanxia Zheng Iro Laina Diane Larlus Andrea Vedaldi VGen 41 0 0 10 Apr 2025
DSO: Aligning 3D Generators with Simulation Feedback for Physical Soundness Ruining Li Chuanxia Zheng Christian Rupprecht Andrea Vedaldi 37 1 0 28 Mar 2025
GenFusion: Closing the Loop between Reconstruction and Generation via Videos Sibo Wu Congrong Xu Binbin Huang Andreas Geiger Anpei Chen VGen 93 0 0 27 Mar 2025
EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolation Zihao Zhang Haoran Chen Haoyu Zhao Guansong Lu Yanwei Fu Hang Xu Zuxuan Wu VGen DiffM 62 0 0 20 Mar 2025
Learn Your Scales: Towards Scale-Consistent Generative Novel View Synthesis Fereshteh Forghani Jason J. Yu Tristan Aumentado-Armstrong Konstantinos G. Derpanis Marcus A. Brubaker DiffM 43 0 0 19 Mar 2025
SIR-DIFF: Sparse Image Sets Restoration with Multi-View Diffusion Model Yucheng Mao Boyang Wang Nilesh Kulkarni Jeong Joon Park DiffM 58 0 0 18 Mar 2025
Bolt3D: Generating 3D Scenes in Seconds Stanislaw Szymanowicz Jason Y. Zhang P. Srinivasan Ruiqi Gao Arthur Brussee Aleksander Holynski Ricardo Martín Brualla Jonathan T. Barron Philipp Henzler 96 4 0 18 Mar 2025
Next-Scale Autoregressive Models are Zero-Shot Single-Image Object View Synthesizers Shiran Yuan Hao Zhao DiffM 47 0 0 17 Mar 2025
Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors Katja Schwarz Norman Mueller Peter Kontschieder 3DGS 93 2 0 17 Mar 2025
GarmentCrafter: Progressive Novel View Synthesis for Single-View 3D Garment Reconstruction and Editing Yuanhao Wang Cheng Zhang Gonçalo Frazão Jinlong Yang Alexandru-Eugen Ichim Thabo Beeler Fernando De la Torre DiffM 80 0 0 11 Mar 2025
Conditional Electrocardiogram Generation Using Hierarchical Variational Autoencoders Ivan Sviridov Konstantin Egorov DRL SyDa 50 0 0 03 Mar 2025
GenVDM: Generating Vector Displacement Maps From a Single Image Yuezhi Yang Qimin Chen Vladimir G. Kim S. Chaudhuri Qixing Huang Z. Chen 3DGS VGen 29 1 0 01 Mar 2025
Synthesizing Consistent Novel Views via 3D Epipolar Attention without Re-Training Botao Ye Sifei Liu Xueting Li Marc Pollefeys Ming Yang 64 0 0 25 Feb 2025
3D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation Hansheng Chen Bokui Shen Yulin Liu Ruoxi Shi Linqi Zhou Connor Z. Lin Jiayuan Gu H. Su Gordon Wetzstein Leonidas J. Guibas 94 1 0 21 Feb 2025
Learning a Diffusion Model Policy from Rewards via Q-Score Matching Michael Psenka Alejandro Escontrela Pieter Abbeel Yi-An Ma DiffM 89 22 0 17 Feb 2025
History-Guided Video Diffusion Kiwhan Song Boyuan Chen Max Simchowitz Yilun Du Russ Tedrake Vincent Sitzmann VGen 109 7 0 10 Feb 2025
MEt3R: Measuring Multi-View Consistency in Generated Images Mohammad Asim Christopher Wewer Thomas Wimmer Bernt Schiele J. E. Lenssen EGVM 3DGS VGen 46 7 0 10 Jan 2025
Pointmap-Conditioned Diffusion for Consistent Novel View Synthesis Thang-Anh-Quan Nguyen Nathan Piasco Luis Roldão Moussâb Bennehar D. Tsishkou Laurent Caraffa J. Tarel R. Brémond DiffM 42 1 0 06 Jan 2025
Real-Time Position-Aware View Synthesis from Single-View Input Manu Gond Emin Zerman S. Knorr Mårten Sjöström 84 0 0 18 Dec 2024
CAP4D: Creating Animatable 4D Portrait Avatars with Morphable Multi-View Diffusion Models Felix Taubner Ruihang Zhang Mathieu Tuli David B. Lindell 68 2 0 16 Dec 2024
MOVIS: Enhancing Multi-Object Novel View Synthesis for Indoor Scenes Ruijie Lu Yixin Chen Junfeng Ni Baoxiong Jia Yu Liu Diwen Wan Gang Zeng Siyuan Huang DiffM 127 4 0 16 Dec 2024
You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale Baorui Ma Huachen Gao Haoge Deng Zhengxiong Luo Tiejun Huang Lulu Tang Xinlong Wang DiffM VGen 114 14 0 09 Dec 2024
MV-Adapter: Multi-view Consistent Image Generation Made Easy Zehuan Huang Y. Guo Haoran Wang Ran Yi Lizhuang Ma Yan-Pei Cao Lu Sheng 107 8 0 04 Dec 2024
Generalizable Single-view Object Pose Estimation by Two-side Generating and Matching Yujing Sun Caiyi Sun Yuan-Bin Liu Yuexin Ma S. Yiu 73 1 0 24 Nov 2024
Novel View Extrapolation with Video Diffusion Priors Kunhao Liu Ling Shao Shijian Lu VGen 75 3 0 21 Nov 2024
Generating 3D-Consistent Videos from Unposed Internet Photos Gene Chou Kai Zhang Sai Bi Hao Tan Zexiang Xu Fujun Luan Bharath Hariharan Noah Snavely 3DGS VGen 75 3 0 20 Nov 2024
Direct and Explicit 3D Generation from a Single Image Haoyu Wu Meher Gitika Karumuri Chuhang Zou Seungbae Bang Yuelong Li Dimitris Samaras Sunil Hadap 3DGS MDE 3DV 32 0 0 17 Nov 2024
L3DG: Latent 3D Gaussian Diffusion Barbara Roessle Norman Muller Lorenzo Porzi Samuel Rota Buló Peter Kontschieder Angela Dai Matthias Nießner 3DGS 27 12 0 17 Oct 2024
DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Model Jingxiang Sun Cheng Peng Ruizhi Shao Y. Guo Xiaochen Zhao Yangguang Li Yanpei Cao Bo Zhang Yebin Liu 36 2 0 16 Oct 2024
Simultaneous Diffusion Sampling for Conditional LiDAR Generation Ryan Faulkner Luke Haub Simon Ratcliffe Anh-Dzung Doan Ian Reid Tat-Jun Chin 21 0 0 15 Oct 2024
Enhancing JEPAs with Spatial Conditioning: Robust and Efficient Representation Learning Etai Littwin Vimal Thilak Anand Gopalakrishnan 37 0 0 14 Oct 2024
Diffusion Models in 3D Vision: A Survey Zhen Wang Dongyuan Li Renhe Jiang Tianyu He Jiang Bian Renhe Jiang MedIm 58 4 0 07 Oct 2024
DeBaRA: Denoising-Based 3D Room Arrangement Generation Léopold Maillard Nicolas Sereyjol-Garros Tom Durand Maks Ovsjanikov DiffM 3DV 31 2 0 26 Sep 2024
Single Image, Any Face: Generalisable 3D Face Generation Wenqing Wang Haosen Yang Josef Kittler Xiatian Zhu 3DH 71 0 0 25 Sep 2024
Single-View 3D Reconstruction via SO(2)-Equivariant Gaussian Sculpting Networks Ruihan Xu Anthony Opipari J. Mah Stanley Lewis Haoran Zhang Hanzhe Guo Odest Chadwicke Jenkins 3DGS 29 0 0 11 Sep 2024
Rethinking The Training And Evaluation of Rich-Context Layout-to-Image Generation Jiaxin Cheng Zixu Zhao Tong He Tianjun Xiao Yicong Zhou Zheng Zhang DiffM 37 0 0 07 Sep 2024
ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis Wangbo Yu Jinbo Xing Li Yuan Wenbo Hu Xiaoyu Li Zhipeng Huang Xiangjun Gao T. Wong Ying Shan Yonghong Tian VGen DiffM 42 78 0 03 Sep 2024
Atlas Gaussians Diffusion for 3D Generation Haitao Yang Yuan Dong Hanwen Jiang Dejia Xu Georgios Pavlakos Qixing Huang 3DGS 67 3 0 23 Aug 2024
Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamics Ruining Li Chuanxia Zheng Christian Rupprecht Andrea Vedaldi DiffM VGen 36 9 0 08 Aug 2024
Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusion Boyang Deng Richard Tucker Zhengqi Li Leonidas J. Guibas Noah Snavely Gordon Wetzstein VGen 3DGS DiffM 32 11 0 18 Jul 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 80 42 0 17 Jul 2024
IDOL: Unified Dual-Modal Latent Diffusion for Human-Centric Joint Video-Depth Generation Yuanhao Zhai K. Lin Linjie Li Chung-Ching Lin Jianfeng Wang Zhengyuan Yang David Doermann Junsong Yuan Zicheng Liu Lijuan Wang DiffM VGen 21 3 0 15 Jul 2024
Controlling Space and Time with Diffusion Models Daniel Watson Saurabh Saxena Lala Li Andrea Tagliasacchi David J. Fleet VGen 59 27 0 10 Jul 2024
Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Images Zhangyang Qi Yunhan Yang Mengchen Zhang Long Xing Xiaoyang Wu Tong Wu Dahua Lin Xihui Liu Jiaqi Wang Hengshuang Zhao DiffM 36 7 0 08 Jul 2024
GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction Yuxuan Mu X. Zuo Chuan Guo Yilin Wang Juwei Lu Xiaofeng Wu Songcen Xu Peng Dai Youliang Yan Li Cheng 3DGS 34 5 0 05 Jul 2024