Novel View Synthesis with Diffusion Models

6 October 2022

Daniel Watson

William Chan

Ricardo Martín Brualla

Papers citing "Novel View Synthesis with Diffusion Models"

50 / 229 papers shown

Title
GVDIFF: Grounded Text-to-Video Generation with Diffusion Models Huanzhang Dou Ruixiang Li Wei Su Xi Li DiffM 34 1 0 02 Jul 2024
MultiDiff: Consistent Novel View Synthesis from a Single Image Norman Muller Katja Schwarz Barbara Roessle Lorenzo Porzi Samuel Rota Buló Matthias Nießner Peter Kontschieder DiffM 34 22 0 26 Jun 2024
Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models Paul Henderson Melonie de Almeida D. Ivanova Titas Anciukevicius 3DGS 43 4 0 18 Jun 2024
Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Models Ziyi Wu Yulia Rubanova Rishabh Kabra Drew A. Hudson Igor Gilitschenski Yusuf Aytar Sjoerd van Steenkiste Kelsey R. Allen Thomas Kipf VGen DiffM 36 10 0 13 Jun 2024
ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Models Meng-Li Shih Wei-Chiu Ma Aleksander Holyñski Forrester Cole Brian L. Curless Janne Kontkanen 24 3 0 10 Jun 2024
Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Image Stanislaw Szymanowicz Eldar Insafutdinov Chuanxia Zheng Dylan Campbell João F. Henriques Christian Rupprecht Andrea Vedaldi 3DGS 24 49 0 06 Jun 2024
A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation Ruihe Wang Yukang Cao Kai Han Kwan-Yee K. Wong 44 5 0 06 Jun 2024
Learning to Approximate Particle Smoothing Trajectories via Diffusion Generative Models Ella Tamir Arno Solin DiffM 31 0 0 01 Jun 2024
Zero-to-Hero: Enhancing Zero-Shot Novel View Synthesis via Attention Map Filtering Ido Sobol Chenfeng Xu Or Litany DiffM 27 1 0 29 May 2024
GenWarp: Single Image to Novel Views with Semantic-Preserving Generative Warping Junyoung Seo Kazumi Fukuda Takashi Shibuya Takuya Narihira Naoki Murata Shoukang Hu Chieh-Hsin Lai Seungryong Kim Yuki Mitsufuji 47 12 0 27 May 2024
NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer Meng You Zhiyu Zhu Hui Liu Junhui Hou VGen DiffM 23 23 0 24 May 2024
CAT3D: Create Anything in 3D with Multi-View Diffusion Models Ruiqi Gao Aleksander Holynski Philipp Henzler Arthur Brussee Ricardo Martín Brualla Pratul P. Srinivasan Jonathan T. Barron Ben Poole 29 149 0 16 May 2024
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion Jaidev Shriram Alex Trevithick Lingjie Liu Ravi Ramamoorthi DiffM 3DGS 71 55 0 10 Apr 2024
The More You See in 2D, the More You Perceive in 3D Xinyang Han Zelin Gao Angjoo Kanazawa Shubham Goel Yossi Gandelsman DiffM 43 3 0 04 Apr 2024
MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space Armand Comas Massague Di Qiu Menglei Chai Marcel C. Bühler Amit Raj ... Mark Matthews Paulo F. U. Gotardo Octavia Camps Sergio Orts Thabo Beeler 37 1 0 01 Apr 2024
Video Interpolation with Diffusion Models Siddhant Jain Daniel Watson Eric Tabellion Aleksander Holyñski Ben Poole Janne Kontkanen SupR VGen DiffM 30 32 0 01 Apr 2024
Enhance Image Classification via Inter-Class Image Mixup with Diffusion Model Zhicai Wang Longhui Wei Tan Wang Heyu Chen Yanbin Hao Xiang Wang Xiangnan He Qi Tian VLM DiffM 27 16 0 28 Mar 2024
CVT-xRF: Contrastive In-Voxel Transformer for 3D Consistent Radiance Fields from Sparse Inputs Yingji Zhong Lanqing Hong Zhenguo Li Dan Xu 24 9 0 25 Mar 2024
latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction Christopher Wewer Kevin Raj Eddy Ilg Bernt Schiele J. E. Lenssen 3DGS 56 59 0 24 Mar 2024
DragAPart: Learning a Part-Level Motion Prior for Articulated Objects Ruining Li Chuanxia Zheng Christian Rupprecht Andrea Vedaldi DiffM 32 18 0 22 Mar 2024
Generic 3D Diffusion Adapter Using Controlled Multi-View Editing Hansheng Chen Ruoxi Shi Yulin Liu Bokui Shen Jiayuan Gu Gordon Wetzstein Hao Su Leonidas J. Guibas DiffM 50 19 0 18 Mar 2024
VideoMV: Consistent Multi-View Generation Based on Large Video Generative Model Qi Zuo Xiaodong Gu Lingteng Qiu Yuan Dong Zhengyi Zhao ... Rui Peng Siyu Zhu Zilong Dong Liefeng Bo Qixing Huang DiffM VGen 29 25 0 18 Mar 2024
Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors Ruicheng Wang Jianfeng Xiang Jiaolong Yang Xin Tong DiffM 27 4 0 18 Mar 2024
Envision3D: One Image to 3D with Anchor Views Interpolation Yatian Pang Tanghui Jia Yujun Shi Zhenyu Tang Junwu Zhang Xinhua Cheng Xing Zhou Francis E. H. Tay Li-xin Yuan 40 8 0 13 Mar 2024
V3D: Video Diffusion Models are Effective 3D Generators Zilong Chen Yikai Wang Feng Wang Zhengyi Wang Huaping Liu VGen 38 61 0 11 Mar 2024
FSViewFusion: Few-Shots View Generation of Novel Objects Rukhshanda Hussain Hui Xian Grace Lim Borchun Chen Mubarak Shah Ser Nam Lim DiffM 28 0 0 11 Mar 2024
Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos Mi Luo Zihui Xue Alex Dimakis Kristen Grauman EgoV DiffM 35 10 0 11 Mar 2024
Enhancing Texture Generation with High-Fidelity Using Advanced Texture Priors Kuo Xu Maoyu Wang Muyu Wang Lincong Feng Tianhui Zhang Xiaoli Liu 30 1 0 08 Mar 2024
Hierarchical Diffusion Policy for Kinematics-Aware Multi-Task Robotic Manipulation Xiao Ma Sumit Patidar Iain Haughton Stephen James 35 49 0 06 Mar 2024
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models Lukas Höllein Aljavz Bovzivc Norman Muller David Novotny Hung-Yu Tseng Christian Richardt Michael Zollhöfer Matthias Nießner DiffM 39 39 0 04 Mar 2024
ViewFusion: Towards Multi-View Consistency via Interpolated Denoising Xianghui Yang Yan Zuo Sameera Ramasinghe Loris Bazzani Gil Avraham A. Hengel DiffM 35 6 0 29 Feb 2024
PolyOculus: Simultaneous Multi-view Image-based Novel View Synthesis Jason J. Yu Tristan Aumentado-Armstrong Fereshteh Forghani Konstantinos G. Derpanis Marcus A. Brubaker 28 5 0 28 Feb 2024
Diffusion Meets DAgger: Supercharging Eye-in-hand Imitation Learning Xiaoyu Zhang Matthew Chang Pranav Kumar Saurabh Gupta DiffM OffRL 43 13 0 27 Feb 2024
CharNeRF: 3D Character Generation from Concept Art Eddy Chu Yiyang Chen Chedy Raissi Anand Bhojan 3DH 21 1 0 27 Feb 2024
Cameras as Rays: Pose Estimation via Ray Diffusion Jason Y. Zhang Amy Lin Moneish Kumar Tzu-Hsuan Yang Deva Ramanan Shubham Tulsiani DiffM 29 54 0 22 Feb 2024
Consolidating Attention Features for Multi-view Image Editing Or Patashnik Rinon Gal Daniel Cohen-Or Jun-Yan Zhu Fernando de la Torre 32 6 0 22 Feb 2024
DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generation Chong Zeng Yue Dong Pieter Peers Youkang Kong Hongzhi Wu Xin Tong 22 27 0 19 Feb 2024
SPAD : Spatially Aware Multiview Diffusers Yash Kant Ziyi Wu Michael Vasilkovsky Guocheng Qian Jian Ren R. A. Guler Bernard Ghanem Sergey Tulyakov Igor Gilitschenski Aliaksandr Siarohin DiffM 22 34 0 07 Feb 2024
Denoising Diffusion via Image-Based Rendering Titas Anciukevicius Fabian Manhardt Federico Tombari Paul Henderson 40 11 0 05 Feb 2024
Retrieval-Augmented Score Distillation for Text-to-3D Generation Junyoung Seo Susung Hong Wooseok Jang Ines Hyeonsu Kim Minseop Kwak Doyup Lee Seungryong Kim 57 9 0 05 Feb 2024
ViewFusion: Learning Composable Diffusion Models for Novel View Synthesis Bernard Spiegl Andrea Perin Stéphane Deny Alexander Ilin DiffM 11 2 0 05 Feb 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 37 38 0 31 Jan 2024
FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Models Feihong He Gang Li Mengyuan Zhang Leilei Yan Lingyu Si Fanzhang Li Li Shen DiffM 18 15 0 28 Jan 2024
DITTO: Diffusion Inference-Time T-Optimization for Music Generation Zachary Novack Julian McAuley Taylor Berg-Kirkpatrick Nicholas J. Bryan DiffM 24 32 0 22 Jan 2024
Template-Free Single-View 3D Human Digitalization with Diffusion-Guided LRM Zhenzhen Weng Jingyuan Liu Hao Tan Zhan Xu Yang Zhou Serena Yeung-Levy Jimei Yang 3DH 30 8 0 22 Jan 2024
HexaGen3D: StableDiffusion is just one step away from Fast and Diverse Text-to-3D Generation Antoine Mercier Ramin Nakhli Mahesh Reddy R. Yasarla Hong Cai Fatih Porikli Guillaume Berger DiffM 22 15 0 15 Jan 2024
SIGNeRF: Scene Integrated Generation for Neural Radiance Fields Jan-Niklas Dihlmann Andreas Engelhardt Hendrik P. A. Lensch DiffM VGen 16 4 0 03 Jan 2024
GD^2-NeRF: Generative Detail Compensation via GAN and Diffusion for One-shot Generalizable Neural Radiance Fields X. Pan Zongxin Yang Shuai Bai Yi Yang DiffM OffRL 18 1 0 01 Jan 2024
iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views Chin-Hsuan Wu Yen-Chun Chen Bolivar Solarte Lu Yuan Min Sun 19 9 0 28 Dec 2023
4DGen: Grounded 4D Content Generation with Spatial-temporal Consistency Yuyang Yin Dejia Xu Zhangyang Wang Yao-Min Zhao Yunchao Wei 3DGS 47 72 0 28 Dec 2023