3D-aware Image Generation using 2D Diffusion Models

31 March 2023

Papers citing "3D-aware Image Generation using 2D Diffusion Models"

50 / 63 papers shown

Title
RayZer: A Self-supervised Large View Synthesis Model Hanwen Jiang Hao Tan Peng Wang Haian Jin Yue Zhao ... Kai Zhang Fujun Luan Kalyan Sunkavalli Qixing Huang Georgios Pavlakos 60 0 0 01 May 2025
GenFusion: Closing the Loop between Reconstruction and Generation via Videos Sibo Wu Congrong Xu Binbin Huang Andreas Geiger Anpei Chen VGen 51 0 0 27 Mar 2025
A Recipe for Generating 3D Worlds From a Single Image Katja Schwarz Denys Rozumnyi Samuel Rota Buló Lorenzo Porzi Peter Kontschieder VGen 74 1 0 20 Mar 2025
Acc3D: Accelerating Single Image to 3D Diffusion Models via Edge Consistency Guided Score Distillation Kendong Liu Zhiyu Zhu Hui Liu Junhui Hou 40 0 0 20 Mar 2025
SynCity: Training-Free Generation of 3D Worlds Paul Engstler Aleksandar Shtedritski Iro Laina Christian Rupprecht Andrea Vedaldi 3DGS 98 0 0 20 Mar 2025
Self-attention-based Diffusion Model for Time-series Imputation in Partial Blackout Scenarios Mohammad Rafid Ul Islam Prasad Tadepalli Alan Fern 29 0 0 03 Mar 2025
Synthesizing Consistent Novel Views via 3D Epipolar Attention without Re-Training Botao Ye Sifei Liu Xueting Li Marc Pollefeys Ming Yang 64 0 0 25 Feb 2025
LiftImage3D: Lifting Any Single Image to 3D Gaussians with Video Generation Priors Yabo Chen Chen-Ning Yang Jiemin Fang Xiaopeng Zhang Lingxi Xie Wei-Ming Shen Wenrui Dai Hongkai Xiong Q. Tian 3DGS 94 2 0 12 Dec 2024
ShapeWords: Guiding Text-to-Image Synthesis with 3D Shape-Aware Prompts Dmitry Petrov Pradyumn Goyal Divyansh Shivashok Yuanming Tao Melinos Averkiou E. Kalogerakis 61 0 0 03 Dec 2024
Direct and Explicit 3D Generation from a Single Image Haoyu Wu Meher Gitika Karumuri Chuhang Zou Seungbae Bang Yuelong Li Dimitris Samaras Sunil Hadap 3DGS MDE 3DV 27 0 0 17 Nov 2024
Towards High-Fidelity 3D Portrait Generation with Rich Details by Cross-View Prior-Aware Diffusion Haoran Wei Wencheng Han Xingping Dong Jianbing Shen DiffM 41 0 0 15 Nov 2024
PrefPaint: Aligning Image Inpainting Diffusion Model with Human Preference Kendong Liu Zhiyu Zhu Chuanhao Li Hui Liu H. Zeng Junhui Hou EGVM 35 2 0 29 Oct 2024
DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Model Jingxiang Sun Cheng Peng Ruizhi Shao Y. Guo Xiaochen Zhao Yangguang Li Yanpei Cao Bo Zhang Yebin Liu 33 2 0 16 Oct 2024
Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors Hritam Basak Hadi Tabatabaee Shreekant Gayaka Ming-feng Li Xin Yang Cheng-Hao Kuo Arnie Sen Min Sun Zhaozheng Yin 3DGS 33 0 0 12 Oct 2024
3DDX: Bone Surface Reconstruction from a Single Standard-Geometry Radiograph via Dual-Face Depth Estimation Yi Gu Y. Otake Keisuke Uemura Masaki Takao Mazen Soufi S. Okada Nobuhiko Sugano Hugues Talbot Yoshinobu Sato 19 2 0 25 Sep 2024
Content-aware Tile Generation using Exterior Boundary Inpainting Sam Sartor Pieter Peers DiffM 13 0 0 21 Sep 2024
Latent Feature and Attention Dual Erasure Attack against Multi-View Diffusion Models for 3D Assets Protection Jingwei Sun Xuchong Zhang Changfeng Sun Qicheng Bai Hongbin Sun AAML DiffM 30 0 0 21 Aug 2024
MultiDiff: Consistent Novel View Synthesis from a Single Image Norman Muller Katja Schwarz Barbara Roessle Lorenzo Porzi Samuel Rota Buló Matthias Nießner Peter Kontschieder DiffM 34 22 0 26 Jun 2024
ConsistDreamer: 3D-Consistent 2D Diffusion for High-Fidelity Scene Editing Jun-Kun Chen Samuel Rota Buló Norman Muller Lorenzo Porzi Peter Kontschieder Yu-Xiong Wang DiffM 23 9 0 13 Jun 2024
Instruct 4D-to-4D: Editing 4D Scenes as Pseudo-3D Scenes Using 2D Diffusion Linzhan Mou Jun-Kun Chen Yu-Xiong Wang VGen DiffM 24 10 0 13 Jun 2024
Real3D: Scaling Up Large Reconstruction Models with Real-World Images Hanwen Jiang Qixing Huang Georgios Pavlakos OffRL 27 11 0 12 Jun 2024
Reasoning3D -- Grounding and Reasoning in 3D: Fine-Grained Zero-Shot Open-Vocabulary 3D Reasoning Part Segmentation via Large Vision-Language Models Tianrun Chen Chunan Yu Jing Li Jianqi Zhang Lanyun Zhu Deyi Ji Yong Zhang Ying-Dong Zang Zejian Li Lingyun Sun LRM 36 9 0 29 May 2024
Part123: Part-aware 3D Reconstruction from a Single-view Image Anran Liu Cheng Lin Yuan-Bin Liu Xiaoxiao Long Zhiyang Dou Hao-Xiang Guo Ping Luo Wenping Wang 29 2 0 27 May 2024
NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer Meng You Zhiyu Zhu Hui Liu Junhui Hou VGen DiffM 23 23 0 24 May 2024
Invisible Stitch: Generating Smooth 3D Scenes with Depth Inpainting Paul Engstler Andrea Vedaldi Iro Laina Christian Rupprecht MDE 29 9 0 30 Apr 2024
Beyond Deepfake Images: Detecting AI-Generated Videos Danial Samadi Vahdati Tai D. Nguyen Aref Azizpour Matthew C. Stamm 55 10 0 24 Apr 2024
E3: Ensemble of Expert Embedders for Adapting Synthetic Image Detectors to New Generators Using Limited Data Aref Azizpour Tai D. Nguyen Manil Shrestha Kaidi Xu Edward Kim Matthew C. Stamm 23 4 0 12 Apr 2024
GenesisTex: Adapting Image Denoising Diffusion to Texture Space Chenjian Gao Boyan Jiang Xinghui Li Yingpeng Zhang Qian Yu DiffM 31 8 0 26 Mar 2024
AniArtAvatar: Animatable 3D Art Avatar from a Single Image Shaoxu Li 29 1 0 26 Mar 2024
Diffusion Models are Geometry Critics: Single Image 3D Editing Using Pre-Trained Diffusion Priors Ruicheng Wang Jianfeng Xiang Jiaolong Yang Xin Tong DiffM 14 4 0 18 Mar 2024
Isotropic3D: Image-to-3D Generation Based on a Single CLIP Embedding Pengkun Liu Yikai Wang Fuchun Sun Jiafang Li Hang Xiao Hongxiang Xue Xinzhou Wang 33 8 0 15 Mar 2024
FSViewFusion: Few-Shots View Generation of Novel Objects Rukhshanda Hussain Hui Xian Grace Lim Borchun Chen Mubarak Shah Ser Nam Lim DiffM 18 0 0 11 Mar 2024
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models Lukas Höllein Aljavz Bovzivc Norman Muller David Novotny Hung-Yu Tseng Christian Richardt Michael Zollhöfer Matthias Nießner DiffM 36 39 0 04 Mar 2024
G3DR: Generative 3D Reconstruction in ImageNet Pradyumna Reddy Ismail Elezi Jiankang Deng 22 5 0 01 Mar 2024
ViewFusion: Towards Multi-View Consistency via Interpolated Denoising Xianghui Yang Yan Zuo Sameera Ramasinghe Loris Bazzani Gil Avraham A. Hengel DiffM 29 5 0 29 Feb 2024
Diffusion Model-Based Image Editing: A Survey Yi Huang Jiancheng Huang Yifan Liu Mingfu Yan Jiaxi Lv Jianzhuang Liu Wei Xiong He Zhang Liangliang Cao Liangliang Cao EGVM 57 82 0 27 Feb 2024
DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generation Chong Zeng Yue Dong Pieter Peers Youkang Kong Hongzhi Wu Xin Tong 22 25 0 19 Feb 2024
Denoising Diffusion via Image-Based Rendering Titas Anciukevicius Fabian Manhardt Federico Tombari Paul Henderson 40 11 0 05 Feb 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 34 38 0 31 Jan 2024
EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion Zehuan Huang Hao Wen Junting Dong Yaohui Wang Yangguang Li ... Yan-Pei Cao Ding Liang Yu Qiao Bo Dai Lu Sheng 14 10 0 11 Dec 2023
Optimized View and Geometry Distillation from Multi-view Diffuser Youjia Zhang Zikai Song Junqing Yu Yawei Luo Wei Yang 19 0 0 11 Dec 2023
Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Views Yabo Chen Jiemin Fang Yuyang Huang Taoran Yi Xiaopeng Zhang Lingxi Xie Xinggang Wang Wenrui Dai Hongkai Xiong Qi Tian DiffM 16 20 0 07 Dec 2023
Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion Kira Prabhu Jane Wu Lynn Tsai Peter Hedman Dan B. Goldman Ben Poole Michael Broxton DiffM 13 7 0 06 Dec 2023
MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation Zhiqi Li Yiming Chen Lingzhe Zhao Peidong Liu 6 7 0 24 Nov 2023
WildFusion: Learning 3D-Aware Latent Diffusion Models in View Space Katja Schwarz Seung Wook Kim Jun Gao Sanja Fidler Andreas Geiger Karsten Kreis 11 6 0 22 Nov 2023
Single-Image 3D Human Digitization with Shape-Guided Diffusion Badour Albahar Shunsuke Saito Hung-Yu Tseng Changil Kim Johannes Kopf Jia-Bin Huang DiffM 24 28 0 15 Nov 2023
Controllable Group Choreography using Contrastive Diffusion Nhat Le Tuong Khanh Long Do Khoa Do Hien Nguyen Erman Tjiputra Quang-Dieu Tran Anh Nguyen 32 10 0 29 Oct 2023
ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image Kyle Sargent Zizhang Li Tanmay Shah Charles Herrmann Hong-Xing Yu ... Eric Ryan Chan Dmitry Lagun Fei-Fei Li Deqing Sun Jiajun Wu DiffM VGen 16 4 0 27 Oct 2023
DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior Jingxiang Sun Bo Zhang Ruizhi Shao Lizhen Wang Wen Liu Zhenda Xie Yebin Liu 15 132 0 25 Oct 2023
Wonder3D: Single Image to 3D using Cross-Domain Diffusion Xiaoxiao Long Yuanchen Guo Cheng Lin Yuan-Bin Liu Zhiyang Dou ... Yuexin Ma Song-Hai Zhang Marc Habermann Christian Theobalt Wenping Wang 29 400 0 23 Oct 2023