HoloDiffusion: Training a 3D Diffusion Model using 2D Images

29 March 2023

Animesh Karnewar

Andrea Vedaldi

David Novotny

Niloy Mitra

ArXiv PDF HTML

Papers citing "HoloDiffusion: Training a 3D Diffusion Model using 2D Images"

50 / 97 papers shown

Title
IDDM: Bridging Synthetic-to-Real Domain Gap from Physics-Guided Diffusion for Real-world Image Dehazing Shijun Zhou Y. Liu Chunhui Hao Zhiyuan Liu Jiandong Tian DiffM 29 0 0 30 Apr 2025
Progressive Rendering Distillation: Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data Zhiyuan Ma Xinyue Liang Rongyuan Wu Xiangyu Zhu Zhen Lei Lei Zhang 71 0 0 27 Mar 2025
Volume Tells: Dual Cycle-Consistent Diffusion for 3D Fluorescence Microscopy De-noising and Super-Resolution Z. Li Chenwei Wang Zhaoke Huang Yiming MA Cunmin Zhao Zhongying Zhao Hong Yan DiffM 46 0 0 04 Mar 2025
DiffSplat: Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation Chenguo Lin Panwang Pan Bangbang Yang Zeming Li Yadong Mu 3DGS 67 7 0 28 Jan 2025
Singular Value Scaling: Efficient Generative Model Compression via Pruned Weights Refinement H. Kim Jaejun Yoo 39 0 0 23 Dec 2024
GANFusion: Feed-Forward Text-to-3D with Diffusion in GAN Space Souhaib Attaiki Paul Guerrero Duygu Ceylan Niloy J. Mitra M. Ovsjanikov 75 0 0 21 Dec 2024
EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting Dong In Lee Hyeongcheol Park Jiyoung Seo Eunbyung Park Hyunje Park Ha Dam Baek Shin Sangheon Sangmin kim Sangpil Kim 3DGS 99 1 0 16 Dec 2024
sMoRe: Enhancing Object Manipulation and Organization in Mixed Reality Spaces with LLMs and Generative AI Yunhao Xing Que Liu Jingwu Wang Diego Gomez-Zara 59 0 0 18 Nov 2024
Towards High-Fidelity 3D Portrait Generation with Rich Details by Cross-View Prior-Aware Diffusion Haoran Wei Wencheng Han Xingping Dong Jianbing Shen DiffM 41 0 0 15 Nov 2024
CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussians Chongjian Ge Chenfeng Xu Yuanfeng Ji C-T.John Peng M. Tomizuka Ping Luo Mingyu Ding Varun Jampani W. Zhan 3DGS 24 4 0 28 Oct 2024
Diffusion Models in 3D Vision: A Survey Zhen Wang Dongyuan Li Renhe Jiang Tianyu He Jiang Bian Renhe Jiang MedIm 49 4 0 07 Oct 2024
AnyLogo: Symbiotic Subject-Driven Diffusion System with Gemini Status Jinghao Zhang Wen Qian Hao Luo Fan Wang Feng Zhao DiffM 16 0 0 26 Sep 2024
Elucidating Optimal Reward-Diversity Tradeoffs in Text-to-Image Diffusion Models Rohit Jena Ali Taghibakhshi Sahil Jain Gerald Shen Nima Tajbakhsh Arash Vahdat 30 3 0 09 Sep 2024
MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Model Minghua Liu Chong Zeng Xinyue Wei Ruoxi Shi Linghao Chen ... Zhaoning Wang Xiaoshuai Zhang Isabella Liu Hongzhi Wu Hao Su 59 23 0 19 Aug 2024
SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views Chao Xu Ang Li Linghao Chen Yulin Liu Ruoxi Shi Hao Su Minghua Liu 3DGS 32 21 0 19 Aug 2024
4Dynamic: Text-to-4D Generation with Hybrid Priors Yu-Jie Yuan Leif Kobbelt Jiwen Liu Yuan Zhang Pengfei Wan Yu-Kun Lai Lin Gao 40 3 0 17 Jul 2024
Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materials Yawar Siddiqui Tom Monnier Filippos Kokkinos Mahendra Kariya Yanir Kleiman ... Oran Gafni Natalia Neverova Andrea Vedaldi Roman Shapovalov David Novotny 40 13 0 02 Jul 2024
MIGC++: Advanced Multi-Instance Generation Controller for Image Synthesis Dewei Zhou Y. Li Fan Ma Zongxin Yang Y. Yang 85 11 0 02 Jul 2024
Consistency Purification: Effective and Efficient Diffusion Purification towards Certified Robustness Yiquan Li Zhongzhu Chen Kun Jin Jiongxiao Wang Bo Li Chaowei Xiao DiffM 23 1 0 30 Jun 2024
SVG: 3D Stereoscopic Video Generation via Denoising Frame Matrix Peng Dai Feitong Tan Qiangeng Xu David Futschik Ruofei Du S. Fanello Xiaojuan Qi Yinda Zhang VGen 21 4 0 29 Jun 2024
ClotheDreamer: Text-Guided Garment Generation with 3D Gaussians Yufei Liu Junshu Tang Chu Zheng Shijie Zhang Jinkun Hao Junwei Zhu Dongjin Huang 25 3 0 24 Jun 2024
Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models Paul Henderson Melonie de Almeida D. Ivanova Titas Anciukevicius 3DGS 33 4 0 18 Jun 2024
Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models Yuxuan Xue Xianghui Xie R. Marin Gerard Pons-Moll 3DGS 44 2 0 12 Jun 2024
AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising Zigeng Chen Xinyin Ma Gongfan Fang Zhenxiong Tan Xinchao Wang 39 7 0 11 Jun 2024
DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data Qihao Liu Yi Zhang Song Bai Adam Kortylewski Alan Yuille 34 9 0 06 Jun 2024
SuperGaussian: Repurposing Video Models for 3D Super Resolution Yuan Shen Duygu Ceylan Paul Guerrero Zexiang Xu Niloy J. Mitra Shenlong Wang Anna Frühstück 66 4 0 02 Jun 2024
$$E^{3}$Gen: Efficient, Expressive and Editable Avatars Generation$ $E^{3}$ Gen: Efficient, Expressive and Editable Avatars Generation Weitian Zhang Yichao Yan Yunhui Liu Xingdong Sheng Xiaokang Yang 32 0 0 29 May 2024
Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabrication Yunuo Chen Tianyi Xie Zeshun Zong Xuan Li Feng Gao Yin Yang Yingnian Wu Chenfanfu Jiang 38 6 0 28 May 2024
Luban: Building Open-Ended Creative Agents via Autonomous Embodied Verification Yuxuan Guo Shaohui Peng Jiaming Guo Di Huang Xishan Zhang ... Zihao Zhang Zidong Du Qi Guo Xingui Hu Yunji Chen 19 4 0 24 May 2024
Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attention Peng Li Yuan-Bin Liu Xiaoxiao Long Feihu Zhang Cheng Lin ... Wenhan Luo Ping Tan Wenping Wang Qi-fei Liu Yi-Ting Guo VGen 69 39 0 19 May 2024
Lightplane: Highly-Scalable Components for Neural 3D Fields Ang Cao Justin Johnson Andrea Vedaldi David Novotny 28 3 0 30 Apr 2024
Unsupervised Dynamics Prediction with Object-Centric Kinematics Yeon-Ji Song Suhyung Choi Jaein Kim Jin-Hwa Kim Byoung-Tak Zhang 25 0 0 29 Apr 2024
MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space Armand Comas Massague Di Qiu Menglei Chai Marcel C. Bühler Amit Raj ... Mark Matthews Paulo F. U. Gotardo Octavia Camps Sergio Orts Thabo Beeler 27 1 0 01 Apr 2024
IPoD: Implicit Field Learning with Point Diffusion for Generalizable 3D Object Reconstruction from Single RGB-D Images Yushuang Wu Luyue Shi Junhao Cai Weihao Yuan Lingteng Qiu Zilong Dong Liefeng Bo Shuguang Cui Xiaoguang Han DiffM 16 1 0 30 Mar 2024
Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation Yujin Chen Yinyu Nie Benjamin Ummenhofer R. Birkl Michael Paulitsch Matthias Müller Matthias Nießner AI4CE 18 3 0 28 Mar 2024
NeuSDFusion: A Spatial-Aware Generative Model for 3D Shape Completion, Reconstruction, and Generation Ruikai Cui Weizhe Liu Weixuan Sun Senbo Wang Taizhang Shang ... Han Yan Zhennan Wu Shenzhou Chen Hongdong Li Pan Ji 29 8 0 27 Mar 2024
latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction Christopher Wewer Kevin Raj Eddy Ilg Bernt Schiele J. E. Lenssen 3DGS 54 8 0 24 Mar 2024
Recent Trends in 3D Reconstruction of General Non-Rigid Scenes Raza Yunus J. E. Lenssen Michael Niemeyer Yiyi Liao Christian Rupprecht Christian Theobalt Gerard Pons-Moll Jia-Bin Huang Vladislav Golyanik Eddy Ilg 46 24 0 22 Mar 2024
GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation Yinghao Xu Zifan Shi Wang Yifan Hansheng Chen Ceyuan Yang Sida Peng Yujun Shen Gordon Wetzstein 3DV 3DGS 18 148 0 21 Mar 2024
BlendScape: Enabling Unified and Personalized Video-Conferencing Environments through Generative AI Shwetha Rajaram Nels Numan Balasaravanan Thoravi Kumaravel Nicolai Marquardt A. D. Wilson 19 1 0 20 Mar 2024
LN3Diff: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation Yushi Lan Fangzhou Hong Shuai Yang Shangchen Zhou Xuyi Meng Bo Dai Xingang Pan Chen Change Loy 27 39 0 18 Mar 2024
Just Say the Name: Online Continual Learning with Category Names Only via Data Generation Minhyuk Seo Diganta Misra Seongwon Cho Minjae Lee Jonghyun Choi CLL 25 6 0 16 Mar 2024
MicroDiffusion: Implicit Representation-Guided Diffusion for 3D Reconstruction from Limited 2D Microscopy Projections Mude Hui Zihao Wei Hongru Zhu Fei Xia Yuyin Zhou MedIm 47 1 0 16 Mar 2024
V3D: Video Diffusion Models are Effective 3D Generators Zilong Chen Yikai Wang Feng Wang Zhengyi Wang Huaping Liu VGen 24 25 0 11 Mar 2024
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models Lukas Höllein Aljavz Bovzivc Norman Muller David Novotny Hung-Yu Tseng Christian Richardt Michael Zollhöfer Matthias Nießner DiffM 21 39 0 04 Mar 2024
G3DR: Generative 3D Reconstruction in ImageNet Pradyumna Reddy Ismail Elezi Jiankang Deng 17 5 0 01 Mar 2024
HyperSDFusion: Bridging Hierarchical Structures in Language and Geometry for Enhanced 3D Text2Shape Generation Zhiying Leng Tolga Birdal Xiaohui Liang Federico Tombari 31 3 0 01 Mar 2024
ViewFusion: Towards Multi-View Consistency via Interpolated Denoising Xianghui Yang Yan Zuo Sameera Ramasinghe Loris Bazzani Gil Avraham A. Hengel DiffM 27 5 0 29 Feb 2024
A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends Abolfazl Younesi Mohsen Ansari Mohammadamin Fazli A. Ejlali Muhammad Shafique Joerg Henkel 3DV 30 43 0 23 Feb 2024
MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesis Dewei Zhou You Li Fan Ma Zongxin Yang Yi Yang DiffM 18 57 0 08 Feb 2024