Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 454 papers shown

Title
Sharp-It: A Multi-view to Multi-view Diffusion Model for 3D Synthesis and Manipulation Yiftach Edelstein Or Patashnik Dana Cohen-Bar Lihi Zelnik-Manor 72 0 0 03 Dec 2024
InfiniDreamer: Arbitrarily Long Human Motion Generation via Segment Score Distillation Wenjie Zhuo Fan Ma Hehe Fan 66 0 0 27 Nov 2024
SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation Duc-Hai Pham Tung Do P. Nguyen Binh-Son Hua K. Nguyen Rang Nguyen MDE 74 1 0 27 Nov 2024
ModeDreamer: Mode Guiding Score Distillation for Text-to-3D Generation using Reference Image Prompts Uy Dieu Tran Minh Luu P. Nguyen K. Nguyen Binh-Son Hua DiffM 71 1 0 27 Nov 2024
SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis Hyojun Go Byeongjun Park Jiho Jang Jin-Young Kim Soonwoo Kwon Changick Kim 3DGS 111 2 0 25 Nov 2024
Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priors Soumava Paul Prakhar Kaushik Alan L. Yuille 3DGS DiffM 88 0 0 24 Nov 2024
TEXGen: a Generative Diffusion Model for Mesh Textures Xin Yu Ze Yuan Y. Guo Ying-Tian Liu J. H. Liu Yangguang Li Yan-Pei Cao Ding Liang Xiaojuan Qi 60 8 0 22 Nov 2024
Novel View Extrapolation with Video Diffusion Priors Kunhao Liu Ling Shao Shijian Lu VGen 75 3 0 21 Nov 2024
MVLight: Relightable Text-to-3D Generation via Light-conditioned Multi-View Diffusion D. Shim Yichun Shi Kejie Li H. J. Kim Peng Wang 64 0 0 18 Nov 2024
ARM: Appearance Reconstruction Model for Relightable 3D Generation Xiang-Wei Feng Chang Yu Zoubin Bi Yintong Shang Feng Gao Hongzhi Wu Kun Zhou Chenfanfu Jiang Y. Yang 3DH 43 1 0 16 Nov 2024
Edify 3D: Scalable High-Quality 3D Asset Generation Nvidia : Maciej Bala Yin Cui Yifan Ding ... Fangyin Wei Donglai Xiang Jiashu Xu Xiaohui Zeng Qinsheng Zhang 54 6 0 11 Nov 2024
ReCapture: Generative Video Camera Controls for User-Provided Videos using Masked Video Fine-Tuning David Junhao Zhang Roni Paiss Shiran Zada Nikhil Karnad David E. Jacobs Yael Pritch Inbar Mosseri Mike Zheng Shou Neal Wadhwa Nataniel Ruiz DiffM VGen 66 15 0 07 Nov 2024
SceneComplete: Open-World 3D Scene Completion in Complex Real World Environments for Robot Manipulation Aditya Agarwal Gaurav Singh Bipasha Sen Tomás Lozano-Pérez L. Kaelbling 3DV 25 3 0 31 Oct 2024
CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussians Chongjian Ge Chenfeng Xu Yuanfeng Ji C-T.John Peng M. Tomizuka Ping Luo Mingyu Ding Varun Jampani W. Zhan 3DGS 32 4 0 28 Oct 2024
Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Models Liulei Li Wenguan Wang Y. Yang 34 7 0 26 Oct 2024
Few-shot NeRF by Adaptive Rendering Loss Regularization Qingshan Xu Xuanyu Yi Jianyao Xu Wenbing Tao Yew-Soon Ong Hanwang Zhang 14 6 0 23 Oct 2024
DreamCraft3D++: Efficient Hierarchical 3D Generation with Multi-Plane Reconstruction Model Jingxiang Sun Cheng Peng Ruizhi Shao Y. Guo Xiaochen Zhao Yangguang Li Yanpei Cao Bo Zhang Yebin Liu 33 2 0 16 Oct 2024
ControLRM: Fast and Controllable 3D Generation via Large Reconstruction Model Hongbin Xu Weitao Chen Zhipeng Zhou Feng Xiao Baigui Sun Mike Zheng Shou Wenxiong Kang 24 2 0 12 Oct 2024
Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors Hritam Basak Hadi Tabatabaee Shreekant Gayaka Ming-feng Li Xin Yang Cheng-Hao Kuo Arnie Sen Min Sun Zhaozheng Yin 3DGS 33 0 0 12 Oct 2024
Semantic Score Distillation Sampling for Compositional Text-to-3D Generation L. Yang Zixiang Zhang Junlin Han Bohan Zeng Runjia Li Philip Torr Wentao Zhang 26 2 0 11 Oct 2024
SceneCraft: Layout-Guided 3D Scene Generation Xiuyu Yang Yunze Man Jun-Kun Chen Yu-Xiong Wang 3DV 74 8 0 11 Oct 2024
Diffusion Models in 3D Vision: A Survey Zhen Wang Dongyuan Li Renhe Jiang Tianyu He Jiang Bian Renhe Jiang MedIm 53 4 0 07 Oct 2024
LaGeM: A Large Geometry Model for 3D Representation Learning and Diffusion Biao Zhang Peter Wonka AI4CE 3DV DiffM 20 7 0 02 Oct 2024
GenesisTex2: Stable, Consistent and High-Quality Text-to-Texture Generation Jiawei Lu Yingpeng Zhang Zengjun Zhao He-Nan Wang Kun Zhou Tianjia Shao 42 4 0 27 Sep 2024
EdgeRunner: Auto-regressive Auto-encoder for Artistic Mesh Generation Jiaxiang Tang Zhaoshuo Li Zekun Hao Xian Liu Gang Zeng Ming-Yu Liu Qinsheng Zhang 39 22 0 26 Sep 2024
DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion Yukun Huang Jianan Wang Ailing Zeng Zheng-Jun Zha Lei Zhang Xihui Liu 3DGS 32 5 0 25 Sep 2024
Blox-Net: Generative Design-for-Robot-Assembly Using VLM Supervision, Physics Simulation, and a Robot with Reset Andrew Goldberg Kavish Kondap Tianshuang Qiu Zehan Ma Letian Fu Justin Kerr Huang Huang Kaiyuan Chen Kuan Fang Ken Goldberg 26 4 0 25 Sep 2024
Single Image, Any Face: Generalisable 3D Face Generation Wenqing Wang Haosen Yang Josef Kittler Xiatian Zhu 3DH 64 0 0 25 Sep 2024
DepthART: Monocular Depth Estimation as Autoregressive Refinement Task Bulat Gabdullin Nina Konovalova Nikolay Patakin Dmitry Senushkin Anton Konushin MDE 25 0 0 23 Sep 2024
MaterialFusion: Enhancing Inverse Rendering with Material Diffusion Priors Yehonathan Litman Or Patashnik Kangle Deng Aviral Agrawal Rushikesh Zawar Fernando de la Torre Shubham Tulsiani 29 5 0 23 Sep 2024
Vista3D: Unravel the 3D Darkside of a Single Image Qiuhong Shen Xingyi Yang Michael Bi Mi Xinchao Wang CoGe 29 2 0 18 Sep 2024
DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors Thomas Hanwen Zhu Ruining Li Tomas Jakab DiffM 34 4 0 12 Sep 2024
DreamBeast: Distilling 3D Fantastical Animals with Part-Aware Knowledge Transfer Runjia Li Junlin Han Luke Melas-Kyriazi Chunyi Sun Zhaochong An Zhongrui Gui Shuyang Sun Philip Torr Tomas Jakab 30 1 0 12 Sep 2024
DreamMesh: Jointly Manipulating and Texturing Triangle Meshes for Text-to-3D Generation Haibo Yang Yang Chen Yingwei Pan Ting Yao Zhineng Chen Zuxuan Wu Yu-Gang Jiang Tao Mei 27 6 0 11 Sep 2024
MVGaussian: High-Fidelity text-to-3D Content Generation with Multi-View Guidance and Surface Densification Phu-Cuong Pham Aradhya Neeraj Mathur Ojaswa Sharma Aniket Bera 3DV 3DGS 16 1 0 10 Sep 2024
Neural MP: A Generalist Neural Motion Planner Murtaza Dalal Jiahui Yang Russell Mendonca Youssef Khaky Ruslan Salakhutdinov Deepak Pathak 21 0 0 09 Sep 2024
DreamMapping: High-Fidelity Text-to-3D Generation via Variational Distribution Mapping Zeyu Cai D. B. Wang Yixun Liang Zhijing Shao Ying-Cong Chen Xiaohang Zhan Z. Wang DiffM 3DGS 26 1 0 08 Sep 2024
GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers Lorenza Prospero Abdullah Hamdi João F. Henriques Christian Rupprecht 3DGS 29 2 0 06 Sep 2024
MeshUp: Multi-Target Mesh Deformation via Blended Score Distillation Hyunwoo Kim Itai Lang Noam Aigerman Thibault Groueix Vladimir G. Kim Rana Hanocka AI4CE 30 3 0 27 Aug 2024
Pixel-Aligned Multi-View Generation with Depth Guided Decoder Z-H. Tang Peiye Zhuang Chaoyang Wang Aliaksandr Siarohin Yash Kant Alexander Schwing Sergey Tulyakov Hsin-Ying Lee 32 1 0 26 Aug 2024
Atlas Gaussians Diffusion for 3D Generation Haitao Yang Yuan Dong Hanwen Jiang Dejia Xu Georgios Pavlakos Qixing Huang 3DGS 57 3 0 23 Aug 2024
MeshFormer: High-Quality Mesh Generation with 3D-Guided Reconstruction Model Minghua Liu Chong Zeng Xinyue Wei Ruoxi Shi Linghao Chen ... Zhaoning Wang Xiaoshuai Zhang Isabella Liu Hongzhi Wu Hao Su 67 23 0 19 Aug 2024
SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views Chao Xu Ang Li Linghao Chen Yulin Liu Ruoxi Shi Hao Su Minghua Liu 3DGS 37 21 0 19 Aug 2024
MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editing Chenjie Cao Chaohui Yu Yanwei Fu Fan Wang Xiangyang Xue VGen 39 7 0 15 Aug 2024
Scene123: One Prompt to 3D Scene Generation via Video-Assisted and Consistency-Enhanced MAE Yiying Yang Fukun Yin Jiayuan Fan Xin Chen Wanzhang Li Gang Yu VGen 39 0 0 10 Aug 2024
FlowDreamer: exploring high fidelity text-to-3D generation via rectified flow Hangyu Li Xiangxiang Chu Dingyuan Shi Lin Wang 45 3 0 09 Aug 2024
SceneMotifCoder: Example-driven Visual Program Learning for Generating 3D Object Arrangements Hou In Ivan Tam Hou In Derek Pun Austin T. Wang Angel X. Chang Manolis Savva 57 10 0 05 Aug 2024
Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attention Mengkang Hu DiffM 31 7 0 01 Aug 2024
Localized Gaussian Splatting Editing with Contextual Awareness Hanyuan Xiao Yingshu Chen Huajian Huang Haolin Xiong Jing Yang P. Prasad Yajie Zhao 3DGS DiffM 26 4 0 31 Jul 2024
SceneTeller: Language-to-3D Scene Generation Basak Melis Öcal Maxim Tatarchenko Sezer Karaoglu Theo Gevers 30 6 0 30 Jul 2024