Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 454 papers shown

Title
ATT3D: Amortized Text-to-3D Object Synthesis Jonathan Lorraine Kevin Xie Xiaohui Zeng Chen-Hsuan Lin Towaki Takikawa Nicholas Sharp Tsung-Yi Lin Ming-Yu Liu Sanja Fidler James Lucas DiffM 14 86 0 06 Jun 2023
Towards Visual Foundational Models of Physical Scenes Chethan Parameshwara Alessandro Achille Matthew Trager Xiaolong Li Jiawei Mo ... A. Swaminathan C. Taylor D. Venkatraman Xiaohan Fei Stefano Soatto DiffM 19 4 0 06 Jun 2023
HeadSculpt: Crafting 3D Head Avatars with Text Xiaoping Han Yukang Cao Kai Han Xiatian Zhu Jiankang Deng Yi-Zhe Song Tao Xiang Kwan-Yee Kenneth Wong DiffM 11 31 0 05 Jun 2023
Efficient Text-Guided 3D-Aware Portrait Generation with Score Distillation Sampling on Distribution Yiji Cheng Fei Yin Xiaoke Huang Xintong Yu Jiaxiang Liu Shi Feng Yujiu Yang Yansong Tang DiffM 13 4 0 03 Jun 2023
Control4D: Efficient 4D Portrait Editing with Text Ruizhi Shao Jingxiang Sun Cheng Peng Zerong Zheng Boyao Zhou Hongwen Zhang Yebin Liu DiffM 14 22 0 31 May 2023
HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance Junzhe Zhu Peiye Zhuang Oluwasanmi Koyejo DiffM 21 72 0 30 May 2023
ZeroAvatar: Zero-shot 3D Avatar Generation from a Single Image Zhenzhen Weng Zeyu Wang S. Yeung DiffM 17 20 0 25 May 2023
ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation Zhengyi Wang Cheng Lu Yikai Wang Fan Bao Chongxuan Li Hang Su Jun Zhu DiffM 28 518 0 25 May 2023
Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedback Yiqi Lin Hao Wu Ruichen Wang H. Lu Xiaodong Lin Hui Xiong Lin Wang 3DV 19 12 0 25 May 2023
Sin3DM: Learning a Diffusion Model from a Single 3D Textured Shape Rundi Wu Ruoshi Liu Carl Vondrick Changxi Zheng DiffM 24 24 0 24 May 2023
Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction Xinhang Liu Jiaben Chen Shiu-hong Kao Yu-Wing Tai Chi-Keung Tang DiffM 18 16 0 24 May 2023
Vision + Language Applications: A Survey Yutong Zhou N. Shimada VLM 18 5 0 24 May 2023
DirecT2V: Large Language Models are Frame-Level Directors for Zero-Shot Text-to-Video Generation Susung Hong Junyoung Seo Heeseong Shin Sung‐Jin Hong Seung Wook Kim DiffM VGen 15 34 0 23 May 2023
Text-guided 3D Human Generation from 2D Collections Tsu-jui Fu Wenhan Xiong Yixin Nie Jingyu Liu Barlas Ouguz William Yang Wang 23 1 0 23 May 2023
DreamWaltz: Make a Scene with Complex 3D Animatable Avatars Yukun Huang Jianan Wang Ailing Zeng He Cao Xianbiao Qi Yukai Shi Zhengjun Zha Lei Zhang 10 69 0 21 May 2023
Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Models Byungjun Kim Patrick Kwon K. Lee Myunggi Lee Sookwan Han Daesik Kim Hanbyul Joo DiffM 24 20 0 19 May 2023
Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fields Jingbo Zhang Xiaoyu Li Ziyu Wan Can Wang Jing Liao VGen DiffM 6 83 0 19 May 2023
RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture Liangchen Song Liangliang Cao Hongyu Xu Kai Kang Feng Tang Junsong Yuan Yang Zhao VGen DiffM 19 44 0 18 May 2023
Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era Chenghao Li Chaoning Zhang Atish Waghwase Lik-Hang Lee François Rameau Yang Yang Sung-Ho Bae Choong Seon Hong 44 68 0 10 May 2023
Shap-E: Generating Conditional 3D Implicit Functions Heewoo Jun Alex Nichol DiffM 184 300 0 03 May 2023
TextDeformer: Geometry Manipulation using Text Guidance William Gao Noam Aigerman Thibault Groueix Vladimir G. Kim Rana Hanocka AI4CE 17 79 0 26 Apr 2023
Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFs Frederik Warburg Ethan Weber Matthew Tancik Aleksander Holynski Angjoo Kanazawa DiffM 13 54 0 20 Apr 2023
Anything-3D: Towards Single-view Anything Reconstruction in the Wild Qiuhong Shen Xingyi Yang Xinchao Wang DiffM 11 85 0 19 Apr 2023
Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Images Jiatao Gu Qingzhe Gao Shuangfei Zhai Baoquan Chen Lingjie Liu J. Susskind 20 29 0 13 Apr 2023
Re-imagine the Negative Prompt Algorithm: Transform 2D Diffusion into 3D, alleviate Janus problem and Beyond Mohammadreza Armandpour A. Sadeghian Huangjie Zheng Amir Sadeghian Mingyuan Zhou DiffM 13 123 0 11 Apr 2023
A Comprehensive Survey on Knowledge Distillation of Diffusion Models Weijian Luo DiffM MedIm 14 33 0 09 Apr 2023
3D-aware Image Generation using 2D Diffusion Models Jianfeng Xiang Jiaolong Yang Binbin Huang Xin Tong DiffM 27 65 0 31 Mar 2023
Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversion Hiromichi Kamata Yuiko Sakuma Akio Hayakawa Masato Ishii T. Narihira DiffM 24 37 0 28 Mar 2023
Debiasing Scores and Prompts of 2D Diffusion for View-consistent Text-to-3D Generation Susung Hong Donghoon Ahn Seungryong Kim DiffM 17 23 0 27 Mar 2023
Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior Junshu Tang Tengfei Wang Bo Zhang Ting Zhang Ran Yi Lizhuang Ma Dong Chen DiffM 179 307 0 24 Mar 2023
CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout Haotian Bai Yiqi Lin Hui Xiong Sijia Li H. Lu Xiaodong Lin Lin Wang DiffM 26 42 0 24 Mar 2023
DreamBooth3D: Subject-Driven Text-to-3D Generation Amit Raj S. Kaza Ben Poole Michael Niemeyer Nataniel Ruiz ... Kfir Aberman Michael Rubinstein Jonathan T. Barron Yuanzhen Li Varun Jampani DiffM 16 218 0 23 Mar 2023
Set-the-Scene: Global-Local Training for Generating Controllable NeRF Scenes Dana Cohen-Bar Elad Richardson G. Metzer Raja Giryes Daniel Cohen-Or 66 52 0 23 Mar 2023
Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions Ayaan Haque Matthew Tancik Alexei A. Efros Aleksander Holynski Angjoo Kanazawa VGen DiffM 14 245 0 22 Mar 2023
Compositional 3D Scene Generation using Locally Conditioned Diffusion Ryan Po Gordon Wetzstein DiffM 6 85 0 21 Mar 2023
Vox-E: Text-guided Voxel Editing of 3D Objects Etai Sella Gal Fiebelman Peter Hedman Hadar Averbuch-Elor DiffM 18 73 0 21 Mar 2023
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models Lukas Höllein Ang Cao Andrew Owens Justin Johnson Matthias Nießner DiffM 25 177 0 21 Mar 2023
Zero-1-to-3: Zero-shot One Image to 3D Object Ruoshi Liu Rundi Wu Basile Van Hoorick P. Tokmakov Sergey Zakharov Carl Vondrick DiffM 8 1,042 0 20 Mar 2023
SKED: Sketch-guided Text-based 3D Editing Aryan Mikaeili Or Perel Mehdi Safaee Daniel Cohen-Or Ali Mahdavi-Amiri DiffM 20 65 0 19 Mar 2023
Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation Junyoung Seo Wooseok Jang Minseop Kwak Ines Hyeonsu Kim Jaehoon Ko Junho Kim Jin-Hwa Kim Jiyoung Lee Seung Wook Kim DiffM 21 135 0 14 Mar 2023
To the Noise and Back: Diffusion for Shared Autonomy Takuma Yoneda Luzhe Sun Ge Yang Bradly C. Stadie Matthew R. Walter DiffM 8 14 0 23 Feb 2023
NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusion Jiatao Gu Alex Trevithick Kai-En Lin J. Susskind Christian Theobalt Lingjie Liu R. Ramamoorthi DiffM VGen 26 167 0 20 Feb 2023
Text-driven Visual Synthesis with Latent Diffusion Prior Tingbo Liao Songwei Ge Yiran Xu Yao-Chih Lee Badour Albahar Jia-Bin Huang DiffM 17 6 0 16 Feb 2023
Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models Jiale Xu Xintao Wang Weihao Cheng Yan-Pei Cao Ying Shan Xiaohu Qie Shenghua Gao 169 161 0 28 Dec 2022
LoopDraw: a Loop-Based Autoregressive Model for Shape Synthesis and Editing Nam Anh Dinh Haochen Wang G. Shakhnarovich Rana Hanocka 11 1 0 09 Dec 2022
SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction Zhizhuo Zhou Shubham Tulsiani DiffM 22 209 0 01 Dec 2022
ReLU Fields: The Little Non-linearity That Could Animesh Karnewar Tobias Ritschel Oliver Wang Niloy J. Mitra 128 100 0 22 May 2022
AvatarCLIP: Zero-Shot Text-Driven Generation and Animation of 3D Avatars Fangzhou Hong Mingyuan Zhang Liang Pan Zhongang Cai Lei Yang Ziwei Liu CLIP 94 78 0 17 May 2022
Text2Mesh: Text-Driven Neural Stylization for Meshes O. Michel Roi Bar-On Richard Liu Sagie Benaim Rana Hanocka CLIP AI4CE 175 350 0 06 Dec 2021
Label-Efficient Semantic Segmentation with Diffusion Models Dmitry Baranchuk Ivan Rubachev A. Voynov Valentin Khrulkov Artem Babenko DiffM VLM 187 508 0 06 Dec 2021