Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 454 papers shown

Title
Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion Kira Prabhu Jane Wu Lynn Tsai Peter Hedman Dan B. Goldman Ben Poole Michael Broxton DiffM 21 7 0 06 Dec 2023
DreamComposer: Controllable 3D Object Generation via Multi-View Conditions Yu-nuo Yang Yukun Huang Xiaoyang Wu Yuanchen Guo Song-Hai Zhang Hengshuang Zhao Tong He Xihui Liu DiffM 29 12 0 06 Dec 2023
AnimatableDreamer: Text-Guided Non-rigid 3D Model Generation and Reconstruction with Canonical Score Distillation Xinzhou Wang Yikai Wang Junliang Ye Zhengyi Wang Fuchun Sun Pengkun Liu Ling Wang Kai Sun Xintong Wang Bin He DiffM 34 17 0 06 Dec 2023
ReconFusion: 3D Reconstruction with Diffusion Priors Rundi Wu B. Mildenhall Philipp Henzler Keunhong Park Ruiqi Gao ... Pratul P. Srinivasan Dor Verbin Jonathan T. Barron Ben Poole Aleksander Holynski 79 170 0 05 Dec 2023
Alchemist: Parametric Control of Material Properties with Diffusion Models Prafull Sharma Varun Jampani Yuanzhen Li Xuhui Jia Dmitry Lagun Frédo Durand William T. Freeman Mark J. Matthews DiffM 31 24 0 05 Dec 2023
AmbiGen: Generating Ambigrams from Pre-trained Diffusion Model Boheng Zhao Rana Hanocka Raymond A. Yeh DiffM 8 1 0 05 Dec 2023
DreaMo: Articulated 3D Reconstruction From A Single Casual Video Tao Tu Ming-feng Li C. Lin Yen-Chi Cheng Min Sun Ming-Hsuan Yang 20 4 0 05 Dec 2023
Customize your NeRF: Adaptive Source Driven 3D Scene Editing via Local-Global Iterative Training Runze He Shaofei Huang Xuecheng Nie Tianrui Hui Luoqi Liu Jiao Dai Jizhong Han Guanbin Li Si Liu DiffM 22 7 0 04 Dec 2023
ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models Jeong-gi Kwak Erqun Dong Yuhe Jin Hanseok Ko Shweta Mahajan Kwang Moo Yi DiffM VGen 72 38 0 03 Dec 2023
ImageDream: Image-Prompt Multi-view Diffusion for 3D Generation Peng Wang Yichun Shi 16 165 0 02 Dec 2023
StableDreamer: Taming Noisy Score Distillation Sampling for Text-to-3D Pengsheng Guo Hans Hao Adam Caccavale Zhongzheng Ren Edward Zhang Qi Shan Aditya Sankar A. Schwing Alex Colburn Fangchang Ma DiffM 3DGS 38 7 0 02 Dec 2023
MorpheuS: Neural Dynamic 360° Surface Reconstruction from Monocular RGB-D Video Hengyi Wang Jingwen Wang Lourdes Agapito 3DH 20 1 0 01 Dec 2023
Adversarial Score Distillation: When score distillation meets GAN Min Wei Jingkai Zhou Junyao Sun Xuesong Zhang DiffM 13 8 0 01 Dec 2023
Lasagna: Layered Score Distillation for Disentangled Object Relighting D. Bashkirova Arijit Ray Rupayan Mallick Sarah Adel Bargal Jianming Zhang Ranjay Krishna Kate Saenko 19 3 0 30 Nov 2023
GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphs Gege Gao Weiyang Liu Anpei Chen Andreas Geiger Bernhard Schölkopf DiffM 23 45 0 30 Nov 2023
LucidDreaming: Controllable Object-Centric 3D Generation Zhaoning Wang Ming Li C. L. P. Chen 34 10 0 30 Nov 2023
X-Dreamer: Creating High-quality 3D Content by Bridging the Domain Gap Between Text-to-2D and Text-to-3D Generation Yiwei Ma Yijun Fan Jiayi Ji Haowei Wang Xiaoshuai Sun Guannan Jiang Annan Shu Rongrong Ji 14 7 0 30 Nov 2023
Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Models Daniel Geng Inbum Park Andrew Owens DiffM 23 29 0 29 Nov 2023
4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling Sherwin Bahmani Ivan Skorokhodov Victor Rong Gordon Wetzstein Leonidas J. Guibas Peter Wonka Sergey Tulyakov Jeong Joon Park Andrea Tagliasacchi David B. Lindell DiffM 41 103 0 29 Nov 2023
Spice-E : Structural Priors in 3D Diffusion using Cross-Entity Attention Etai Sella Gal Fiebelman Noam Atia Hadar Averbuch-Elor DiffM 31 2 0 29 Nov 2023
GeoDream: Disentangling 2D and Geometric Priors for High-Fidelity and Consistent 3D Generation Baorui Ma Haoge Deng Junsheng Zhou Yu-Shen Liu Tiejun Huang Xinlong Wang DiffM 32 28 0 29 Nov 2023
SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors Dave Zhenyu Chen Haoxuan Li Hsin-Ying Lee Sergey Tulyakov Matthias Nießner DiffM 17 28 0 28 Nov 2023
HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting Xian Liu Xiaohang Zhan Jiaxiang Tang Ying Shan Gang Zeng Dahua Lin Xihui Liu Ziwei Liu 3DGS 35 72 0 28 Nov 2023
Adversarial Diffusion Distillation Axel Sauer Dominik Lorenz A. Blattmann Robin Rombach 138 329 0 28 Nov 2023
HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion Jingbo Zhang Xiaoyu Li Qi Zhang Yan-Pei Cao Ying Shan Jing Liao 27 8 0 28 Nov 2023
RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3D Lingteng Qiu Guanying Chen Xiaodong Gu Qi Zuo Mutian Xu Yushuang Wu Weihao Yuan Zilong Dong Liefeng Bo Xiaoguang Han 25 113 0 28 Nov 2023
A Unified Approach for Text- and Image-guided 4D Scene Generation Yufeng Zheng Xueting Li Koki Nagano Sifei Liu Karsten Kreis Otmar Hilliges Shalini De Mello 30 47 0 28 Nov 2023
DreamPropeller: Supercharge Text-to-3D Generation with Parallel Sampling Linqi Zhou Andy Shih Minh-Tuan Tran Dinh Q. Phung DiffM 29 13 0 28 Nov 2023
Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusion Yuanxun Lu Jingyang Zhang Shiwei Li Tian Fang David McKinnon Yanghai Tsin Long Quan Xun Cao Yao Yao 20 35 0 27 Nov 2023
SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusion Hsuan-I Ho Jie Song Otmar Hilliges DiffM 11 31 0 27 Nov 2023
ET3D: Efficient Text-to-3D Generation via Multi-View Distillation Yiming Chen Zhiqi Li Peidong Liu 16 6 0 27 Nov 2023
Animate124: Animating One Image to 4D Dynamic Scene Yuyang Zhao Zhiwen Yan Enze Xie Lanqing Hong Zhenguo Li Gim Hee Lee VGen 32 62 0 24 Nov 2023
MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation Zhiqi Li Yiming Chen Lingzhe Zhao Peidong Liu 13 7 0 24 Nov 2023
GigaPose: Fast and Robust Novel Object Pose Estimation via One Correspondence Van Nguyen Nguyen Thibault Groueix Mathieu Salzmann Vincent Lepetit 3DPC 3DH 18 48 0 23 Nov 2023
Posterior Distillation Sampling Juil Koo Chanho Park Minhyuk Sung DiffM 13 25 0 23 Nov 2023
WildFusion: Learning 3D-Aware Latent Diffusion Models in View Space Katja Schwarz Seung Wook Kim Jun Gao Sanja Fidler Andreas Geiger Karsten Kreis 24 6 0 22 Nov 2023
Applications of Large Scale Foundation Models for Autonomous Driving Yu Huang Yue Chen Zhu Li ELM AI4CE LRM ALM LM&Ro 46 15 0 20 Nov 2023
GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noise Xinhai Li Huaibin Wang Kuo-Kun Tseng 3DGS 29 28 0 19 Nov 2023
MetaDreamer: Efficient Text-to-3D Creation With Disentangling Geometry and Texture Lincong Feng Muyu Wang Maoyu Wang Kuo Xu Xiaoli Liu 25 3 0 16 Nov 2023
3D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillation Dale Decatur Itai Lang Kfir Aberman Rana Hanocka 25 16 0 16 Nov 2023
Single-Image 3D Human Digitization with Shape-Guided Diffusion Badour Albahar Shunsuke Saito Hung-Yu Tseng Changil Kim Johannes Kopf Jia-Bin Huang DiffM 27 28 0 15 Nov 2023
DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model Yinghao Xu Hao Tan Fujun Luan Sai Bi Peng Wang ... Zifan Shi Kalyan Sunkavalli Gordon Wetzstein Zexiang Xu Kai Zhang 33 153 0 15 Nov 2023
Instant3D: Instant Text-to-3D Generation Ming Li Pan Zhou Jia-Wei Liu Jussi Keppo Min-Bin Lin Shuicheng Yan Xiangyu Xu 20 30 0 14 Nov 2023
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion Minghua Liu Ruoxi Shi Linghao Chen Zhuoyang Zhang Chao Xu Xinyue Wei Hansheng Chen Chong Zeng Jiayuan Gu Hao Su 26 188 0 14 Nov 2023
Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model Jiahao Li Hao Tan Kai Zhang Zexiang Xu Fujun Luan Yinghao Xu Yicong Hong Kalyan Sunkavalli Greg Shakhnarovich Sai Bi 43 254 0 10 Nov 2023
Consistent4D: Consistent 360° Dynamic Object Generation from Monocular Video Yanqin Jiang Li Zhang Jin Gao Weiming Hu Yao Yao VGen 24 57 0 06 Nov 2023
Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture Yixin Chen Junfeng Ni Nan Jiang Yaowei Zhang Yixin Zhu Siyuan Huang 3DV 17 21 0 01 Nov 2023
Text-to-3D with Classifier Score Distillation Xin Yu Yuanchen Guo Yangguang Li Ding Liang Song-Hai Zhang Xiaojuan Qi DiffM 29 83 0 30 Oct 2023
Gen2Sim: Scaling up Robot Learning in Simulation with Generative Models Pushkal Katara Zhou Xian Katerina Fragkiadaki LM&Ro 41 35 0 27 Oct 2023
ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image Kyle Sargent Zizhang Li Tanmay Shah Charles Herrmann Hong-Xing Yu ... Eric Ryan Chan Dmitry Lagun Fei-Fei Li Deqing Sun Jiajun Wu DiffM VGen 24 40 0 27 Oct 2023