Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 454 papers shown

Title
Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image Kailu Wu Fangfu Liu Zhihan Cai Runjie Yan Hanyang Wang Yating Hu Yueqi Duan Kaisheng Ma 31 52 0 30 May 2024
GECO: Generative Image-to-3D within a SECOnd Chen Wang Jiatao Gu Xiaoxiao Long Yuan Liu Lingjie Liu 31 5 0 30 May 2024
PLA4D: Pixel-Level Alignments for Text-to-4D Gaussian Splatting Qiaowei Miao Yawei Luo Yi Yang 3DGS DiffM 36 7 0 30 May 2024
TetSphere Splatting: Representing High-Quality Geometry with Lagrangian Volumetric Meshes Minghao Guo Bohan Wang Kaiming He Wojciech Matusik 3DGS 83 6 0 30 May 2024
REPARO: Compositional 3D Assets Generation with Differentiable 3D Layout Alignment Haonan Han Rui Yang Huan Liao Jiankai Xing Zunnan Xu Xiao-Qing Yu Junwei Zha Xiu Li Wanhua Li DiffM 35 5 0 28 May 2024
Atlas3D: Physically Constrained Self-Supporting Text-to-3D for Simulation and Fabrication Yunuo Chen Tianyi Xie Zeshun Zong Xuan Li Feng Gao Yin Yang Yingnian Wu Chenfanfu Jiang 41 6 0 28 May 2024
Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priors Soumava Paul Christopher Wewer Bernt Schiele J. E. Lenssen 3DGS 33 3 0 26 May 2024
Score Distillation via Reparametrized DDIM Artem Lukoianov Haitz Sáez de Ocáriz Borde Kristjan Greenewald Vitor Campagnolo Guizilini Timur M. Bagautdinov Vincent Sitzmann Justin Solomon DiffM 25 17 0 24 May 2024
NIVeL: Neural Implicit Vector Layers for Text-to-Vector Generation Vikas Thamizharasan Difan Liu Matthew Fisher Nanxuan Zhao E. Kalogerakis Michal Lukac DiffM 14 5 0 24 May 2024
Diff3DS: Generating View-Consistent 3D Sketch via Differentiable Curve Rendering Yibo Zhang Lihong Wang Changqing Zou Tieru Wu Rui Ma DiffM 33 1 0 24 May 2024
PuzzleAvatar: Assembling 3D Avatars from Personal Albums Yuliang Xiu Yufei Ye Zhen Liu Dimitrios Tzionas Michael J. Black 34 9 0 23 May 2024
Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis Basile Van Hoorick Rundi Wu Ege Ozguroglu Kyle Sargent Ruoshi Liu P. Tokmakov Achal Dave Changxi Zheng Carl Vondrick DiffM VGen 44 29 0 23 May 2024
Improved Distribution Matching Distillation for Fast Image Synthesis Tianwei Yin Michael Gharbi Taesung Park Richard Zhang Eli Shechtman Frédo Durand William T. Freeman DiffM 23 92 0 23 May 2024
Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attention Peng Li Yuan-Bin Liu Xiaoxiao Long Feihu Zhang Cheng Lin ... Wenhan Luo Ping Tan Wenping Wang Qi-fei Liu Yi-Ting Guo VGen 69 39 0 19 May 2024
Dreamer XL: Towards High-Resolution Text-to-3D Generation via Trajectory Score Matching Xingyu Miao Haoran Duan Varun Ojha Jun Song Tejal Shah Yang Long R. Ranjan 24 3 0 18 May 2024
ART3D: 3D Gaussian Splatting for Text-Guided Artistic Scenes Generation Pengzhi Li Chengshuai Tang Qinxuan Huang Zhiheng Li 3DGS 41 12 0 17 May 2024
Dual3D: Efficient and Consistent Text-to-3D Generation with Dual-mode Multi-view Latent Diffusion Xinyang Li Zhangyu Lai Linning Xu Jianfei Guo Liujuan Cao Shengchuan Zhang Bo Dai Rongrong Ji DiffM 38 8 0 16 May 2024
Flow Score Distillation for Diverse Text-to-3D Generation Runjie Yan Kailu Wu Kaisheng Ma 18 3 0 16 May 2024
A Survey On Text-to-3D Contents Generation In The Wild Chenhan Jiang 27 5 0 15 May 2024
DiffTF++: 3D-aware Diffusion Transformer for Large-Vocabulary 3D Generation Ziang Cao Fangzhou Hong Tong Wu Liang Pan Ziwei Liu 14 2 0 13 May 2024
Coin3D: Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioning Wenqi Dong Bangbang Yang Lin Ma Xiao Liu Liyuan Cui Hujun Bao Yuewen Ma Zhaopeng Cui DiffM 27 9 0 13 May 2024
X-Oscar: A Progressive Framework for High-quality Text-guided 3D Animatable Avatar Generation Yiwei Ma Zhekai Lin Jiayi Ji Yijun Fan Xiaoshuai Sun Rongrong Ji 31 7 0 02 May 2024
Learning to Compose: Improving Object Centric Learning by Injecting Compositionality Whie Jung Jaehoon Yoo Sungjin Ahn Seunghoon Hong OCL CoGe 24 4 0 01 May 2024
$MicroDreamer: Zero-shot 3D Generation in $\sim$20 Seconds by Score-based Iterative Reconstruction$ MicroDreamer: Zero-shot 3D Generation in $\sim$ 20 Seconds by Score-based Iterative Reconstruction Luxi Chen Zhengyi Wang Zihan Zhou Tingting Gao Hang Su Jun Zhu Chongxuan Li DiffM 3DGS 29 1 0 30 Apr 2024
Grounded Compositional and Diverse Text-to-3D with Pretrained Multi-View Diffusion Model Xiaolong Li Jiawei Mo Ying Wang Chethan Parameshwara Xiaohan Fei Ashwin Swaminathan C. Taylor Zhuowen Tu Paolo Favaro Stefano Soatto 45 4 0 28 Apr 2024
Interactive3D: Create What You Want by Interactive 3D Generation Shaocong Dong Lihe Ding Zhanpeng Huang Zibin Wang Tianfan Xue Dan Xu 19 10 0 25 Apr 2024
Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses Inhee Lee Byungjun Kim Hanbyul Joo 3DGS 52 5 0 22 Apr 2024
X-Ray: A Sequential 3D Representation For Generation Tao Hu Wenhang Ge Yuyang Zhao Gim Hee Lee MedIm 18 4 0 22 Apr 2024
G-HOP: Generative Hand-Object Prior for Interaction Reconstruction and Grasp Synthesis Yufei Ye Abhinav Gupta Kris M. Kitani Shubham Tulsiani 18 16 0 18 Apr 2024
Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinement Chi-Yin Wang Junming Huang Rong Zhang Qi Wang Haotian Yang Haibin Huang Chongyang Ma Weiwei Xu 3DH 36 2 0 15 Apr 2024
DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling Xuening Yuan Hongyu Yang Yueming Zhao Di Huang 3DGS 49 3 0 14 Apr 2024
Probing the 3D Awareness of Visual Foundation Models Mohamed El Banani Amit Raj Kevis-Kokitsi Maninis Abhishek Kar Yuanzhen Li Michael Rubinstein Deqing Sun Leonidas J. Guibas Justin Johnson Varun Jampani 25 79 0 12 Apr 2024
InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models Jiale Xu Weihao Cheng Yiming Gao Xintao Wang Shenghua Gao Ying Shan 3DGS 33 39 0 10 Apr 2024
Move Anything with Layered Scene Diffusion Jiawei Ren Mengmeng Xu Jui-Chieh Wu Ziwei Liu Tao Xiang Antoine Toisoul 14 9 0 10 Apr 2024
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion Jaidev Shriram Alex Trevithick Lingjie Liu Ravi Ramamoorthi DiffM 3DGS 62 54 0 10 Apr 2024
DreamView: Injecting View-specific Text Guidance into Text-to-3D Generation Junkai Yan Yipeng Gao Q. Yang Xihan Wei Xuansong Xie Ancong Wu Wei-Shi Zheng 22 1 0 09 Apr 2024
Hash3D: Training-free Acceleration for 3D Generation Xingyi Yang Xinchao Wang 3DGS 28 10 0 09 Apr 2024
Diffusion Time-step Curriculum for One Image to 3D Generation Xuanyu Yi Zike Wu Qingshan Xu Pan Zhou Joo-Hwee Lim Hanwang Zhang 53 19 0 06 Apr 2024
DATENeRF: Depth-Aware Text-based Editing of NeRFs Sara Rojas Julien Philip Kai Zhang Sai Bi Fujun Luan Bernard Ghanem Kalyan Sunkavalli DiffM 27 3 0 06 Apr 2024
Idea-2-3D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs Junhao Chen Xiang Li Xiaojun Ye Chao Li Zhaoxin Fan Hao Zhao VGen 3DV 193 4 0 05 Apr 2024
SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfer Zijie Wu Chaohui Yu Yanqin Jiang Chenjie Cao Fan Wang Xiang Bai 3DGS 31 22 0 04 Apr 2024
MVD-Fusion: Single-view 3D via Depth-consistent Multi-view Generation Hanzhe Hu Zhizhuo Zhou Varun Jampani Shubham Tulsiani MDE 39 21 0 04 Apr 2024
The More You See in 2D, the More You Perceive in 3D Xinyang Han Zelin Gao Angjoo Kanazawa Shubham Goel Yossi Gandelsman DiffM 41 3 0 04 Apr 2024
AWOL: Analysis WithOut synthesis using Language Silvia Zuffi Michael J. Black 33 2 0 03 Apr 2024
MatAtlas: Text-driven Consistent Geometry Texturing and Material Assignment Duygu Ceylan Valentin Deschaintre Thibault Groueix Rosalie Martin C. Huang Romain Rouffet Vladimir G. Kim Gaetan Lassagne DiffM 16 8 0 03 Apr 2024
MagicMirror: Fast and High-Quality Avatar Generation with a Constrained Search Space Armand Comas Massague Di Qiu Menglei Chai Marcel C. Bühler Amit Raj ... Mark Matthews Paulo F. U. Gotardo Octavia Camps Sergio Orts Thabo Beeler 35 1 0 01 Apr 2024
FlexiDreamer: Single Image-to-3D Generation with FlexiCubes Ruowen Zhao Zhengyi Wang Yikai Wang Zihan Zhou Jun Zhu 39 8 0 01 Apr 2024
DiSR-NeRF: Diffusion-Guided View-Consistent Super-Resolution NeRF Jie Long Lee Chen Li Gim Hee Lee 21 6 0 01 Apr 2024
Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation Yujin Chen Yinyu Nie Benjamin Ummenhofer R. Birkl Michael Paulitsch Matthias Müller Matthias Nießner AI4CE 29 3 0 28 Mar 2024
TC4D: Trajectory-Conditioned Text-to-4D Generation Sherwin Bahmani Xian Liu Yifan Wang Ivan Skorokhodov Victor Rong ... Jeong Joon Park Sergey Tulyakov Gordon Wetzstein Andrea Tagliasacchi David B. Lindell 94 34 0 26 Mar 2024