Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 454 papers shown

Title
GenesisTex: Adapting Image Denoising Diffusion to Texture Space Chenjian Gao Boyan Jiang Xinghui Li Yingpeng Zhang Qian Yu DiffM 39 8 0 26 Mar 2024
DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusion Yuanze Lin Ronald Clark Philip H. S. Torr 3DGS 32 9 0 25 Mar 2024
VP3D: Unleashing 2D Visual Prompt for Text-to-3D Generation Yang Chen Yingwei Pan Haibo Yang Ting Yao Tao Mei DiffM 34 18 0 25 Mar 2024
Comp4D: LLM-Guided Compositional 4D Scene Generation Dejia Xu Hanwen Liang N. Bhatt Hezhen Hu Hanxue Liang Konstantinos N. Plataniotis Zhangyang Wang 34 23 0 25 Mar 2024
Make-It-Vivid: Dressing Your Animatable Biped Cartoon Characters from Text Junshu Tang Yanhong Zeng Ke Fan Xuheng Wang Bo Dai Kai Chen Lizhuang Ma 18 7 0 25 Mar 2024
InterFusion: Text-Driven Generation of 3D Human-Object Interaction Sisi Dai Wenhao Li Haowen Sun Haibin Huang Chongyang Ma Hui Huang Kai Xu Ruizhen Hu 23 7 0 22 Mar 2024
LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesis Kevin Xie Jonathan Lorraine Tianshi Cao Jun Gao James Lucas Antonio Torralba Sanja Fidler Xiaohui Zeng DiffM 23 36 0 22 Mar 2024
DreamFlow: High-Quality Text-to-3D Generation by Approximating Probability Flow Kyungmin Lee Kihyuk Sohn Jinwoo Shin 35 19 0 22 Mar 2024
STAG4D: Spatial-Temporal Anchored Generative 4D Gaussians Yifei Zeng Yanqin Jiang Siyu Zhu Yuanxun Lu Youtian Lin Hao Zhu Weiming Hu Xun Cao Yao Yao 3DGS 71 45 0 22 Mar 2024
GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation Yinghao Xu Zifan Shi Wang Yifan Hansheng Chen Ceyuan Yang Sida Peng Yujun Shen Gordon Wetzstein 3DV 3DGS 32 148 0 21 Mar 2024
DreamReward: Text-to-3D Generation with Human Preference Junliang Ye Fangfu Liu Qixiu Li Zhengyi Wang Yikai Wang Xinzhou Wang Yueqi Duan Jun Zhu 66 21 0 21 Mar 2024
SyncTweedies: A General Generative Framework Based on Synchronized Diffusions Jaihoon Kim Juil Koo Kyeongmin Yeo Minhyuk Sung DiffM 3DGS 32 9 0 21 Mar 2024
Text-to-3D Shape Generation Han-Hung Lee Manolis Savva Angel X. Chang 32 11 0 20 Mar 2024
BAGS: Building Animatable Gaussian Splatting from a Monocular Video with Diffusion Priors Tingyang Zhang Qingzhe Gao Weiyu Li Libin Liu Baoquan Chen DiffM 3DGS VGen 16 9 0 18 Mar 2024
BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesis Lutao Jiang Lin Wang 3DGS 62 14 0 17 Mar 2024
3D-SceneDreamer: Text-Driven 3D-Consistent Scene Generation Frank Zhang Yibo Zhang Quan Zheng R. Ma W. Hua Hujun Bao Weiwei Xu Changqing Zou 49 9 0 14 Mar 2024
Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior Cheng Chen Xiaofeng Yang Fan Yang Chengzeng Feng Zhoujie Fu Chuan-Sheng Foo Guosheng Lin Fayao Liu 48 13 0 14 Mar 2024
Envision3D: One Image to 3D with Anchor Views Interpolation Yatian Pang Tanghui Jia Yujun Shi Zhenyu Tang Junwu Zhang Xinhua Cheng Xing Zhou Francis E. H. Tay Li-xin Yuan 40 8 0 13 Mar 2024
Fast Text-to-3D-Aware Face Generation and Manipulation via Direct Cross-modal Mapping and Geometric Regularization Jinlu Zhang Yiyi Zhou Qiancheng Zheng Xiaoxiong Du Gen Luo Jun Peng Xiaoshuai Sun Rongrong Ji 3DH 20 3 0 11 Mar 2024
3D-aware Image Generation and Editing with Multi-modal Conditions Bo Li Yike Li Zhien He Bin Liu Yu-Kun Lai 29 2 0 11 Mar 2024
Enhancing Texture Generation with High-Fidelity Using Advanced Texture Priors Kuo Xu Maoyu Wang Muyu Wang Lincong Feng Tianhui Zhang Xiaoli Liu 27 1 0 08 Mar 2024
CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model Zhengyi Wang Yikai Wang Yifei Chen Chendong Xiang Shuo Chen Dajiang Yu Chongxuan Li Hang Su Jun Zhu 33 123 0 08 Mar 2024
3DTextureTransformer: Geometry Aware Texture Generation for Arbitrary Mesh Topology K. Dharma Clayton T. Morrison 30 0 0 07 Mar 2024
3DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priors Fangzhou Hong Jiaxiang Tang Ziang Cao Min Shi Tong Wu ... Shuai Yang Tengfei Wang Liang Pan Dahua Lin Ziwei Liu 30 44 0 04 Mar 2024
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models Lukas Höllein Aljavz Bovzivc Norman Muller David Novotny Hung-Yu Tseng Christian Richardt Michael Zollhöfer Matthias Nießner DiffM 39 39 0 04 Mar 2024
HyperSDFusion: Bridging Hierarchical Structures in Language and Geometry for Enhanced 3D Text2Shape Generation Zhiying Leng Tolga Birdal Xiaohui Liang Federico Tombari 39 3 0 01 Mar 2024
ViewFusion: Towards Multi-View Consistency via Interpolated Denoising Xianghui Yang Yan Zuo Sameera Ramasinghe Loris Bazzani Gil Avraham A. Hengel DiffM 35 5 0 29 Feb 2024
A Quantitative Evaluation of Score Distillation Sampling Based Text-to-3D Xiaohan Fei Chethan Parameshwara Jiawei Mo Xiaolong Li Ashwin Swaminathan C. Taylor Paolo Favaro Stefano Soatto DiffM EGVM 28 0 0 29 Feb 2024
CharacterGen: Efficient 3D Character Generation from Single Images with Multi-View Pose Canonicalization Haoyue Peng Jia-Peng Zhang Meng-Hao Guo Yan-Pei Cao Shi-Min Hu DiffM 32 11 0 27 Feb 2024
CharNeRF: 3D Character Generation from Concept Art Eddy Chu Yiyang Chen Chedy Raissi Anand Bhojan 3DH 16 1 0 27 Feb 2024
Disentangled 3D Scene Generation with Layout Learning Dave Epstein Ben Poole B. Mildenhall Alexei A. Efros Aleksander Holynski CoGe OCL 3DV 40 20 0 26 Feb 2024
MVD $^2$ : Efficient Multiview 3D Reconstruction for Multiview Diffusion Xin-Yang Zheng Hao Pan Yufeng Guo Xin Tong Yang Liu DiffM 31 22 0 22 Feb 2024
FlashTex: Fast Relightable Mesh Texturing with LightControlNet Kangle Deng Timothy Omernick Alexander Weiss Deva Ramanan Jun-Yan Zhu Tinghui Zhou Maneesh Agrawala 37 27 0 20 Feb 2024
GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering Abdullah Hamdi Luke Melas-Kyriazi Jinjie Mai Guocheng Qian Ruoshi Liu Carl Vondrick Bernard Ghanem Andrea Vedaldi 3DGS 17 43 0 15 Feb 2024
GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting Xiaoyu Zhou Xingjian Ran Yajiao Xiong Jinlin He Zhiwei Lin Yongtao Wang Deqing Sun Ming-Hsuan Yang 3DGS 14 54 0 11 Feb 2024
HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting Zhen Zhou Fan Ma Hehe Fan Yi Yang 3DGS 27 23 0 09 Feb 2024
SPAD : Spatially Aware Multiview Diffusers Yash Kant Ziyi Wu Michael Vasilkovsky Guocheng Qian Jian Ren R. A. Guler Bernard Ghanem Sergey Tulyakov Igor Gilitschenski Aliaksandr Siarohin DiffM 22 34 0 07 Feb 2024
Denoising Diffusion via Image-Based Rendering Titas Anciukevicius Fabian Manhardt Federico Tombari Paul Henderson 40 11 0 05 Feb 2024
Retrieval-Augmented Score Distillation for Text-to-3D Generation Junyoung Seo Susung Hong Wooseok Jang Ines Hyeonsu Kim Minseop Kwak Doyup Lee Seungryong Kim 57 9 0 05 Feb 2024
ID-NeRF: Indirect Diffusion-guided Neural Radiance Fields for Generalizable View Synthesis Yaokun Li Chao Gou Guang Tan DiffM 17 0 0 02 Feb 2024
AToM: Amortized Text-to-Mesh using 2D Diffusion Guocheng Qian Junli Cao Aliaksandr Siarohin Yash Kant Chaoyang Wang ... Igor Gilitschenski Jian Ren Bernard Ghanem Kfir Aberman Sergey Tulyakov DiffM 34 15 0 01 Feb 2024
Plug-and-Play image restoration with Stochastic deNOising REgularization Marien Renaud Jean Prost Arthur Leclaire Nicolas Papadakis DiffM 44 7 0 01 Feb 2024
ReplaceAnything3D:Text-Guided 3D Scene Editing with Compositional Neural Radiance Fields Edward Bartrum Thu Nguyen-Phuoc Christopher Xie Zhengqin Li Numair Khan A. Avetisyan Douglas Lanman Lei Xiao DiffM 35 4 0 31 Jan 2024
Advances in 3D Generation: A Survey Xiaoyu Li Qi Zhang Di Kang Weihao Cheng Yiming Gao Jingbo Zhang Zhihao Liang Jing Liao Yan-Pei Cao Ying Shan 37 38 0 31 Jan 2024
BoostDream: Efficient Refining for High-Quality Text-to-3D Generation from Multi-View Diffusion Yonghao Yu Shunan Zhu Huai Qin Haorui Li Jinglu Hu 21 7 0 30 Jan 2024
DressCode: Autoregressively Sewing and Generating Garments from Text Guidance Kai He Kaixin Yao Qixuan Zhang Jingyi Yu Lingjie Liu Lan Xu AI4CE 102 23 0 29 Jan 2024
Sketch2NeRF: Multi-view Sketch-guided Text-to-3D Generation Minglin Chen Weihao Yuan Yukun Wang Zhe Sheng Yisheng He Zilong Dong Liefeng Bo Yulan Guo DiffM 13 4 0 25 Jan 2024
TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusion Yu-Ying Yeh Jia-Bin Huang Changil Kim Lei Xiao Thu Nguyen-Phuoc ... Cheng Zhang Manmohan Chandraker Carl S. Marshall Zhao Dong Zhengqin Li DiffM 22 30 0 17 Jan 2024
Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Prior Zike Wu Pan Zhou Xuanyu Yi Xiaoding Yuan Hanwang Zhang DiffM 23 36 0 17 Jan 2024
Diffusion Priors for Dynamic View Synthesis from Monocular Videos Chaoyang Wang Peiye Zhuang Aliaksandr Siarohin Junli Cao Guocheng Qian Hsin-Ying Lee Sergey Tulyakov VGen DiffM 21 12 0 10 Jan 2024