Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 454 papers shown

Title
Score Distillation Sampling with Learned Manifold Corrective Thiemo Alldieck Nikos Kolotouros C. Sminchisescu DiffM 39 13 0 10 Jan 2024
GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generation Tong Wu Guandao Yang Zhibing Li Kai Zhang Ziwei Liu Leonidas J. Guibas Dahua Lin Gordon Wetzstein EGVM VGen 21 87 0 08 Jan 2024
Latte: Latent Diffusion Transformer for Video Generation Xin Ma Yaohui Wang Gengyun Jia Xinyuan Chen Z. Liu Yuan-Fang Li Cunjian Chen Yu Qiao DiffM VGen 123 233 0 05 Jan 2024
What You See is What You GAN: Rendering Every Pixel for High-Fidelity Geometry in 3D GANs Alex Trevithick Matthew Chan Towaki Takikawa Umar Iqbal Shalini De Mello Manmohan Chandraker Ravi Ramamoorthi Koki Nagano 3DV 46 6 0 04 Jan 2024
Image Sculpting: Precise Object Editing with 3D Geometry Control Jiraphon Yenphraphai Xichen Pan Sainan Liu Daniele Panozzo Saining Xie 30 17 0 02 Jan 2024
GD^2-NeRF: Generative Detail Compensation via GAN and Diffusion for One-shot Generalizable Neural Radiance Fields X. Pan Zongxin Yang Shuai Bai Yi Yang DiffM OffRL 18 1 0 01 Jan 2024
SteinDreamer: Variance Reduction for Text-to-3D Score Distillation via Stein Identity Peihao Wang Zhiwen Fan Dejia Xu Dilin Wang Sreyas Mohan ... Rakesh Ranjan Yilei Li Qiang Liu Zhangyang Wang Vikas Chandra 20 21 0 31 Dec 2023
Taming Mode Collapse in Score Distillation for Text-to-3D Generation Peihao Wang Dejia Xu Zhiwen Fan Dilin Wang Sreyas Mohan ... Rakesh Ranjan Yilei Li Qiang Liu Zhangyang Wang Vikas Chandra DiffM 23 27 0 31 Dec 2023
iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views Chin-Hsuan Wu Yen-Chun Chen Bolivar Solarte Lu Yuan Min Sun 19 9 0 28 Dec 2023
4DGen: Grounded 4D Content Generation with Spatial-temporal Consistency Yuyang Yin Dejia Xu Zhangyang Wang Yao-Min Zhao Yunchao Wei 3DGS 47 72 0 28 Dec 2023
SVGDreamer: Text Guided SVG Generation with Diffusion Model Ximing Xing Haitao Zhou Chuang Wang Jing Zhang Dong Xu Qian Yu DiffM 24 29 0 27 Dec 2023
HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3D Sangmin Woo Byeongjun Park Hyojun Go Jin-Young Kim Changick Kim 35 23 0 26 Dec 2023
Hyper-VolTran: Fast and Generalizable One-Shot Image to 3D Object Structure via HyperNetworks Christian Simon Sen He Juan-Manuel Perez-Rua Mengmeng Xu Amine Benhalloum Tao Xiang 15 2 0 24 Dec 2023
PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar Tzofi Klinghoffer Xiaoyu Xiang S. Somasundaram Yuchen Fan Christian Richardt Ramesh Raskar Rakesh Ranjan 23 6 0 21 Dec 2023
Carve3D: Improving Multi-view Reconstruction Consistency for Diffusion Models with RL Finetuning Desai Xie Jiahao Li Hao Tan Xin Sun Zhixin Shu Yi Zhou Sai Bi Soren Pirk Arie E. Kaufman 24 8 0 21 Dec 2023
Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models Huan Ling Seung Wook Kim Antonio Torralba Sanja Fidler Karsten Kreis DiffM 3DGS 32 111 0 21 Dec 2023
ZeroShape: Regression-based Zero-shot Shape Reconstruction Zixuan Huang Stefan Stojanov Anh Thai Varun Jampani James M. Rehg 3DV 17 22 0 21 Dec 2023
Repaint123: Fast and High-quality One Image to 3D Generation with Progressive Controllable 2D Repainting Junwu Zhang Zhenyu Tang Yatian Pang Xinhua Cheng Peng Jin Yida Wei Munan Ning Li-ming Yuan DiffM 3DGS 14 23 0 20 Dec 2023
ShowRoom3D: Text to High-Quality 3D Room Generation Using 3D Priors Weijia Mao Yan-Pei Cao Jia-Wei Liu Zhongcong Xu Mike Zheng Shou DiffM 43 5 0 20 Dec 2023
Text-Image Conditioned Diffusion for Consistent Text-to-3D Generation Yuze He Yushi Bai M. Lin Jenny Sheng Yubin Hu Qi Wang Yu-Hui Wen Yong-Jin Liu 23 1 0 19 Dec 2023
Scene-Conditional 3D Object Stylization and Composition Jinghao Zhou Tomas Jakab Philip H. S. Torr Christian Rupprecht DiffM 65 2 0 19 Dec 2023
Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Rendering Youwang Kim Tae-Hyun Oh Gerard Pons-Moll DiffM 17 46 0 18 Dec 2023
MVHuman: Tailoring 2D Diffusion with Multi-view Sampling For Realistic 3D Human Generation Suyi Jiang Haimin Luo Haoran Jiang Ziyu Wang Jingyi Yu Lan Xu 71 3 0 15 Dec 2023
Stable Score Distillation for High-Quality 3D Generation Boshi Tang Jianan Wang Zhiyong Wu Lei Zhang 16 15 0 14 Dec 2023
Text2Immersion: Generative Immersive Scene with 3D Gaussians Ouyang Hao Kathryn Heal Stephen Lombardi Tiancheng Sun 3DGS 28 27 0 14 Dec 2023
Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers Zi-Xin Zou Zhipeng Yu Yuanchen Guo Yangguang Li Ding Liang Yan-Pei Cao Song-Hai Zhang 3DGS 29 173 0 14 Dec 2023
PI3D: Efficient Text-to-3D Generation with Pseudo-Image Diffusion Ying-Tian Liu Yuanchen Guo Guan Luo Heyi Sun Wei Yin Song-Hai Zhang 24 18 0 14 Dec 2023
VaLID: Variable-Length Input Diffusion for Novel View Synthesis Shijie Li F. G. Zanjani H. Yahia Yuki M. Asano Juergen Gall A. Habibian DiffM 11 5 0 14 Dec 2023
Efficient-NeRF2NeRF: Streamlining Text-Driven 3D Editing with Multiview Correspondence-Enhanced Diffusion Models Liangchen Song Liangliang Cao Jiatao Gu Yifan Jiang Junsong Yuan Hao Tang DiffM 13 13 0 13 Dec 2023
SceneWiz3D: Towards Text-guided 3D Scene Composition Qihang Zhang Chaoyang Wang Aliaksandr Siarohin Peiye Zhuang Yinghao Xu Ceyuan Yang Dahua Lin Bolei Zhou Sergey Tulyakov Hsin-Ying Lee 20 31 0 13 Dec 2023
SEEAvatar: Photorealistic Text-to-3D Avatar Generation with Constrained Geometry and Appearance Yuanyou Xu Zongxin Yang Yi Yang 25 26 0 13 Dec 2023
HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillation Hongyu Liu Xuan Wang Ziyu Wan Yujun Shen Yibing Song Jing Liao Qifeng Chen DiffM 36 17 0 12 Dec 2023
MinD-3D: Reconstruct High-quality 3D objects in Human Brain Jianxiong Gao Yu Fu Yun Wang Xuelin Qian Jianfeng Feng Yanwei Fu DiffM 17 6 0 12 Dec 2023
NVS-Adapter: Plug-and-Play Novel View Synthesis from a Single Image Yoonwoo Jeong Jinwoo Lee Chiheon Kim Minsu Cho Doyup Lee 19 3 0 12 Dec 2023
CAD: Photorealistic 3D Generation via Adversarial Distillation Ziyu Wan Despoina Paschalidou Ian Huang Hongyu Liu Bokui Shen Xiaoyu Xiang Jing Liao Leonidas J. Guibas DiffM 74 11 0 11 Dec 2023
UpFusion: Novel View Diffusion from Unposed Sparse View Observations Bharath Raj Nagoor Kani Hsin-Ying Lee Sergey Tulyakov Shubham Tulsiani 36 5 0 11 Dec 2023
Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior Fangfu Liu Diankun Wu Yi Wei Yongming Rao Yueqi Duan DiffM 11 23 0 11 Dec 2023
EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusion Zehuan Huang Hao Wen Junting Dong Yaohui Wang Yangguang Li ... Yan-Pei Cao Ding Liang Yu Qiao Bo Dai Lu Sheng 23 33 0 11 Dec 2023
Large Scale Foundation Models for Intelligent Manufacturing Applications: A Survey Haotian Zhang S. D. Semujju Zhicheng Wang Xianwei Lv Kang Xu ... Jing Wu Zhuo Long Wensheng Liang Xiaoguang Ma Ruiyan Zhuang UQCV AI4TS AI4CE 27 4 0 11 Dec 2023
Optimized View and Geometry Distillation from Multi-view Diffuser Youjia Zhang Zikai Song Junqing Yu Yawei Luo Wei Yang 21 0 0 11 Dec 2023
SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation Thuan Hoang Nguyen Anh Tran DiffM 18 55 0 08 Dec 2023
Disentangled Clothed Avatar Generation from Text Descriptions Jiong-Qi Wang Yuan Liu Zhiyang Dou Zhengming Yu Yongqing Liang Xin Li Wenping Wang Rong Xie Li-Na Song 23 21 0 08 Dec 2023
ControlRoom3D: Room Generation using Semantic Proxy Rooms Jonas Schult Sam S. Tsai Lukas Höllein Bichen Wu Jialiang Wang ... Zijian He Peizhao Zhang Bastian Leibe Peter Vajda Ji Hou 17 31 0 08 Dec 2023
Learn to Optimize Denoising Scores for 3D Generation: A Unified and Improved Diffusion Prior on NeRF and 3D Gaussian Splatting Xiaofeng Yang Yiwen Chen Cheng Chen Chi Zhang Yi Tian Xu Xulei Yang Fayao Liu Guosheng Lin 3DGS DiffM 21 18 0 08 Dec 2023
RL Dreams: Policy Gradient Optimization for Score Distillation based 3D Generation Aradhya Neeraj Mathur Phu-Cuong Pham Aniket Bera Ojaswa Sharma 19 0 0 08 Dec 2023
NeuSD: Surface Completion with Multi-View Text-to-Image Diffusion Savva Ignatyev Daniil Selikhanovych Oleg Voynov Yiqun Wang Peter Wonka Stamatios Lefkimmiatis Evgeny Burnaev 16 0 0 07 Dec 2023
NeRFiller: Completing Scenes via Generative 3D Inpainting Ethan Weber Aleksander Holyñski Varun Jampani Saurabh Saxena Noah Snavely Abhishek Kar Angjoo Kanazawa 60 30 0 07 Dec 2023
Cascade-Zero123: One Image to Highly Consistent 3D with Self-Prompted Nearby Views Yabo Chen Jiemin Fang Yuyang Huang Taoran Yi Xiaopeng Zhang Lingxi Xie Xinggang Wang Wenrui Dai Hongkai Xiong Qi Tian DiffM 22 20 0 07 Dec 2023
Text-to-3D Generation with Bidirectional Diffusion using both 2D and 3D priors Lihe Ding Shaocong Dong Zhanpeng Huang Zibin Wang Yiyuan Zhang Kaixiong Gong Dan Xu Tianfan Xue 19 17 0 07 Dec 2023
Resolution Chromatography of Diffusion Models Juno Hwang Yong-Hyun Park Junghyo Jo DiffM 21 1 0 07 Dec 2023