Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation

1 December 2022

Gregory Shakhnarovich

DiffM

ArXiv PDF HTML

Papers citing "Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation"

50 / 454 papers shown

Title
Floating No More: Object-Ground Reconstruction from a Single Image Yunze Man Yichen Sheng Jianming Zhang Liangyan Gui Yu-xiong Wang 21 2 0 26 Jul 2024
DreamCar: Leveraging Car-specific Prior for in-the-wild 3D Car Reconstruction Xiaobiao Du Haiyang Sun Ming Lu Tianqing Zhu Xin Yu 28 2 0 24 Jul 2024
DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priors Zizheng Yan Jiapeng Zhou Fanpeng Meng Yushuang Wu Lingteng Qiu Zisheng Ye Shuguang Cui Guanying Chen Xiaoguang Han DiffM 31 4 0 23 Jul 2024
HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions Haiyang Zhou Xinhua Cheng Wangbo Yu Yonghong Tian Li-ming Yuan 3DGS DiffM 44 10 0 21 Jul 2024
Streetscapes: Large-scale Consistent Street View Generation Using Autoregressive Video Diffusion Boyang Deng Richard Tucker Zhengqi Li Leonidas J. Guibas Noah Snavely Gordon Wetzstein VGen 3DGS DiffM 29 11 0 18 Jul 2024
Connecting Consistency Distillation to Score Distillation for Text-to-3D Generation Zong-Han Li Minghui Hu Qian Zheng Xudong Jiang DiffM 26 6 0 18 Jul 2024
DiffuX2CT: Diffusion Learning to Reconstruct CT Images from Biplanar X-Rays Xuhui Liu Zhi Qiao Runkun Liu Hong Li Juan Zhang Xiantong Zhen Zhen Qian Baochang Zhang MedIm 32 2 0 18 Jul 2024
GenRC: Generative 3D Room Completion from Sparse Image Collections Ming-feng Li Yueh-Feng Ku Hong-Xuan Yen Chi Liu Yu-Lun Liu Albert Y. C. Chen Cheng-Hao Kuo Min Sun 3DV VGen 34 4 0 17 Jul 2024
SlimFlow: Training Smaller One-Step Diffusion Models with Rectified Flow Yuanzhi Zhu Xingchao Liu Qiang Liu 30 9 0 17 Jul 2024
4Dynamic: Text-to-4D Generation with Hybrid Priors Yu-Jie Yuan Leif Kobbelt Jiwen Liu Yuan Zhang Pengfei Wan Yu-Kun Lai Lin Gao 40 3 0 17 Jul 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 72 41 0 17 Jul 2024
Animate3D: Animating Any 3D Model with Multi-view Video Diffusion Yanqin Jiang Chaohui Yu Chenjie Cao Fan Wang Weiming Hu Jin Gao VGen 46 16 0 16 Jul 2024
Tree-D Fusion: Simulation-Ready Tree Dataset from Single Images with Diffusion Priors Jae Joong Lee Bosheng Li Sara Beery Jonathan Huang Songlin Fei Raymond A. Yeh Bedrich Benes 30 5 0 14 Jul 2024
VividDreamer: Invariant Score Distillation For Hyper-Realistic Text-to-3D Generation Wenjie Zhuo Fan Ma Hehe Fan Yi Yang DiffM 32 8 0 13 Jul 2024
Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Images Zhangyang Qi Yunhan Yang Mengchen Zhang Long Xing Xiaoyang Wu Tong Wu Dahua Lin Xihui Liu Jiaqi Wang Hengshuang Zhao DiffM 34 7 0 08 Jul 2024
VEGS: View Extrapolation of Urban Scenes in 3D Gaussian Splatting using Learned Priors Sungwon Hwang Min-Jung Kim Taewoong Kang Jayeon Kang Jaegul Choo 3DGS 33 10 0 03 Jul 2024
Meta 3D Gen Raphael Bensadoun Tom Monnier Yanir Kleiman Filippos Kokkinos Yawar Siddiqui ... Antoine Toisoul David Novotny Oran Gafni Natalia Neverova Andrea Vedaldi 48 0 0 02 Jul 2024
Meta 3D AssetGen: Text-to-Mesh Generation with High-Quality Geometry, Texture, and PBR Materials Yawar Siddiqui Tom Monnier Filippos Kokkinos Mahendra Kariya Yanir Kleiman ... Oran Gafni Natalia Neverova Andrea Vedaldi Roman Shapovalov David Novotny 48 28 0 02 Jul 2024
ScaleDreamer: Scalable Text-to-3D Synthesis with Asynchronous Score Distillation Zhiyuan Ma Yuxiang Wei Yabin Zhang Xiangyu Zhu Zhen Lei Lei Zhang DiffM 30 15 0 02 Jul 2024
TrAME: Trajectory-Anchored Multi-View Editing for Text-Guided 3D Gaussian Splatting Manipulation Chaofan Luo Donglin Di Xun Yang Yongjia Ma Zhou Xue Chen Wei Yebin Liu 3DGS 29 9 0 02 Jul 2024
OccFusion: Rendering Occluded Humans with Generative Diffusion Priors Adam Sun Tiange Xiang Scott Delp Li Fei-Fei Ehsan Adeli 29 2 0 29 Jun 2024
From Efficient Multimodal Models to World Models: A Survey Xinji Mai Zeng Tao Junxiong Lin Haoran Wang Yang Chang Yanlan Kang Yan Wang Wenqiang Zhang 26 5 0 27 Jun 2024
GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly Enhanced Quality Taoran Yi Jiemin Fang Zanwei Zhou Junjie Wang Guanjun Wu Lingxi Xie Xiaopeng Zhang Wenyu Liu Xinggang Wang Qi Tian 3DGS 31 8 0 26 Jun 2024
Director3D: Real-world Camera Trajectory and 3D Scene Generation from Text Xinyang Li Zhangyu Lai Linning Xu Yansong Qu Liujuan Cao Shengchuan Zhang Bo Dai Rongrong Ji VGen 47 8 0 25 Jun 2024
Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modeling Min-Seop Kwak Donghoon Ahn Ines Hyeonsu Kim Jin-Hwa Kim Seungryong Kim 11 2 0 24 Jun 2024
YouDream: Generating Anatomically Controllable Consistent Text-to-3D Animals Sandeep Mishra Oindrila Saha A. Bovik 24 0 0 24 Jun 2024
Text-based Transfer Function Design for Semantic Volume Rendering S. Jeong Jixian Li Christopher Johnson Shusen Liu Matthew Berger 13 1 0 21 Jun 2024
GeoLRM: Geometry-Aware Large Reconstruction Model for High-Quality 3D Gaussian Generation Chubin Zhang Hongliang Song Yi Wei Yu Chen Jiwen Lu Yansong Tang 3DGS 3DV 23 17 0 21 Jun 2024
A3D: Does Diffusion Dream about 3D Alignment? Savva Ignatyev Nina Konovalova Daniil Selikhanovych Nikolay Patakin Nikolay Patakin ... Anton Konushin Peter Wonka Alexander Filippov Peter Wonka Evgeny Burnaev DiffM 52 0 0 21 Jun 2024
Sampling 3D Gaussian Scenes in Seconds with Latent Diffusion Models Paul Henderson Melonie de Almeida D. Ivanova Titas Anciukevicius 3DGS 43 4 0 18 Jun 2024
HumanSplat: Generalizable Single-Image Human Gaussian Splatting with Structure Priors Panwang Pan Zhuo Su Chenguo Lin Zhen Fan Yongjie Zhang Zeming Li Tingting Shen Yadong Mu Yebin Liu 3DGS 37 18 0 18 Jun 2024
GenMM: Geometrically and Temporally Consistent Multimodal Data Generation for Video and LiDAR Bharat Singh Viveka Kulharia Luyu Yang Avinash Ravichandran Ambrish Tyagi Ashish Shrivastava VGen 29 2 0 15 Jun 2024
OrientDream: Streamlining Text-to-3D Generation with Explicit Orientation Control Yuzhong Huang Zhong Li Zhang Chen Zhiyuan Ren Guosheng Lin Fred Morstatter Yi Tian Xu 31 1 0 14 Jun 2024
Rethinking Score Distillation as a Bridge Between Image Distributions David McAllister Songwei Ge Jia-Bin Huang David W. Jacobs Alexei A. Efros Aleksander Holyñski Angjoo Kanazawa DiffM 51 14 0 13 Jun 2024
Neural Assets: 3D-Aware Multi-Object Scene Synthesis with Image Diffusion Models Ziyi Wu Yulia Rubanova Rishabh Kabra Drew A. Hudson Igor Gilitschenski Yusuf Aytar Sjoerd van Steenkiste Kelsey R. Allen Thomas Kipf VGen DiffM 31 10 0 13 Jun 2024
Preserving Identity with Variational Score for General-purpose 3D Editing Duong H. Le Tuan Pham Aniruddha Kembhavi Stephan Mandt Wei-Chiu Ma Jiasen Lu 27 0 0 13 Jun 2024
C3DAG: Controlled 3D Animal Generation using 3D pose guidance Sandeep Mishra Oindrila Saha A. Bovik 27 0 0 11 Jun 2024
4Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models Heng Yu Chaoyang Wang Peiye Zhuang Willi Menapace Aliaksandr Siarohin Junli Cao László A. Jeni Sergey Tulyakov Hsin-Ying Lee VGen 43 23 0 11 Jun 2024
Generative Lifting of Multiview to 3D from Unknown Pose: Wrapping NeRF inside Diffusion Xin Yuan Rana Hanocka Michael Maire DiffM 27 0 0 11 Jun 2024
NaRCan: Natural Refined Canonical Image with Integration of Diffusion Prior for Video Editing Ting-Hsuan Chen Jiewen Chan Hau-Shiang Shiu Shih-Han Yen Chang-Han Yeh Yu-Lun Liu VGen DiffM 38 3 0 10 Jun 2024
GTR: Improving Large 3D Reconstruction Models through Geometry and Texture Refinement Peiye Zhuang Songfang Han Chaoyang Wang Aliaksandr Siarohin Jiaxu Zou Michael Vasilkovsky V. Shakhrai Sergey Korolev Sergey Tulyakov Hsin-Ying Lee 3DV 49 6 0 09 Jun 2024
VP-LLM: Text-Driven 3D Volume Completion with Large Language Models through Patchification Jianmeng Liu Yichen Liu Yuyao Zhang Zeyuan Meng Yu-Wing Tai Chi-Keung Tang 42 0 0 08 Jun 2024
STAR: Skeleton-aware Text-based 4D Avatar Generation with In-Network Motion Retargeting Zenghao Chai Chen Tang Yongkang Wong Mohan Kankanhalli DiffM 24 7 0 07 Jun 2024
DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data Qihao Liu Yi Zhang Song Bai Adam Kortylewski Alan Yuille 34 9 0 06 Jun 2024
RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting Qi Wang Ruijie Lu Xudong Xu Jingbo Wang Michael Yu Wang Bo Dai Gang Zeng Dan Xu DiffM 33 6 0 04 Jun 2024
DreamPhysics: Learning Physical Properties of Dynamic 3D Gaussians with Video Diffusion Priors Tianyu Huang Yihan Zeng Hui Li Zhilu Zhang Rynson W. H. Lau Wangmeng Zuo Rynson W. H. Lau 3DGS VGen 27 5 0 03 Jun 2024
Freeplane: Unlocking Free Lunch in Triplane-Based Sparse-View Reconstruction Models Wenqiang Sun Zhengyi Wang Shuo Chen Yikai Wang Zilong Chen Jun Zhu Jun Zhang 43 1 0 02 Jun 2024
Lay-A-Scene: Personalized 3D Object Arrangement Using Text-to-Image Priors Ohad Rahamim Hilit Segev Idan Achituve Y. Atzmon Yoni Kasten Gal Chechik 44 4 0 02 Jun 2024
Bootstrap3D: Improving 3D Content Creation with Synthetic Data Zeyi Sun Tong Wu Pan Zhang Yuhang Zang Xiao-wen Dong Yuanjun Xiong Dahua Lin Jiaqi Wang 31 0 0 31 May 2024
Amortizing intractable inference in diffusion models for vision, language, and control S. Venkatraman Moksh Jain Luca Scimeca Minsu Kim Marcin Sendera ... Alexandre Adam Jarrid Rector-Brooks Yoshua Bengio Glen Berseth Nikolay Malkin 60 24 0 31 May 2024