CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation

6 October 2021

Joseph G. Lambourne

Kamal Rahimi Malekshan

CLIP

ArXiv PDF HTML

Papers citing "CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation"

50 / 234 papers shown

Title
Intelligent Generation of Graphical Game Assets: A Conceptual Framework and Systematic Review of the State of the Art Kaisei Fukaya Damon Daylamani-Zad Harry Agius 34 2 0 16 Nov 2023
MetaDreamer: Efficient Text-to-3D Creation With Disentangling Geometry and Texture Lincong Feng Muyu Wang Maoyu Wang Kuo Xu Xiaoli Liu 19 3 0 16 Nov 2023
Instant3D: Instant Text-to-3D Generation Ming Li Pan Zhou Jia-Wei Liu Jussi Keppo Min-Bin Lin Shuicheng Yan Xiangyu Xu 15 30 0 14 Nov 2023
One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion Minghua Liu Ruoxi Shi Linghao Chen Zhuoyang Zhang Chao Xu Xinyue Wei Hansheng Chen Chong Zeng Jiayuan Gu Hao Su 23 186 0 14 Nov 2023
Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model Jiahao Li Hao Tan Kai Zhang Zexiang Xu Fujun Luan Yinghao Xu Yicong Hong Kalyan Sunkavalli Greg Shakhnarovich Sai Bi 22 253 0 10 Nov 2023
Sculpting Holistic 3D Representation in Contrastive Language-Image-3D Pre-training Yipeng Gao Zeyu Wang Wei-Shi Zheng Cihang Xie Yuyin Zhou 3DPC 16 8 0 03 Nov 2023
EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generation Zhengzhe Liu Jingyu Hu Ka-Hei Hui Xiaojuan Qi Daniel Cohen-Or Chi-Wing Fu 51 9 0 03 Nov 2023
HyperFields: Towards Zero-Shot Generation of NeRFs from Text Sudarshan Babu Richard Liu Avery Zhou Michael Maire Greg Shakhnarovich Rana Hanocka AI4CE 11 10 0 26 Oct 2023
DreamCraft3D: Hierarchical 3D Generation with Bootstrapped Diffusion Prior Jingxiang Sun Bo Zhang Ruizhi Shao Lizhen Wang Wen Liu Zhenda Xie Yebin Liu 15 132 0 25 Oct 2023
TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models Tianshi Cao Karsten Kreis Sanja Fidler Nicholas Sharp Kangxue Yin 12 72 0 20 Oct 2023
3D-GPT: Procedural 3D Modeling with Large Language Models Chunyi Sun Junlin Han Weijian Deng Xinlong Wang Zishan Qin Stephen Gould 29 39 0 19 Oct 2023
GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models Taoran Yi Jiemin Fang Junjie Wang Guanjun Wu Lingxi Xie Xiaopeng Zhang Wenyu Liu Qi Tian Xinggang Wang 3DGS 18 126 0 12 Oct 2023
State of the Art on Diffusion Models for Visual Computing Ryan Po Wang Yifan Vladislav Golyanik Kfir Aberman Jonathan T. Barron ... Matthias Nießner Bjorn Ommer Christian Theobalt Peter Wonka Gordon Wetzstein 16 101 0 11 Oct 2023
HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generation Xin Huang Ruizhi Shao Qi Zhang Hongwen Zhang Yingfa Feng Yebin Liu Qing Wang DiffM 11 64 0 02 Oct 2023
TextField3D: Towards Enhancing Open-Vocabulary 3D Generation with Noisy Text Fields Tianyu Huang Yihan Zeng Bowen Dong Hang Xu Songcen Xu Rynson W. H. Lau Wangmeng Zuo DiffM 8 9 0 29 Sep 2023
Text-to-3D using Gaussian Splatting Manish Sharma Moitreya Chatterjee Yikai Wang Huaping Liu 3DGS 17 220 0 28 Sep 2023
Looking at words and points with attention: a benchmark for text-to-shape coherence Andrea Amaduzzi Giuseppe Lisanti Samuele Salti Luigi Di Stefano 9 2 0 14 Sep 2023
Text-Guided Generation and Editing of Compositional 3D Avatars Hao Zhang Yao Feng Peter Kulits Yandong Wen Justus Thies Michael J. Black 8 31 0 13 Sep 2023
ImageBind-LLM: Multi-modality Instruction Tuning Jiaming Han Renrui Zhang Wenqi Shao Peng Gao Peng-Tao Xu ... Yafei Wen Xiaoxin Chen Xiangyu Yue Hongsheng Li Yu Qiao MLLM 16 115 0 07 Sep 2023
Representation Learning for Sequential Volumetric Design Tasks Md Ferdous Alam Yi Wang Linh Tran Chin-Yi Cheng Jieliang Luo 3DV 8 2 0 05 Sep 2023
Towards Foundational AI Models for Additive Manufacturing: Language Models for G-Code Debugging, Manipulation, and Comprehension Anushrut Jignasu Kelly O. Marshall Baskar Ganapathysubramanian Aditya Balu Chinmay Hegde A. Krishnamurthy ELM AI4CE 11 6 0 04 Sep 2023
Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following Ziyu Guo Renrui Zhang Xiangyang Zhu Yiwen Tang Xianzheng Ma ... Ke Chen Peng Gao Xianzhi Li Hongsheng Li Pheng-Ann Heng MLLM 12 123 0 01 Sep 2023
Text2Scene: Text-driven Indoor Scene Stylization with Part-aware Details I. Hwang Hyeonwoo Kim Y. Kim DiffM 6 16 0 31 Aug 2023
Towards High-Fidelity Text-Guided 3D Face Generation and Manipulation Using only Images Cuican Yu Guansong Lu Yihan Zeng Jian-jun Sun Xiaodan Liang Huibin Li Zongben Xu Songcen Xu Wei Zhang Hang Xu 29 14 0 31 Aug 2023
Utilizing Task-Generic Motion Prior to Recover Full-Body Motion from Very Sparse Signals Myungjin Shin Dohae Lee In-Kwon Lee 3DH 8 3 0 30 Aug 2023
AI-Generated Content (AIGC) for Various Data Modalities: A Survey Lin Geng Foo Hossein Rahmani J. Liu 55 30 0 27 Aug 2023
Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields H. Song Seokhun Choi Hoseok Do Chul Lee Taehyeong Kim DiffM 13 24 0 23 Aug 2023
TADA! Text to Animatable Digital Avatars Tingting Liao Hongwei Yi Yuliang Xiu Jiaxaing Tang Yangyi Huang Justus Thies Michael J. Black 63 90 0 21 Aug 2023
Guide3D: Create 3D Avatars from Text and Image Guidance Yukang Cao Yan-Pei Cao Kai Han Ying Shan Kwan-Yee Kenneth Wong DiffM 12 10 0 18 Aug 2023
Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Events Hoonhee Cho Hyeonseong Kim Yujeong Chae Kuk-Jin Yoon VLM 22 24 0 18 Aug 2023
AvatarVerse: High-quality & Stable 3D Avatar Creation from Text and Pose Huichao Zhang Bo Chen Hao-Yu Yang Liao Qu Xu Wang Li Chen Chao Long Feida Zhu Kang Du Min Zheng DiffM 6 38 0 07 Aug 2023
Sketch and Text Guided Diffusion Model for Colored Point Cloud Generation Zijie Wu Yaonan Wang Mingtao Feng He-ping Xie Ajmal Saeed Mian DiffM 11 32 0 05 Aug 2023
VPP: Efficient Conditional 3D Generation via Voxel-Point Progressive Representation Zekun Qi Muzhou Yu Runpei Dong Kaisheng Ma 3DPC 11 11 0 28 Jul 2023
Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures Kun Yuan V. Srivastav Tong Yu Joël L. Lavanchy Pietro Mascagni Pietro Mascagni N. Padoy Nicolas Padoy 16 19 0 27 Jul 2023
Points-to-3D: Bridging the Gap between Sparse Points and Shape-Controllable Text-to-3D Generation Chaohui Yu Qiang-feng Zhou Jingliang Li Zhe Zhang Zhibin Wang Fan Wang DiffM 11 29 0 26 Jul 2023
FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fields S. Hwang J. Hyung Daejin Kim Minjeong Kim Jaegul Choo 3DH CLIP CVBM 33 11 0 21 Jul 2023
Sketch-A-Shape: Zero-Shot Sketch-to-3D Shape Generation Aditya Sanghi P. Jayaraman Arianna Rampini Joseph Lambourne Hooman Shayani Evan Atherton Saeid Asgari Taghanaki 3DV 11 10 0 08 Jul 2023
Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representation Zibo Zhao Wen Liu Xin Chen Xi Zeng Rui Wang Pei Cheng Bin-Bin Fu Tao Chen Gang Yu Shenghua Gao DiffM 12 85 0 29 Jun 2023
One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimization Minghua Liu Chao Xu Haian Jin Ling-Hao Chen T. MukundVarma Zexiang Xu Hao Su 29 433 0 29 Jun 2023
Local 3D Editing via 3D Distillation of CLIP Knowledge J. Hyung S. Hwang Daejin Kim Hyunji Lee Jaegul Choo 8 22 0 21 Jun 2023
Pushing the Limits of 3D Shape Generation at Scale Wang Yu Xuelin Qian Jingyang Huo Tiejun Huang Bo-Lu Zhao Yanwei Fu 21 11 0 20 Jun 2023
3D VR Sketch Guided 3D Shape Prototyping and Exploration Ling Luo Pinaki Nath Chowdhury Tao Xiang Yi-Zhe Song Yulia Gryaditskaya 31 10 0 19 Jun 2023
UniG3D: A Unified 3D Object Generation Dataset Qinghong Sun Yangguang Li Zexia Liu Xiaoshui Huang Fenggang Liu Xihui Liu Wanli Ouyang Jing Shao 22 6 0 19 Jun 2023
Vision-Language Models can Identify Distracted Driver Behavior from Naturalistic Videos Md Zahid Hasan Jiajing Chen Jiyang Wang Mohammed Shaiqur Rahman Ameya Joshi Senem Velipasalar C. Hegde Anuj Sharma S. Sarkar VLM 34 18 0 16 Jun 2023
DreamHuman: Animatable 3D Avatars from Text Nikos Kolotouros Thiemo Alldieck Andrei Zanfir Eduard Gabriel Bazavan Mihai Fieraru C. Sminchisescu 33 91 0 15 Jun 2023
CLIPXPlore: Coupled CLIP and Shape Spaces for 3D Shape Exploration Jingyu Hu Ka-Hei Hui Zhengzhe Liu Haotong Zhang Chi-Wing Fu 11 2 0 14 Jun 2023
ZeroForge: Feedforward Text-to-Shape Without 3D Supervision Kelly O. Marshall Minh Pham Ameya Joshi Anushrut Jignasu Aditya Balu Adarsh Krishnamurthy A. Hegde CLIP 10 2 0 14 Jun 2023
Scalable 3D Captioning with Pretrained Models Tiange Luo C. Rockwell Honglak Lee Justin Johnson 11 151 0 12 Jun 2023
Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptions Ian Huang Vrishab Krishna Omoruyi E. Atekha Leonidas J. Guibas DiffM VGen 8 7 0 09 Jun 2023
ATT3D: Amortized Text-to-3D Object Synthesis Jonathan Lorraine Kevin Xie Xiaohui Zeng Chen-Hsuan Lin Towaki Takikawa Nicholas Sharp Tsung-Yi Lin Ming-Yu Liu Sanja Fidler James Lucas DiffM 14 86 0 06 Jun 2023