Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings

22 March 2018

Silvio Savarese

Papers citing "Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings"

46 / 46 papers shown

Title
OctGPT: Octree-based Multiscale Autoregressive Models for 3D Shape Generation Si-Tong Wei Rui-Huan Wang Chuan-Zhi Zhou Baoquan Chen Peng-Shuai Wang 31 1 0 14 Apr 2025
ArtFormer: Controllable Generation of Diverse 3D Articulated Objects Jiayi Su Youhe Feng Zheng Li Jinhua Song Yangfan He Botao Ren Botian Xu AI4CE 91 2 0 10 Dec 2024
PaintScene4D: Consistent 4D Scene Generation from Text Prompts Vinayak Gupta Yunze Man Yu-Xiong Wang VGen 83 0 0 05 Dec 2024
DreamPolish: Domain Score Distillation With Progressive Geometry Generation Yean Cheng Ziqi Cai Ming Ding Wendi Zheng Shiyu Huang Yuxiao Dong J. Tang Boxin Shi DiffM 32 0 0 03 Nov 2024
Diffusion Models in 3D Vision: A Survey Zhen Wang Dongyuan Li Renhe Jiang Tianyu He Jiang Bian Renhe Jiang MedIm 66 4 0 07 Oct 2024
SPARTUN3D: Situated Spatial Understanding of 3D World in Large Language Models Yue Zhang Zhiyang Xu Ying Shen Parisa Kordjamshidi Lifu Huang 34 6 0 04 Oct 2024
DreamBeast: Distilling 3D Fantastical Animals with Part-Aware Knowledge Transfer Runjia Li Junlin Han Luke Melas-Kyriazi Chunyi Sun Zhaochong An Zhongrui Gui Shuyang Sun Philip Torr Tomas Jakab 36 1 0 12 Sep 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 85 42 0 17 Jul 2024
Text2Robot: Evolutionary Robot Design from Text Descriptions Ryan P. Ringel Zachary S. Charlick Jiaxun Liu Boxi Xia Boyuan Chen 40 2 0 28 Jun 2024
Duoduo CLIP: Efficient 3D Understanding with Multi-View Images Han-Hung Lee Yiming Zhang Angel X. Chang 3DPC 41 3 0 17 Jun 2024
VP-LLM: Text-Driven 3D Volume Completion with Large Language Models through Patchification Jianmeng Liu Yichen Liu Yuyao Zhang Zeyuan Meng Yu-Wing Tai Chi-Keung Tang 47 0 0 08 Jun 2024
Part-aware Shape Generation with Latent 3D Diffusion of Neural Voxel Fields Yuhang Huang SHilong Zou Xinwang Liu K. Xu DiffM 59 0 0 02 May 2024
RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion Jaidev Shriram Alex Trevithick Lingjie Liu Ravi Ramamoorthi DiffM 3DGS 73 55 0 10 Apr 2024
Garment3DGen: 3D Garment Stylization and Texture Generation N. Sarafianos Tuur Stuyck Xiaoyu Xiang Yilei Li Jovan Popovic Rakesh Ranjan 3DH 104 17 0 27 Mar 2024
Uni3DL: Unified Model for 3D and Language Understanding Xiang Li Jian Ding Zhaoyang Chen Mohamed Elhoseiny 30 3 0 05 Dec 2023
4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling Sherwin Bahmani Ivan Skorokhodov Victor Rong Gordon Wetzstein Leonidas J. Guibas Peter Wonka Sergey Tulyakov Jeong Joon Park Andrea Tagliasacchi David B. Lindell DiffM 43 103 0 29 Nov 2023
Towards High-Fidelity Text-Guided 3D Face Generation and Manipulation Using only Images Cuican Yu Guansong Lu Yihan Zeng Jian-jun Sun Xiaodan Liang Huibin Li Zongben Xu Songcen Xu Wei Zhang Hang Xu 33 14 0 31 Aug 2023
Zero-shot CAD Program Re-Parameterization for Interactive Manipulation Milin Kodnongbua Benjamin T. Jones Maaz Bin Safeer Ahmad Vladimir G. Kim Adriana Schulz 35 4 0 05 Jun 2023
Locally Attentional SDF Diffusion for Controllable 3D Shape Generation Xin-Yang Zheng Hao Pan Peng-Shuai Wang Xin Tong Yang Liu H. Shum 32 126 0 08 May 2023
TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervision Jiacheng Wei Hao Wang Jiashi Feng Guosheng Lin Kim-Hui Yap 22 30 0 23 Mar 2023
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models Lukas Höllein Ang Cao Andrew Owens Justin Johnson Matthias Nießner DiffM 35 177 0 21 Mar 2023
Text-To-4D Dynamic Scene Generation Uriel Singer Shelly Sheynin Adam Polyak Oron Ashual Iurii Makarov ... Naman Goyal Andrea Vedaldi Devi Parikh Justin Johnson Yaniv Taigman DiffM 30 147 0 26 Jan 2023
Objaverse: A Universe of Annotated 3D Objects Matt Deitke Dustin Schwenk Jordi Salvador Luca Weihs Oscar Michel Eli VanderBilt Ludwig Schmidt Kiana Ehsani Aniruddha Kembhavi Ali Farhadi 22 882 0 15 Dec 2022
ScanEnts3D: Exploiting Phrase-to-3D-Object Correspondences for Improved Visio-Linguistic Models in 3D Scenes Ahmed Abdelreheem Kyle Olszewski Hsin-Ying Lee Peter Wonka Panos Achlioptas 3DPC 20 28 0 12 Dec 2022
LADIS: Language Disentanglement for 3D Shape Editing Ian Huang Panos Achlioptas Tianyi Zhang Sergey Tulyakov Minhyuk Sung Leonidas J. Guibas 20 10 0 09 Dec 2022
Diffusion-SDF: Text-to-Shape via Voxelized Diffusion Muheng Li Yueqi Duan Jie Zhou Jiwen Lu DiffM 42 121 0 06 Dec 2022
DiffRF: Rendering-Guided 3D Radiance Field Diffusion Norman Muller Yawar Siddiqui Lorenzo Porzi Samuel Rota Buló Peter Kontschieder Matthias Nießner 32 185 0 02 Dec 2022
3D-TOGO: Towards Text-Guided Cross-Category 3D Object Generation Zutao Jiang Guangsong Lu Xiaodan Liang Jihua Zhu Wei Zhang Xiaojun Chang Hang Xu DiffM 19 8 0 02 Dec 2022
Understanding Pure CLIP Guidance for Voxel Grid NeRF Models Han-Hung Lee Angel X. Chang 22 63 0 30 Sep 2022
DreamFusion: Text-to-3D using 2D Diffusion Ben Poole Ajay Jain Jonathan T. Barron B. Mildenhall 47 2,311 0 29 Sep 2022
Cross-Modal 3D Shape Generation and Manipulation Zezhou Cheng Menglei Chai Jian Ren Hsin-Ying Lee Kyle Olszewski Zeng Huang Subhransu Maji Sergey Tulyakov 42 32 0 24 Jul 2022
ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Model Rao Fu Xiaoyu Zhan Yiwen Chen Daniel E. Ritchie Srinath Sridhar 33 79 0 19 Jul 2022
Voxel-informed Language Grounding Rodolfo Corona Shizhan Zhu Dan Klein Trevor Darrell 133 11 0 19 May 2022
Text2Pos: Text-to-Point-Cloud Cross-Modal Localization Manuel Kolmet Qunjie Zhou Aljosa Osep Laura Leal-Taixe 19 22 0 28 Mar 2022
CLIP-Mesh: Generating textured meshes from text using pretrained image-text models N. Khalid Tianhao Xie Eugene Belilovsky Tiberiu Popa CLIP 8 291 0 24 Mar 2022
TriCoLo: Trimodal Contrastive Loss for Text to Shape Retrieval Yue Ruan Han-Hung Lee Yiming Zhang Ke Zhang Angel X. Chang 27 22 0 19 Jan 2022
D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Grounding Dave Zhenyu Chen Qirui Wu Matthias Nießner Angel X. Chang 19 29 0 02 Dec 2021
CLIP-Forge: Towards Zero-Shot Text-to-Shape Generation Aditya Sanghi Hang Chu Joseph G. Lambourne Ye Wang Chin-Yi Cheng Marco Fumero Kamal Rahimi Malekshan CLIP 35 289 0 06 Oct 2021
DAE-GAN: Dynamic Aspect-aware GAN for Text-to-Image Synthesis Shulan Ruan Yong Zhang Kun Zhang Yanbo Fan Fan Tang Qi Liu Enhong Chen 28 88 0 27 Aug 2021
Parts2Words: Learning Joint Embedding of Point Clouds and Texts by Bidirectional Matching between Parts and Words Chuan Tang Xi Yang Bojian Wu Zhizhong Han Yi Chang 3DPC 28 13 0 05 Jul 2021
Fold2Seq: A Joint Sequence(1D)-Fold(3D) Embedding-based Generative Model for Protein Design Yue Cao Payel Das Vijil Chenthamarakshan Pin-Yu Chen Igor Melnyk Yang Shen 24 45 0 24 Jun 2021
Scan2Cap: Context-aware Dense Captioning in RGB-D Scans Dave Zhenyu Chen A. Gholami Matthias Nießner Angel X. Chang 3DPC 23 157 0 03 Dec 2020
Y^2Seq2Seq: Cross-Modal Representation Learning for 3D Shape and Text by Joint Reconstruction and Prediction of View and Word Sequences Simon Denman Mingyang Shang Sabesan Sivapalan Yu-Shen Liu Matthias Zwicker 3DV 8 53 0 07 Nov 2018
Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling Jiajun Wu Chengkai Zhang Tianfan Xue Bill Freeman J. Tenenbaum GAN 171 1,940 0 24 Oct 2016
Learning Deep Representations of Fine-grained Visual Descriptions Scott E. Reed Zeynep Akata Bernt Schiele Honglak Lee OCL VLM 170 840 0 17 May 2016
A Multi-View Embedding Space for Modeling Internet Images, Tags, and their Semantics Yunchao Gong Qifa Ke Michael Isard Svetlana Lazebnik 3DV 62 584 0 18 Dec 2012