CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields

9 December 2021

Papers citing "CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields"

50 / 55 papers shown

Title
Geometry in Style: 3D Stylization via Surface Normal Deformation Nam Anh Dinh Itai Lang Hyunwoo Kim Oded Stein Rana Hanocka 3DH 41 0 0 29 Mar 2025
TranSplat: Lighting-Consistent Cross-Scene Object Transfer with 3D Gaussian Splatting Boyang Yanlin Jin Ashok Veeraraghavan Akshat Dave Guha Balakrishnan 3DGS 56 0 0 28 Mar 2025
Kiss3DGen: Repurposing Image Diffusion Models for 3D Asset Generation Jiantao Lin Xin Yang Meixi Chen Yingjie Xu D. Yan Leyi Wu Xinli Xu Lie Xu Shunsi Zhang Ying-Cong Chen 55 1 0 03 Mar 2025
MM-NeRF: Multimodal-Guided 3D Multi-Style Transfer of Neural Radiance Field Zijian Győző Yang Zhongwei Qiu Chang Xu Dongmei Fu 45 2 0 28 Jan 2025
GeoDiffuser: Geometry-Based Image Editing with Diffusion Models Rahul Sajnani Jeroen Vanbaar Jie Min Kapil D. Katyal Srinath Sridhar DiffM 49 10 0 03 Jan 2025
PaintScene4D: Consistent 4D Scene Generation from Text Prompts Vinayak Gupta Yunze Man Yu-Xiong Wang VGen 81 0 0 05 Dec 2024
InstantStyleGaussian: Efficient Art Style Transfer with 3D Gaussian Splatting Xin-Yi Yu Jun-Xin Yu Li-Bo Zhou Yan Wei Lin-Lin Ou 3DGS 22 4 0 08 Aug 2024
HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions Haiyang Zhou Xinhua Cheng Wangbo Yu Yonghong Tian Li-ming Yuan 3DGS DiffM 44 10 0 21 Jul 2024
VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Sherwin Bahmani Ivan Skorokhodov Aliaksandr Siarohin Willi Menapace Guocheng Qian ... Chaoyang Wang Jiaxu Zou Andrea Tagliasacchi David B. Lindell Sergey Tulyakov VGen DiffM 72 41 0 17 Jul 2024
MLPHand: Real Time Multi-View 3D Hand Mesh Reconstruction via MLP Modeling Jian Yang Jiakun Li Guoming Li Zhen Shen Huai-Yu Wu Zhaoxin Fan Heng Huang 3DH 25 0 0 23 Jun 2024
A3D: Does Diffusion Dream about 3D Alignment? Savva Ignatyev Nina Konovalova Daniil Selikhanovych Nikolay Patakin Nikolay Patakin ... Anton Konushin Peter Wonka Alexander Filippov Peter Wonka Evgeny Burnaev DiffM 52 0 0 21 Jun 2024
IReNe: Instant Recoloring of Neural Radiance Fields Alessio Mazzucchelli Adrian Garcia-Garcia Elena Garces Fernando Rivas-Manzaneque Francesc Moreno-Noguer Adrian Penate-Sanchez 3DH 49 2 0 30 May 2024
GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting Haodong Chen Yongle Huang Haojian Huang Xiangsheng Ge Dian Shao DiffM 32 11 0 13 May 2024
Point Resampling and Ray Transformation Aid to Editable NeRF Models Zhenyang Li Zilong Chen Feifan Qu Mingqing Wang Yizhou Zhao Kai Zhang Yifan Peng 20 1 0 12 May 2024
MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes via Diffusion Prior Honghua Chen Chen Change Loy Xingang Pan 34 11 0 05 May 2024
DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editing Minghao Chen Iro Laina Andrea Vedaldi 3DGS 38 23 0 29 Apr 2024
TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts Jingyu Zhuang Di Kang Yan-Pei Cao Guanbin Li Liang Lin Ying Shan DiffM 3DGS 27 38 0 26 Jan 2024
GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning Ye Yuan Xueting Li Yangyi Huang Shalini De Mello Koki Nagano Jan Kautz Umar Iqbal 3DGS 25 44 0 18 Dec 2023
HeadArtist: Text-conditioned 3D Head Generation with Self Score Distillation Hongyu Liu Xuan Wang Ziyu Wan Yujun Shen Yibing Song Jing Liao Qifeng Chen DiffM 33 17 0 12 Dec 2023
Learning Naturally Aggregated Appearance for Efficient 3D Editing Ka Leong Cheng Qiuyu Wang Zifan Shi Kecheng Zheng Yinghao Xu Ouyang Hao Qifeng Chen Yujun Shen 3DH 50 4 0 11 Dec 2023
TeMO: Towards Text-Driven 3D Stylization for Multi-Object Meshes Xuying Zhang Bo-Wen Yin Yuming Chen Zheng Lin Yunheng Li Qibin Hou Ming-Ming Cheng CLIP DiffM 28 7 0 07 Dec 2023
4D-fy: Text-to-4D Generation Using Hybrid Score Distillation Sampling Sherwin Bahmani Ivan Skorokhodov Victor Rong Gordon Wetzstein Leonidas J. Guibas Peter Wonka Sergey Tulyakov Jeong Joon Park Andrea Tagliasacchi David B. Lindell DiffM 39 103 0 29 Nov 2023
HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting Xian Liu Xiaohang Zhan Jiaxiang Tang Ying Shan Gang Zeng Dahua Lin Xihui Liu Ziwei Liu 3DGS 35 72 0 28 Nov 2023
GaussianEditor: Editing 3D Gaussians Delicately with Text Instructions Jiemin Fang Junjie Wang Xiaopeng Zhang Lingxi Xie Qi Tian 3DGS DiffM 20 107 0 27 Nov 2023
Entangled View-Epipolar Information Aggregation for Generalizable Neural Radiance Fields Zhiyuan Min Yawei Luo Wei Yang Yuesong Wang Yi Yang 22 2 0 20 Nov 2023
Aria-NeRF: Multimodal Egocentric View Synthesis Jiankai Sun Jianing Qiu Chuanyang Zheng Johnathan Tucker Javier Yu Mac Schwager EgoV 28 5 0 11 Nov 2023
Few-shot Action Recognition with Captioning Foundation Models Xiang Wang Shiwei Zhang Hangjie Yuan Yingya Zhang Changxin Gao Deli Zhao Nong Sang VLM 16 7 0 16 Oct 2023
CLIP-Hand3D: Exploiting 3D Hand Pose Estimation via Context-Aware Prompting Shaoxiang Guo Qing Cai Lin Qi Junyu Dong 3DH 28 7 0 28 Sep 2023
Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views Zi-Xin Zou Weihao Cheng Yan-Pei Cao Shi-Sheng Huang Ying Shan Songiie Zhang DiffM 13 23 0 27 Aug 2023
Blending-NeRF: Text-Driven Localized Editing in Neural Radiance Fields H. Song Seokhun Choi Hoseok Do Chul Lee Taehyeong Kim DiffM 13 24 0 23 Aug 2023
Neural radiance fields in the industrial and robotics domain: applications, research opportunities and use cases Eugen Šlapak Enric Pardo Matús Dopiriak T. Maksymyuk Juraj Gazda AI4CE 17 11 0 14 Aug 2023
FaceCLIPNeRF: Text-driven 3D Face Manipulation using Deformable Neural Radiance Fields S. Hwang J. Hyung Daejin Kim Minjeong Kim Jaegul Choo 3DH CLIP CVBM 36 11 0 21 Jul 2023
NeRFool: Uncovering the Vulnerability of Generalizable Neural Radiance Fields against Adversarial Perturbations Y. Fu Ye Yuan Souvik Kundu Shang Wu Shunyao Zhang Yingyan Lin AAML 55 6 0 10 Jun 2023
InNeRF360: Text-Guided 3D-Consistent Object Inpainting on 360-degree Neural Radiance Fields Dongqing Wang Tong Zhang Alaa Abboud Sabine Süsstrunk 11 12 0 24 May 2023
TAPS3D: Text-Guided 3D Textured Shape Generation from Pseudo Supervision Jiacheng Wei Hao Wang Jiashi Feng Guosheng Lin Kim-Hui Yap 14 30 0 23 Mar 2023
Semantic Ray: Learning a Generalizable Semantic Field with Cross-Reprojection Attention F. Liu Chubing Zhang Yu Zheng Yueqi Duan 19 27 0 23 Mar 2023
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models Lukas Höllein Ang Cao Andrew Owens Justin Johnson Matthias Nießner DiffM 25 177 0 21 Mar 2023
Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinement Jiaxiang Tang Hang Zhou Xiaokang Chen Tianshu Hu Errui Ding Jingdong Wang Gang Zeng 27 115 0 03 Mar 2023
Painting 3D Nature in 2D: View Synthesis of Natural Scenes from a Single Semantic Mask Shangzhan Zhang Sida Peng Tianrun Chen Linzhan Mou Haotong Lin Kaicheng Yu Yiyi Liao Xiaowei Zhou 38 8 0 14 Feb 2023
Text-To-4D Dynamic Scene Generation Uriel Singer Shelly Sheynin Adam Polyak Oron Ashual Iurii Makarov ... Naman Goyal Andrea Vedaldi Devi Parikh Justin Johnson Yaniv Taigman DiffM 14 145 0 26 Jan 2023
PaletteNeRF: Palette-based Color Editing for NeRFs Qiling Wu Jianchao Tan Kun Xu 14 18 0 25 Dec 2022
LidarCLIP or: How I Learned to Talk to Point Clouds Georg Hess Adam Tonderski Christoffer Petersson Kalle AAstrom Lennart Svensson DiffM 13 22 0 13 Dec 2022
NeRFEditor: Differentiable Style Decomposition for Full 3D Scene Editing Chun-Yu Sun Yanbing Liu Junlin Han Stephen Gould 8 7 0 07 Dec 2022
Ref-NPR: Reference-Based Non-Photorealistic Radiance Fields for Controllable Scene Stylization Yuechen Zhang Zexin He Jinbo Xing Xu Yao Jiaya Jia VGen 14 25 0 06 Dec 2022
UniT3D: A Unified Transformer for 3D Dense Captioning and Visual Grounding Dave Zhenyu Chen Ronghang Hu Xinlei Chen Matthias Nießner Angel X. Chang 17 52 0 01 Dec 2022
NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360° Views Dejia Xu Yifan Jiang Peihao Wang Zhiwen Fan Yi Wang Zhangyang Wang DiffM 17 143 0 29 Nov 2022
Peekaboo: Text to Image Diffusion Models are Zero-Shot Segmentors R. Burgert Kanchana Ranasinghe Xiang Li Michael S. Ryoo DiffM VLM 22 37 0 23 Nov 2022
Latent-NeRF for Shape-Guided Generation of 3D Shapes and Textures G. Metzer Elad Richardson Or Patashnik Raja Giryes Daniel Cohen-Or DiffM 21 450 0 14 Nov 2022
ShapeCrafter: A Recursive Text-Conditioned 3D Shape Generation Model Rao Fu Xiaoyu Zhan Yiwen Chen Daniel E. Ritchie Srinath Sridhar 19 78 0 19 Jul 2022
Volumetric Disentanglement for 3D Scene Manipulation Sagie Benaim Frederik Warburg Peter Ebert Christensen Serge J. Belongie 11 15 0 06 Jun 2022