Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuning

17 August 2022

Tao He

Lianli Gao

Jingkuan Song

Yuan-Fang Li

VLM

ArXiv PDF HTML

Papers citing "Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuning"

33 / 33 papers shown

Title
Generalized Visual Relation Detection with Diffusion Models Kaifeng Gao Siqi Chen Hanwang Zhang Jun Xiao Yueting Zhuang Qianru Sun 30 0 0 16 Apr 2025
Open-Vocabulary Semantic Segmentation with Uncertainty Alignment for Robotic Scene Understanding in Indoor Building Environments Yifan Xu V. Kamat Carol Menassa 47 0 0 29 Mar 2025
What can Off-the-Shelves Large Multi-Modal Models do for Dynamic Scene Graph Generation? Xuanming Cui Jaiminkumar Ashokbhai Bhoi Chionh Wei Peng Adriel Kuek Ser-Nam Lim 48 0 0 20 Mar 2025
HyperGLM: HyperGraph for Video Scene Graph Generation and Anticipation Trong-Thuan Nguyen Pha Nguyen J. Cothren Alper Yilmaz Khoa Luu 80 1 0 27 Nov 2024
Scene Graph Generation with Role-Playing Large Language Models Guikun Chen Jin Li Wenguan Wang VLM 40 5 0 20 Oct 2024
End-to-end Open-vocabulary Video Visual Relationship Detection using Multi-modal Prompting Yongqi Wang Xinxiao Wu Shuo Yang Jiebo Luo 42 0 0 19 Sep 2024
OpenPSG: Open-set Panoptic Scene Graph Generation via Large Multimodal Models Zijian Zhou Zheng Zhu Holger Caesar Miaojing Shi VLM 24 2 0 15 Jul 2024
Enhanced Data Transfer Cooperating with Artificial Triplets for Scene Graph Generation Kuanchao Chu Satoshi Yamazaki Hideki Nakayama 33 0 0 27 Jun 2024
G-SAP: Graph-based Structure-Aware Prompt Learning over Heterogeneous Knowledge for Commonsense Reasoning Ruiting Dai Yuqiao Tan Lisi Mo Shuang Liang Guohao Huo Jiayi Luo Yao Cheng ReLM RALM LRM 16 0 0 09 May 2024
Tri-modal Confluence with Temporal Dynamics for Scene Graph Generation in Operating Rooms Diandian Guo Manxi Lin Jialun Pei He Tang Yueming Jin Pheng-Ann Heng 24 1 0 14 Apr 2024
From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Models Rongjie Li Songyang Zhang Dahua Lin Kai-xiang Chen Xuming He VLM 29 14 0 01 Apr 2024
Predicate Debiasing in Vision-Language Models Integration for Scene Graph Generation Enhancement Yuxuan Wang Xiaoyuan Liu VLM 39 0 0 24 Mar 2024
Scene-Graph ViT: End-to-End Open-Vocabulary Visual Relationship Detection Tim Salzmann Markus Ryll Alex Bewley Matthias Minderer 33 4 0 21 Mar 2024
Towards Lifelong Scene Graph Generation with Knowledge-ware In-context Prompt Learning Tao He Tongtong Wu Dongyang Zhang Guiduo Duan Ke Qin Yuan-Fang Li CLL 10 1 0 26 Jan 2024
ALF: Adaptive Label Finetuning for Scene Graph Generation Qishen Chen Jianzhi Liu Xinyu Lyu Lianli Gao Hengtao Shen Jingkuan Song 10 0 0 29 Dec 2023
VLPrompt: Vision-Language Prompting for Panoptic Scene Graph Generation Zijian Zhou Miaojing Shi Holger Caesar VLM 19 12 0 27 Nov 2023
Enhancing Scene Graph Generation with Hierarchical Relationships and Commonsense Knowledge Bowen Jiang Zhijun Zhuang Shreyas S. Shivakumar Camillo J. Taylor 19 6 0 21 Nov 2023
Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retention Zuyao Chen Jinlin Wu Zhen Lei Zhaoxiang Zhang Changwen Chen 10 11 0 18 Nov 2023
Open Visual Knowledge Extraction via Relation-Oriented Multimodality Model Prompting Hejie Cui Xinyu Fang Zihan Zhang Ran Xu Xuan Kan Xin Liu Yue Yu Manling Li Yangqiu Song Carl Yang VLM 15 4 0 28 Oct 2023
LLM4SGG: Large Language Models for Weakly Supervised Scene Graph Generation Kibum Kim Kanghoon Yoon Jaeyeong Jeon Yeonjun In Jinyoung Moon Donghyun Kim Chanyoung Park 16 14 0 16 Oct 2023
Read-only Prompt Optimization for Vision-Language Few-shot Learning Dongjun Lee Seokwon Song Jihee G. Suh Joonmyeong Choi S. Lee Hyunwoo J.Kim VLM 29 39 0 29 Aug 2023
Head-Tail Cooperative Learning Network for Unbiased Scene Graph Generation Lei Wang Zejian Yuan Yao Lu Badong Chen 19 0 0 23 Aug 2023
Open-Vocabulary Object Detection via Scene Graph Discovery Hengcan Shi Munawar Hayat Jianfei Cai ObjD 8 12 0 07 Jul 2023
Zero-shot Visual Relation Detection via Composite Visual Cues from Large Language Models Lin Li Jun Xiao Guikun Chen Jian Shao Yueting Zhuang Long Chen VLM 19 25 0 21 May 2023
Probabilistic Prompt Learning for Dense Prediction Hyeongjun Kwon Taeyong Song Somi Jeong Jin-Hwa Kim Jinhyun Jang K. Sohn VLM 14 8 0 03 Apr 2023
Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World Qifan Yu Juncheng Li Yuehua Wu Siliang Tang Wei Ji Yueting Zhuang 25 33 0 23 Mar 2023
Decomposed Prototype Learning for Few-Shot Scene Graph Generation Xingchen Li Long Chen Guikun Chen Yinfu Feng Yi Yang Jun Xiao 22 6 0 20 Mar 2023
Compositional Prompt Tuning with Motion Cues for Open-vocabulary Video Relation Detection Kaifeng Gao Long Chen Hanwang Zhang Jun Xiao Qianru Sun VLM VPVLM 14 26 0 01 Feb 2023
Skew Class-balanced Re-weighting for Unbiased Scene Graph Generation Haeyong Kang Chang-Dong Yoo 18 6 0 01 Jan 2023
Scene Graph Generation: A Comprehensive Survey Guangming Zhu Liang Zhang Youliang Jiang Yixuan Dang Haoran Hou ... Mingtao Feng Xia Zhao Qiguang Miao Syed Afaq Ali Shah Bennamoun 3DV 17 79 0 03 Jan 2022
Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generation Rongjie Li Songyang Zhang Bo Wan Xuming He 170 209 0 01 Apr 2021
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 396 2,576 0 03 Sep 2019
Visual Translation Embedding Network for Visual Relation Detection Hanwang Zhang Zawlin Kyaw Shih-Fu Chang Tat-Seng Chua ViT 140 559 0 27 Feb 2017