Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detection

16 August 2023

Ming Shan Hee

Papers citing "Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detection"

23 / 23 papers shown

Title
Improving Multimodal Hateful Meme Detection Exploiting LMM-Generated Knowledge Maria Tzelepi Vasileios Mezaris 34 0 0 14 Apr 2025
MemeIntel: Explainable Detection of Propagandistic and Hateful Memes Mohamed Bayan Kmainasi A. Hasnat Md. Arid Hasan Ali Ezzat Shahroor Firoj Alam VLM 45 0 0 23 Feb 2025
Improved Fine-Tuning of Large Multimodal Models for Hateful Meme Detection Jingbiao Mei Jinghong Chen Guangyu Yang Weizhe Lin Bill Byrne VLM 92 0 0 18 Feb 2025
Cross-Modal Transfer from Memes to Videos: Addressing Data Scarcity in Hateful Video Detection Han Wang Rui Yang Tan Roy Ka-Wei Lee 34 0 0 28 Jan 2025
SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memes Palash Nandi Shivam Sharma Tanmoy Chakraborty 26 1 0 31 Dec 2024
Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memes Rahul Garg Trilok Padhi Hemang Jain Ugur Kursuncu Ponnurangam Kumaraguru 72 2 0 19 Nov 2024
Prompt-enhanced Network for Hateful Meme Classification Junxi Liu Yanyan Feng Jiehai Chen Yun Xue Fenghuan Li VLM 53 0 0 12 Nov 2024
Towards Low-Resource Harmful Meme Detection with LMM Agents Jianzhao Huang Hongzhan Lin Ziyan Liu Ziyang Luo Guang Chen Jing Ma 33 2 0 08 Nov 2024
M3Hop-CoT: Misogynous Meme Identification with Multimodal Multi-hop Chain-of-Thought G. Kumari Kirtan Jain Asif Ekbal 18 1 0 11 Oct 2024
Bridging Modalities: Enhancing Cross-Modality Hate Speech Detection with Few-Shot In-Context Learning Ming Shan Hee Aditi Kumaresan Roy Ka-Wei Lee 14 3 0 08 Oct 2024
MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classification Siddhant Bikram Shah Shuvam Shiwakoti Maheep Chaudhary Haohan Wang VLM 17 8 0 23 Sep 2024
MultiHateClip: A Multilingual Benchmark Dataset for Hateful Video Detection on YouTube and Bilibili Han Wang Tan Rui Yang Usman Naseem Roy Ka-Wei Lee 23 5 0 28 Jul 2024
VGA: Vision GUI Assistant -- Minimizing Hallucinations through Image-Centric Fine-Tuning Ziyang Meng Yu Dai Zezheng Gong Shaoxiong Guo Minglong Tang Tongquan Wei VLM 19 3 0 20 Jun 2024
Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicities Delfina Sol Martinez Pandiani Erik Tjong Kim Sang Davide Ceolin 29 2 0 11 Jun 2024
MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation Han Wang Roy Ka-Wei Lee 27 7 0 24 Feb 2024
Modularized Networks for Few-shot Hateful Meme Detection Rui Cao Roy Ka-Wei Lee Jing Jiang 16 4 0 19 Feb 2024
Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Models Ming Shan Hee Shivam Sharma Rui Cao Palash Nandi Tanmoy Chakraborty Roy Ka-Wei Lee 36 14 0 30 Jan 2024
Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models Hongzhan Lin Ziyang Luo Wei Gao Jing Ma Bo Wang Ruichao Yang 19 11 0 24 Jan 2024
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 244 4,186 0 30 Jan 2023
Multi-modal Misinformation Detection: Approaches, Challenges and Opportunities S. Abdali Sina shaham Bhaskar Krishnamachari 13 18 0 25 Mar 2022
BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li Dongxu Li Caiming Xiong S. Hoi MLLM BDL VLM CLIP 388 4,010 0 28 Jan 2022
Making Pre-trained Language Models Better Few-shot Learners Tianyu Gao Adam Fisch Danqi Chen 241 1,898 0 31 Dec 2020
Supervised Multimodal Bitransformers for Classifying Images and Text Douwe Kiela Suvrat Bhooshan Hamed Firooz Ethan Perez Davide Testuggine 57 238 0 06 Sep 2019