v1v2v3 (latest)

The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes

10 May 2020

Douwe Kiela

Amanpreet Singh

Papers citing "The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes"

50 / 357 papers shown

Title
SlowFast-LLaVA-1.5: A Family of Token-Efficient Video Large Language Models for Long-Form Video Understanding Mingze Xu Mingfei Gao Shiyu Li Jiasen Lu Zhe Gan Zhengfeng Lai Meng Cao Kai Kang Yue Yang Afshin Dehghan 266 10 0 24 Mar 2025
Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition Chengxiang Huang Yake Wei Zequn Yang D. Hu 160 3 0 24 Mar 2025
See-Saw Modality Balance: See Gradient, and Sew Impaired Vision-Language Balance to Mitigate Dominant Modality Bias Junehyoung Kwon Mihyeon Kim Eunju Lee Juhwan Choi Youngbin Kim 141 0 0 18 Mar 2025
Multi-Granular Multimodal Clue Fusion for Meme Understanding Li Zheng Hao Fei Ting Dai Zuquan Peng Fei Li Huisheng Ma Chong Teng Donghong Ji 147 7 0 16 Mar 2025
cantnlp@DravidianLangTech2025: A Bag-of-Sounds Approach to Multimodal Hate Speech Detection Sidney Wong Andrew Li 107 0 0 10 Mar 2025
Small Vision-Language Models: A Survey on Compact Architectures and Techniques Nitesh Patnaik Navdeep Nayak Himani Bansal Agrawal Moinak Chinmoy Khamaru Gourav Bal Saishree Smaranika Panda Rishi Raj Vishal Meena Kartheek Vadlamani VLM 129 1 0 09 Mar 2025
Advancing Multimodal In-Context Learning in Large Vision-Language Models with Task-aware Demonstrations Yanshu Li 201 3 0 05 Mar 2025
Detecting Offensive Memes with Social Biases in Singapore Context Using Multimodal Large Language Models Cao Yuxuan Wu Jiayang Alistair Cheong Liang Chuen Bryan Shan Guanrong Theodore Lee Chong Jen Sherman Chann Zhi Shen 500 0 0 25 Feb 2025
Tracking the Copyright of Large Vision-Language Models through Parameter Learning Adversarial Images Yubo Wang Jianting Tang Chaohu Liu Linli Xu AAML 239 3 0 23 Feb 2025
MemeIntel: Explainable Detection of Propagandistic and Hateful Memes Mohamed Bayan Kmainasi A. Hasnat Md. Arid Hasan Ali Ezzat Shahroor Firoj Alam VLM 166 1 0 23 Feb 2025
RealSyn: An Effective and Scalable Multimodal Interleaved Document Transformation Paradigm Tiancheng Gu Kaicheng Yang Chaoyi Zhang Yin Xie Xiang An Ziyong Feng Dongnan Liu Weidong Cai Jiankang Deng CLIP VLM 188 3 0 18 Feb 2025
Can't See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs Wenxuan Wang Xiaoyuan Liu Kuiyi Gao Shu Yang Youliang Yuan Pinjia He Shuai Wang Zhaopeng Tu 161 5 0 16 Feb 2025
Demystifying Hateful Content: Leveraging Large Multimodal Models for Hateful Meme Detection with Explainable Decisions Ming Shan Hee Roy Ka-wei Lee VLM 150 6 0 16 Feb 2025
Towards a Robust Framework for Multimodal Hate Detection: A Study on Video vs. Image-based Content Girish A. Koushik Diptesh Kanojia Helen Treharne 164 3 0 11 Feb 2025
Cross-Modal Transfer from Memes to Videos: Addressing Data Scarcity in Hateful Video Detection Han Wang Rui Yang Tan Roy Ka-wei Lee 106 4 0 28 Jan 2025
Playing Devil's Advocate: Unmasking Toxicity and Vulnerabilities in Large Vision-Language Models Abdulkadir Erol Trilok Padhi Agnik Saha Ugur Kursuncu Mehmet Emin Aktas 155 2 0 17 Jan 2025
VLM2Vec: Training Vision-Language Models for Massive Multimodal Embedding Tasks Ziyan Jiang Rui Meng Xinyi Yang Semih Yavuz Yingbo Zhou Lei Ma MLLM VLM 296 63 0 03 Jan 2025
SAFE-MEME: Structured Reasoning Framework for Robust Hate Speech Detection in Memes Palash Nandi Shivam Sharma Tanmoy Chakraborty 101 4 0 31 Dec 2024
Vitron: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editing Hao Fei Shengqiong Wu Hao Zhang Tat-Seng Chua Shuicheng Yan 275 55 0 31 Dec 2024
Bag of Tricks for Multimodal AutoML with Image, Text, and Tabular Data Zhiqiang Tang Zihan Zhong Tong He Gerald Friedland 227 2 0 19 Dec 2024
A Survey on Automatic Online Hate Speech Detection in Low-Resource Languages Susmita Das Arpita Dutta Kingshuk Roy Abir Mondal Arnab Mukhopadhyay 161 0 0 28 Nov 2024
Just KIDDIN: Knowledge Infusion and Distillation for Detection of INdecent Memes Rahul Garg Trilok Padhi Hemang Jain Ugur Kursuncu Ponnurangam Kumaraguru 191 4 0 19 Nov 2024
Prompt-enhanced Network for Hateful Meme Classification Junxi Liu Yanyan Feng Jiehai Chen Yun Xue Fenghuan Li VLM 161 0 0 12 Nov 2024
Towards Low-Resource Harmful Meme Detection with LMM Agents Jianzhao Huang Hongzhan Lin Ziyan Liu Ziyang Luo Guang Chen Jing Ma 118 11 0 08 Nov 2024
Multi3Hate: Multimodal, Multilingual, and Multicultural Hate Speech Detection with Vision-Language Models Minh Duc Bui Katharina von der Wense Anne Lauscher VLM 159 1 0 06 Nov 2024
RoMemes: A multimodal meme corpus for the Romanian language Vasile Păiş Sara Niţă Alexandru-Iulius Jerpelea Luca Pană Eric Curea GNN 112 1 0 20 Oct 2024
Seeing Through VisualBERT: A Causal Adventure on Memetic Landscapes Dibyanayan Bandyopadhyay Mohammed Hasanuzzaman Asif Ekbal AAML 132 3 0 17 Oct 2024
BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Bangla Fabiha Haider Fariha Tanjim Shifat Md Farhan Ishmam Deeparghya Dutta Barua Md Sakib Ul Rahman Sourove Md Fahim Md Farhad Alam 218 5 0 17 Oct 2024
Can We Predict Performance of Large Models across Vision-Language Tasks? Qinyu Zhao Ming Xu Kartik Gupta Akshay Asthana Liang Zheng Stephen Gould 208 1 0 14 Oct 2024
M3Hop-CoT: Misogynous Meme Identification with Multimodal Multi-hop Chain-of-Thought G. Kumari Kirtan Jain Asif Ekbal 162 6 0 11 Oct 2024
Q-VLM: Post-training Quantization for Large Vision-Language Models Changyuan Wang Ziwei Wang Xiuwei Xu Yansong Tang Jie Zhou Jiwen Lu MQ 202 9 0 10 Oct 2024
VHELM: A Holistic Evaluation of Vision Language Models Tony Lee Haoqin Tu Chi Heem Wong Wenhao Zheng Yiyang Zhou ... Josselin Somerville Roberts Michihiro Yasunaga Huaxiu Yao Cihang Xie Percy Liang VLM 177 27 0 09 Oct 2024
Deep Correlated Prompting for Visual Recognition with Missing Modalities Lianyu Hu Tongkai Shi Wei Feng Fanhua Shang Liang Wan VLM 210 6 0 09 Oct 2024
Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Step Wenxuan Wang Kuiyi Gao Zihan Jia Youliang Yuan Shu Yang S. Wang Wenxiang Jiao Zhaopeng Tu 551 5 0 04 Oct 2024
Towards Comprehensive Detection of Chinese Harmful Memes Junyu Lu Bo Xu Xiaokun Zhang Hongbo Wang Yuanyuan Sun Dongyu Zhang Liang Yang Hongfei Lin 78 4 0 03 Oct 2024
Multimodal Pragmatic Jailbreak on Text-to-image Models Tong Liu Zhixin Lai Jiawen Wang Gengyuan Zhang Shuo Chen Juil Sock Vera Demberg Volker Tresp Jindong Gu 139 5 0 27 Sep 2024
Understanding the Cognitive Complexity in Language Elicited by Product Images Yan-Ying Chen Shabnam Hakimi Monica P Van Francine Chen Matthew K. Hong M. Klenk Charlene C. Wu 126 0 0 25 Sep 2024
MemeCLIP: Leveraging CLIP Representations for Multimodal Meme Classification Siddhant Bikram Shah Shuvam Shiwakoti Maheep Chaudhary Haohan Wang VLM 124 18 0 23 Sep 2024
SpMis: An Investigation of Synthetic Spoken Misinformation Detection Peizhuo Liu Li Wang Renqiang He Haorui He Lei Wang Huadi Zheng Jie Shi Tong Xiao Zhizheng Wu 128 1 0 17 Sep 2024
Safeguarding Decentralized Social Media: LLM Agents for Automating Community Rule Compliance Lucio La Cava Andrea Tagarelli LLMAG 58 0 0 13 Sep 2024
MHS-STMA: Multimodal Hate Speech Detection via Scalable Transformer-Based Multilevel Attention Framework Anusha Chhabra Dinesh Kumar Vishwakarma 85 2 0 08 Sep 2024
MuAP: Multi-step Adaptive Prompt Learning for Vision-Language Model with Missing Modality Ruiting Dai Yuqiao Tan Lisi Mo Tao He Ke Qin Shuang Liang VLM 105 3 0 07 Sep 2024
Multimodal Contrastive In-Context Learning Yosuke Miyanishi Minh Le Nguyen 104 2 0 23 Aug 2024
Building and better understanding vision-language models: insights and future directions Hugo Laurençon Andrés Marafioti Victor Sanh Léo Tronchon VLM 176 111 0 22 Aug 2024
Modality Invariant Multimodal Learning to Handle Missing Modalities: A Single-Branch Approach Muhammad Saad Saeed Shah Nawaz Muhammad Zaigham Zaheer Muhammad Haris Khan Karthik Nandakumar Muhammad Haroon Yousaf Hassan Sajjad Tom De Schepper Markus Schedl 127 3 0 14 Aug 2024
HateSieve: A Contrastive Learning Framework for Detecting and Segmenting Hateful Content in Multimodal Memes Xuanyu Su Yansong Li Diana Inkpen Nathalie Japkowicz VLM 130 2 0 11 Aug 2024
LLaVA-OneVision: Easy Visual Task Transfer Bo Li Yuanhan Zhang Dong Guo Renrui Zhang Feng Li Hao Zhang Kaichen Zhang Yanwei Li Ziwei Liu Chunyuan Li MLLM SyDa VLM 249 1,299 0 06 Aug 2024
Evolver: Chain-of-Evolution Prompting to Boost Large Multimodal Models for Hateful Meme Detection Jinfa Huang Jinsheng Pan Zhongwei Wan Hanjia Lyu Jiebo Luo 223 9 0 30 Jul 2024
Multi-label Cluster Discrimination for Visual Representation Learning Xiang An Kaicheng Yang Xiangzi Dai Ziyong Feng Jiankang Deng VLM 148 9 0 24 Jul 2024
Chameleon: Images Are What You Need For Multimodal Learning Robust To Missing Modalities Muhammad Irzam Liaqat Shah Nawaz Muhammad Zaigham Zaheer M. S. Saeed Hassan Sajjad Tom De Schepper Karthik Nandakumar Muhammad Haris Khan 140 1 0 23 Jul 2024