v1v2v3 (latest)

The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes

10 May 2020

Douwe Kiela

Amanpreet Singh

Papers citing "The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes"

50 / 357 papers shown

Title
Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Models Donggeun Kim Taesup Kim 112 6 0 17 Jul 2024
What Makes a Meme a Meme? Identifying Memes for Memetics-Aware Dataset Creation Muzhaffar Hazman Susan Mckeever Josephine Griffith 74 1 0 16 Jul 2024
A Single Transformer for Scalable Vision-Language Modeling Yangyi Chen Xingyao Wang Yuan Yao Heng Ji LRM 157 24 0 08 Jul 2024
OmChat: A Recipe to Train Multimodal Language Models with Strong Long Context and Video Understanding Tiancheng Zhao Qianqian Zhang Kyusong Lee Peng Liu Lu Zhang Chunxin Fang Jiajia Liao Kelei Jiang Yibo Ma Ruochen Xu MLLM VLM 131 7 0 06 Jul 2024
HEMM: Holistic Evaluation of Multimodal Foundation Models Paul Pu Liang Akshay Goindani Talha Chafekar Leena Mathur Haofei Yu Ruslan Salakhutdinov Louis-Philippe Morency 134 23 0 03 Jul 2024
Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Application Chuanpeng Yang Wang Lu Yao Zhu Yidong Wang Qian Chen Chenlong Gao Bingjie Yan Yiqiang Chen ALM KELM 144 47 0 02 Jul 2024
How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models Jaeyoung Lee Ximing Lu Jack Hessel Faeze Brahman Youngjae Yu Yonatan Bisk Yejin Choi Saadia Gabriel 121 3 0 29 Jun 2024
Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs Shengbang Tong Ellis L Brown Penghao Wu Sanghyun Woo Manoj Middepogu ... Xichen Pan Austin Wang Rob Fergus Yann LeCun Saining Xie 3DV MLLM 221 493 0 24 Jun 2024
COT: A Generative Approach for Hate Speech Counter-Narratives via Contrastive Optimal Transport Linhao Zhang Li Jin Guangluan Xu Xiaoyu Li Xian Sun 109 1 0 18 Jun 2024
CoMM: A Coherent Interleaved Image-Text Dataset for Multimodal Understanding and Generation Wei Chen Lin Li Yongqi Yang Bin Wen Fan Yang Tingting Gao Yu Wu Long Chen VLM VGen 166 12 0 15 Jun 2024
OSPC: Detecting Harmful Memes with Large Language Model as a Catalyst Jingtao Cao Zheng Zhang Hongru Wang Bin Liang Hao Wang Kam-Fai Wong 79 0 0 14 Jun 2024
Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicities Delfina Sol Martinez Pandiani Erik Tjong Kim Sang Davide Ceolin 125 6 0 11 Jun 2024
MLLMGuard: A Multi-dimensional Safety Evaluation Suite for Multimodal Large Language Models Tianle Gu Zeyang Zhou Kexin Huang Dandan Liang Yixu Wang ... Keqing Wang Yujiu Yang Yan Teng Botian Shi Yingchun Wang ELM 149 22 0 11 Jun 2024
Let Go of Your Labels with Unsupervised Transfer Artyom Gadetsky Yulun Jiang Maria Brbić VLM 147 9 0 11 Jun 2024
AIM: Let Any Multi-modal Large Language Models Embrace Efficient In-Context Learning Jun Gao Qian Qiao Ziqiang Cao Zili Wang Wenjie Li 140 3 0 11 Jun 2024
RWKV-CLIP: A Robust Vision-Language Representation Learner Tiancheng Gu Kaicheng Yang Xiang An Ziyong Feng Dongnan Liu Weidong Cai Jiankang Deng VLM CLIP 125 18 0 11 Jun 2024
MemeGuard: An LLM and VLM-based Framework for Advancing Content Moderation via Meme Intervention Prince Jha Raghav Jain Konika Mandal Vasu Sharma Sriparna Saha P. Bhattacharyya 111 12 0 08 Jun 2024
ArMeme: Propagandistic Content in Arabic Memes Firoj Alam A. Hasnat Fatema Ahmed Md. Arid Hasan Maram Hasanain 98 10 0 06 Jun 2024
SLANT: Spurious Logo ANalysis Toolkit Maan Qraitem Piotr Teterwak Kate Saenko Bryan A. Plummer AAML 106 0 0 03 Jun 2024
Multi-Modal Generative Embedding Model Feipeng Ma Hongwei Xue Guangting Wang Yizhou Zhou Fengyun Rao Shilin Yan Yueyi Zhang Siying Wu Mike Zheng Shou Xiaoyan Sun VLM 89 4 0 29 May 2024
Hate Speech Detection with Generalizable Target-aware Fairness Tong Chen Danny Wang Xurong Liang Marten Risius Gianluca Demartini Hongzhi Yin 180 8 0 28 May 2024
A Survey of Multimodal Large Language Model from A Data-centric Perspective Tianyi Bai Hao Liang Binwang Wan Yanran Xu Xi Li ... Ping Huang Jiulong Shan Conghui He Binhang Yuan Wentao Zhang 216 53 0 26 May 2024
MemeMQA: Multimodal Question Answering for Memes via Rationale-Based Inferencing Siddhant Agarwal Shivam Sharma Preslav Nakov Tanmoy Chakraborty 130 6 0 18 May 2024
UnsafeBench: Benchmarking Image Safety Classifiers on Real-World and AI-Generated Images Y. Qu Xinyue Shen Yixin Wu Michael Backes Savvas Zannettou Yang Zhang EGVM 165 26 0 06 May 2024
What matters when building vision-language models? Hugo Laurençon Léo Tronchon Matthieu Cord Victor Sanh VLM 140 229 0 03 May 2024
Auto-Encoding Morph-Tokens for Multimodal LLM Kaihang Pan Siliang Tang Juncheng Li Zhaoyu Fan Wei Chow Shuicheng Yan Tat-Seng Chua Yueting Zhuang Hanwang Zhang MLLM 113 29 0 03 May 2024
SGHateCheck: Functional Tests for Detecting Hate Speech in Low-Resource Languages of Singapore Ri Chi Ng Nirmalendu Prakash Ming Shan Hee K. T. W. Choo Roy Ka-wei Lee 97 9 0 03 May 2024
AutoGluon-Multimodal (AutoMM): Supercharging Multimodal AutoML with Foundation Models Zhiqiang Tang Haoyang Fang Su Zhou Taojiannan Yang Zihan Zhong Tony Hu Katrin Kirchhoff George Karypis 159 24 0 24 Apr 2024
What Makes Multimodal In-Context Learning Work? Folco Bertini Baldassini Mustafa Shukor Matthieu Cord Laure Soulier Benjamin Piwowarski 200 33 0 24 Apr 2024
Exploring the Transferability of Visual Prompting for Multimodal Large Language Models Yichi Zhang Yinpeng Dong Siyuan Zhang Tianzan Min Hang Su Jun Zhu LRM VLM 147 12 0 17 Apr 2024
What Are We Measuring When We Evaluate Large Vision-Language Models? An Analysis of Latent Factors and Biases A. M. H. Tiong Junqi Zhao Boyang Albert Li Junnan Li Guosheng Lin Caiming Xiong 123 9 0 03 Apr 2024
Chinese Offensive Language Detection:Current Status and Future Directions Yunze Xiao Houda Bouamor Wajdi Zaghouani 144 3 0 27 Mar 2024
Assessment of Multimodal Large Language Models in Alignment with Human Values Zhelun Shi Zhipin Wang Hongxing Fan Zaibin Zhang Lijun Li Yongting Zhang Zhen-fei Yin Lu Sheng Yu Qiao Jing Shao 89 31 0 26 Mar 2024
Deciphering Hate: Identifying Hateful Memes and Their Targets E. Hossain Omar Sharif M. M. Hoque S. Preum 116 6 0 16 Mar 2024
Borrowing Treasures from Neighbors: In-Context Learning for Multimodal Learning with Missing Modalities and Data Scarcity Zhuo Zhi Ziquan Liu M. Elbadawi Adam Daneshmend Mine Orlu Abdul Basit Andreas Demosthenous Miguel R. D. Rodrigues 124 3 0 14 Mar 2024
Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use Imad Eddine Toubal Aditya Avinash N. Alldrin Jan Dlabal Wenlei Zhou ... Chun-Ta Lu Howard Zhou Ranjay Krishna Ariel Fuxman Tom Duerig VLM 209 15 0 05 Mar 2024
MemeCraft: Contextual and Stance-Driven Multimodal Meme Generation Han Wang Roy Ka-wei Lee 101 11 0 24 Feb 2024
GPT-HateCheck: Can LLMs Write Better Functional Tests for Hate Speech Detection? Yiping Jin Leo Wanner A. Shvets 110 4 0 23 Feb 2024
Towards Robust Instruction Tuning on Multimodal Large Language Models Wei Han Hui Chen Soujanya Poria MLLM 82 1 0 22 Feb 2024
MM-Soc: Benchmarking Multimodal Large Language Models in Social Media Platforms Yiqiao Jin Minje Choi Gaurav Verma Yongfeng Zhang Srijan Kumar 138 26 0 21 Feb 2024
GradSafe: Detecting Jailbreak Prompts for LLMs via Safety-Critical Gradient Analysis Yueqi Xie Minghong Fang Renjie Pi Neil Zhenqiang Gong 186 43 0 21 Feb 2024
Modularized Networks for Few-shot Hateful Meme Detection Rui Cao Roy Ka-wei Lee Jing Jiang 108 10 0 19 Feb 2024
Align before Attend: Aligning Visual and Textual Features for Multimodal Hateful Content Detection E. Hossain Omar Sharif M. M. Hoque S. Preum 94 5 0 15 Feb 2024
VisLingInstruct: Elevating Zero-Shot Learning in Multi-Modal Language Models with Autonomous Instruction Optimization Dongsheng Zhu Xunzhu Tang Weidong Han Jinghui Lu Yukun Zhao Guoliang Xing Junfeng Wang D. Yin VLM MLLM 143 16 0 12 Feb 2024
Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models Yongshuo Zong Ondrej Bohdal Tingyang Yu Yongxin Yang Timothy M. Hospedales VLM MLLM 185 92 0 03 Feb 2024
Safety of Multimodal Large Language Models on Images and Texts Xin Liu Yichen Zhu Yunshi Lan Chao Yang Yu Qiao 156 48 0 01 Feb 2024
Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Models Ming Shan Hee Shivam Sharma Rui Cao Palash Nandi Tanmoy Chakraborty Roy Ka-wei Lee 81 24 0 30 Jan 2024
Cross-Modal Prototype based Multimodal Federated Learning under Severely Missing Modality Huy Q. Le Chu Myaet Thwal Yu Qiao Ye Lin Tun Minh N. H. Nguyen Choong Seon Hong Choong Seon Hong 157 11 0 25 Jan 2024
MM-LLMs: Recent Advances in MultiModal Large Language Models Duzhen Zhang Yahan Yu Jiahua Dong Chenxing Li Dan Su Chenhui Chu Dong Yu OffRL LRM 255 276 0 24 Jan 2024
Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models Hongzhan Lin Ziyang Luo Wei Gao Jing Ma Bo Wang Ruichao Yang 95 21 0 24 Jan 2024