v1v2v3 (latest)

The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes

10 May 2020

Douwe Kiela

Amanpreet Singh

Papers citing "The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes"

50 / 357 papers shown

Title
OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents Hugo Laurenccon Lucile Saulnier Léo Tronchon Stas Bekman Amanpreet Singh ... Siddharth Karamcheti Alexander M. Rush Douwe Kiela Matthieu Cord Victor Sanh 227 292 0 21 Jun 2023
FedMultimodal: A Benchmark For Multimodal Federated Learning Tiantian Feng Digbalay Bose Tuo Zhang Rajat Hebbar Anil Ramakrishna Rahul Gupta Mi Zhang Salman Avestimehr Shrikanth Narayanan 193 83 0 15 Jun 2023
Modality Influence in Multimodal Machine Learning Abdelhamid Haouhat Slimane Bellaouar A. Nehar H. Cherroun 105 3 0 10 Jun 2023
Safety and Fairness for Content Moderation in Generative Models Susan Hao Piyush Kumar Sarah Laszlo Shivani Poddar Bhaktipriya Radharapu Renee Shelby EGVM 97 24 0 09 Jun 2023
TotalDefMeme: A Multi-Attribute Meme dataset on Total Defence in Singapore Nirmalendu Prakash Ming Shan Hee Roy Ka-wei Lee 79 16 0 29 May 2023
MemeGraphs: Linking Memes to Knowledge Graphs Vasiliki Kougia Simon Fetzel Thomas Kirchmair Erion cCano Sina Moayed Baharlou Sahand Sharifzadeh Benjamin Roth 121 11 0 28 May 2023
Decoding the Underlying Meaning of Multimodal Hateful Memes Ming Shan Hee Wen-Haw Chong Roy Ka-wei Lee 154 46 0 28 May 2023
MEMEX: Detecting Explanatory Evidence for Memes via Knowledge-Enriched Contextualization Shivam Sharma S Ramaneswaran Udit Arora Md. Shad Akhtar Tanmoy Chakraborty 124 10 0 25 May 2023
LAraBench: Benchmarking Arabic AI with Large Language Models Ahmed Abdelali Hamdy Mubarak Shammur A. Chowdhury Maram Hasanain Basel Mousi ... Yousseif Elshahawy Ahmed M. Ali Nadir Durrani Natasa Milic-Frayling Firoj Alam ELM LM&MA 102 28 0 24 May 2023
Images in Language Space: Exploring the Suitability of Large Language Models for Vision & Language Tasks Sherzod Hakimov David Schlangen VLM 93 7 0 23 May 2023
Validating Multimedia Content Moderation Software via Semantic Fusion Wenxuan Wang Jingyuan Huang Chang Chen Jiazhen Gu Jianping Zhang Weibin Wu Pinjia He Michael Lyu 144 10 0 23 May 2023
Rethinking Multimodal Content Moderation from an Asymmetric Angle with Mixed-modality Jialing Yuan Ye Yu Gaurav Mittal Matthew Hall Sandra Sajeev Mei Chen 117 13 0 17 May 2023
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning Wenliang Dai Junnan Li Dongxu Li A. M. H. Tiong Junqi Zhao Weisheng Wang Boyang Albert Li Pascale Fung Steven C. H. Hoi MLLM VLM 518 2,503 0 11 May 2023
A Review of Vision-Language Models and their Performance on the Hateful Memes Challenge Bryan Zhao Andrew Zhang Blake Watson Gillian Kearney Isaac Dale VLM 50 4 0 09 May 2023
HateMM: A Multi-Modal Dataset for Hate Video Classification Mithun Das R. Raj Punyajoy Saha Binny Mathew Manish Gupta Animesh Mukherjee 118 44 0 06 May 2023
Unstructured and structured data: Can we have the best of both worlds with large language models? W. Tan 141 2 0 25 Apr 2023
MemeFier: Dual-stage Modality Fusion for Image Meme Classification C. Koutlis Manos Schinas Symeon Papadopoulos 128 17 0 06 Apr 2023
Vision-Language Models for Vision Tasks: A Survey Jingyi Zhang Jiaxing Huang Sheng Jin Shijian Lu VLM 261 749 0 03 Apr 2023
DIME-FM: DIstilling Multimodal and Efficient Foundation Models Ximeng Sun Pengchuan Zhang Peizhao Zhang Hardik Shah Kate Saenko Xide Xia VLM 179 29 0 31 Mar 2023
SemiMemes: A Semi-supervised Learning Approach for Multimodal Memes Analysis Pham Thai Hoang Tung Nguyen Tan Viet Ngo Tien Anh P. D. Hung 105 5 0 31 Mar 2023
Memotion 3: Dataset on Sentiment and Emotion Analysis of Codemixed Hindi-English Memes Shreyash Mishra S. Suryavardan Parth Patwa Megha Chakraborty Anku Rani ... Amitava Das Amit P. Sheth Manoj Kumar Chinnakotla Asif Ekbal Srijan Kumar 151 17 0 17 Mar 2023
Multimodal Prompting with Missing Modalities for Visual Recognition Yi-Lun Lee Yi-Hsuan Tsai Wei-Chen Chiu Chen-Yu Lee VPVLM 158 124 0 06 Mar 2023
Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design Michelle S. Lam Zixian Ma Anne Li Izequiel Freitas Dakuo Wang James A. Landay Michael S. Bernstein 281 28 0 06 Mar 2023
Language Is Not All You Need: Aligning Perception with Language Models Shaohan Huang Li Dong Wenhui Wang Y. Hao Saksham Singhal ... Johan Bjorck Vishrav Chaudhary Subhojit Som Xia Song Furu Wei VLM LRM MLLM 244 614 0 27 Feb 2023
TOT: Topology-Aware Optimal Transport For Multimodal Hate Detection Linhao Zhang Li Jin Xian Sun Guangluan Xu Zequn Zhang Xiaoyu Li Nayu Liu Qing Liu Shiyao Yan 118 8 0 27 Feb 2023
Cluster-based Deep Ensemble Learning for Emotion Classification in Internet Memes Xiaoyu Guo Jing Ma A. Zubiaga 101 0 0 16 Feb 2023
HateProof: Are Hateful Meme Detection Systems really Robust? Piush Aggarwal Pranit Chawla Mithun Das Punyajoy Saha Binny Mathew Torsten Zesch Animesh Mukherjee AAML 98 10 0 11 Feb 2023
Prompting for Multimodal Hateful Meme Classification Rui Cao Roy Ka-wei Lee Wen-Haw Chong Jing Jiang VLM 121 96 0 08 Feb 2023
Regulating ChatGPT and other Large Generative AI Models P. Hacker A. Engel M. Mauer AILaw 378 388 0 05 Feb 2023
Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking Mubashara Akhtar O. Cocarascu Elena Simperl 157 34 0 27 Jan 2023
Down the Rabbit Hole: Detecting Online Extremism, Radicalisation, and Politicised Hate Speech Jarod Govers Philip G. Feldman Aaron Dant Panos Patros 80 35 0 27 Jan 2023
Characterizing the Entities in Harmful Memes: Who is the Hero, the Villain, the Victim? Shivam Sharma Atharva Kulkarni Tharun Suresh Himanshi Mathur Preslav Nakov Md. Shad Akhtar Tanmoy Chakraborty 146 21 0 26 Jan 2023
Qualitative Analysis of a Graph Transformer Approach to Addressing Hate Speech: Adapting to Dynamically Changing Content Liam Hebert Hong Chen R. Cohen Lukasz Golab 100 4 0 25 Jan 2023
The State of Human-centered NLP Technology for Fact-checking Anubrata Das Houjiang Liu Venelin Kovatchev Matthew Lease HILM 176 74 0 08 Jan 2023
Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training Filip Radenovic Abhimanyu Dubey Abhishek Kadian Todor Mihaylov Simon Vandenhende Yash J. Patel Y. Wen Vignesh Ramanathan D. Mahajan VLM 171 96 0 05 Jan 2023
MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning Zhiyang Xu Ying Shen Lifu Huang MLLM 206 123 0 21 Dec 2022
Are Deep Neural Networks SMARTer than Second Graders? A. Cherian Kuan-Chuan Peng Suhas Lohit Kevin A. Smith J. Tenenbaum AAML LRM ReLM 144 33 0 20 Dec 2022
Understanding Zero-Shot Adversarial Robustness for Large-Scale Models Chengzhi Mao Scott Geng Junfeng Yang Xin Eric Wang Carl Vondrick VLM 176 91 0 14 Dec 2022
The Hateful Memes Challenge Next Move Weijun Jin Lance Wilhelm VLM 115 1 0 13 Dec 2022
On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learning Y. Qu Xinlei He S. Pierson Michael Backes Yang Zhang Savvas Zannettou 110 33 0 13 Dec 2022
Multimodal and Explainable Internet Meme Classification A. Thakur Filip Ilievski Hông-Ân Sandlin Zhivar Sourati Luca Luceri Riccardo Tommasini Alain Mermoud 124 8 0 11 Dec 2022
What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memes Shivam Sharma Siddhant Agarwal Tharun Suresh Preslav Nakov Md. Shad Akhtar Tanmoy Charkraborty VLM 141 23 0 01 Dec 2022
Multitask Vision-Language Prompt Tuning Sheng Shen Shijia Yang Tianjun Zhang Bohan Zhai Joseph E. Gonzalez Kurt Keutzer Trevor Darrell VLM VPVLM 216 69 0 21 Nov 2022
AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities Zhongzhi Chen Guangyi Liu Bo Zhang Fulong Ye Qinghong Yang Ledell Yu Wu VLM 151 95 0 12 Nov 2022
Robustness of Fusion-based Multimodal Classifiers to Cross-Modal Content Dilutions Gaurav Verma Vishwa Vinay Ryan A. Rossi Srijan Kumar VLM AAML 108 9 0 04 Nov 2022
Non-Contrastive Learning Meets Language-Image Pre-Training Jinghao Zhou Li Dong Zhe Gan Lijuan Wang Furu Wei VLM CLIP 110 30 0 17 Oct 2022
One does not fit all! On the Complementarity of Vision Encoders for Vision and Language Tasks Gregor Geigle Chen Cecilia Liu Jonas Pfeiffer Iryna Gurevych VLM 88 1 0 12 Oct 2022
Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Features Gokul Karthik Kumar Karthik Nandakumar VLM CLIP 140 72 0 12 Oct 2022
Underspecification in Scene Description-to-Depiction Tasks Ben Hutchinson Jason Baldridge Vinodkumar Prabhakaran DiffM 160 36 0 11 Oct 2022
Transfer Learning with Joint Fine-Tuning for Multimodal Sentiment Analysis Guilherme Lourencco de Toledo R. Marcacini 66 6 0 11 Oct 2022