Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solution

15 December 2020

Papers citing "Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solution"

38 / 38 papers shown

Title
Detecting and Mitigating Hateful Content in Multimodal Memes with Vision-Language Models Minh-Hao Van Xintao Wu VLM 157 0 0 30 Apr 2025
What's Pulling the Strings? Evaluating Integrity and Attribution in AI Training and Inference through Concept Shift Jiamin Chang Haoyang Li Hammond Pearce Ruoxi Sun Yue Liu Minhui Xue 81 0 0 28 Apr 2025
Prompt-enhanced Network for Hateful Meme Classification Junxi Liu Yanyan Feng Jiehai Chen Yun Xue Fenghuan Li VLM 111 0 0 12 Nov 2024
Towards Low-Resource Harmful Meme Detection with LMM Agents Jianzhao Huang Hongzhan Lin Ziyan Liu Ziyang Luo Guang Chen Jing Ma 80 6 0 08 Nov 2024
Toxic Memes: A Survey of Computational Perspectives on the Detection and Explanation of Meme Toxicities Delfina Sol Martinez Pandiani Erik Tjong Kim Sang Davide Ceolin 100 4 0 11 Jun 2024
Modularized Networks for Few-shot Hateful Meme Detection Rui Cao Roy Ka-wei Lee Jing Jiang 64 6 0 19 Feb 2024
Towards Explainable Harmful Meme Detection through Multimodal Debate between Large Language Models Hongzhan Lin Ziyang Luo Wei Gao Jing Ma Bo Wang Ruichao Yang 66 16 0 24 Jan 2024
PromptMTopic: Unsupervised Multimodal Topic Modeling of Memes using Large Language Models Nirmalendu Prakash Han Wang N. Hoang Ming Shan Hee Roy Ka-wei Lee 67 12 0 11 Dec 2023
Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models Hongzhan Lin Ziyang Luo Jing Ma Long Chen 60 12 0 09 Dec 2023
Detecting and Correcting Hate Speech in Multimodal Memes with Large Visual Language Model Minh-Hao Van Xintao Wu VLM MLLM 65 11 0 12 Nov 2023
Mapping Memes to Words for Multimodal Hateful Meme Classification Giovanni Burbi Alberto Baldrati Lorenzo Agnolucci Marco Bertini A. Bimbo 61 19 0 12 Oct 2023
Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detection Rui Cao Ming Shan Hee Adriel Kuek Wen-Haw Chong Roy Ka-wei Lee Jing Jiang VLM MLLM 56 42 0 16 Aug 2023
Unimodal Intermediate Training for Multimodal Meme Sentiment Classification Muzhaffar Hazman Susan Mckeever Josephine Griffith 78 1 0 01 Aug 2023
ARC-NLP at Multimodal Hate Speech Event Detection 2023: Multimodal Methods Boosted by Ensemble Learning, Syntactical and Entity Features Umitcan Sahin Izzet Emre Kucukkaya Oguzhan Ozcelik Cagri Toraman 73 11 0 25 Jul 2023
MemeGraphs: Linking Memes to Knowledge Graphs Vasiliki Kougia Simon Fetzel Thomas Kirchmair Erion cCano Sina Moayed Baharlou Sahand Sharifzadeh Benjamin Roth 79 11 0 28 May 2023
Unsafe Diffusion: On the Generation of Unsafe Images and Hateful Memes From Text-To-Image Models Y. Qu Xinyue Shen Xinlei He Michael Backes Savvas Zannettou Yang Zhang 66 124 0 23 May 2023
Rethinking Multimodal Content Moderation from an Asymmetric Angle with Mixed-modality Jialing Yuan Ye Yu Gaurav Mittal Matthew Hall Sandra Sajeev Mei Chen 93 10 0 17 May 2023
A Review of Vision-Language Models and their Performance on the Hateful Memes Challenge Bryan Zhao Andrew Zhang Blake Watson Gillian Kearney Isaac Dale VLM 24 4 0 09 May 2023
MemeFier: Dual-stage Modality Fusion for Image Meme Classification C. Koutlis Manos Schinas Symeon Papadopoulos 63 15 0 06 Apr 2023
Model Sketching: Centering Concepts in Early-Stage Machine Learning Model Design Michelle S. Lam Zixian Ma Anne Li Izequiel Freitas Dakuo Wang James A. Landay Michael S. Bernstein 216 24 0 06 Mar 2023
Meme Sentiment Analysis Enhanced with Multimodal Spatial Encoding and Facial Embedding Muzhaffar Hazman Susan Mckeever Josephine Griffith 83 4 0 03 Mar 2023
TOT: Topology-Aware Optimal Transport For Multimodal Hate Detection Linhao Zhang Li Jin Xian Sun Guangluan Xu Zequn Zhang Xiaoyu Li Nayu Liu Qing Liu Shiyao Yan 81 8 0 27 Feb 2023
Prompting for Multimodal Hateful Meme Classification Rui Cao Roy Ka-wei Lee Wen-Haw Chong Jing Jiang VLM 83 83 0 08 Feb 2023
The Hateful Memes Challenge Next Move Weijun Jin Lance Wilhelm VLM 80 1 0 13 Dec 2022
On the Evolution of (Hateful) Memes by Means of Multimodal Contrastive Learning Y. Qu Xinlei He S. Pierson Michael Backes Yang Zhang Savvas Zannettou 67 28 0 13 Dec 2022
Multimodal Transformer for Parallel Concatenated Variational Autoencoders Stephen D. Liang J. Mendel ViT 66 5 0 28 Oct 2022
Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Features Gokul Karthik Kumar Karthik Nandakumar VLM CLIP 86 65 0 12 Oct 2022
Flamingo: a Visual Language Model for Few-Shot Learning Jean-Baptiste Alayrac Jeff Donahue Pauline Luc Antoine Miech Iain Barr ... Mikolaj Binkowski Ricardo Barreira Oriol Vinyals Andrew Zisserman Karen Simonyan MLLM VLM 423 3,617 0 29 Apr 2022
RubCSG at SemEval-2022 Task 5: Ensemble learning for identifying misogynous MEMEs Wentao Yu Benedikt T. Boenninghoff Jonas Roehrig D. Kolossa 37 3 0 08 Apr 2022
On Explaining Multimodal Hateful Meme Detection Models Ming Shan Hee Roy Ka-wei Lee Wen-Haw Chong VLM 107 41 0 04 Apr 2022
Feels Bad Man: Dissecting Automated Hateful Meme Detection Through the Lens of Facebook's Challenge Catherine Jennifer Fatemeh Tahmasbi Jeremy Blackburn Gianluca Stringhini Savvas Zannettou Emiliano De Cristofaro 38 6 0 17 Feb 2022
Emotion Based Hate Speech Detection using Multimodal Learning Aneri Rana Sonali Jha 74 41 0 13 Feb 2022
Detecting Harmful Memes and Their Targets Shraman Pramanick Dimitar Dimitrov Rituparna Mukherjee Shivam Sharma Md. Shad Akhtar Preslav Nakov Tanmoy Chakraborty 80 116 0 24 Sep 2021
An Interpretable Approach to Hateful Meme Detection Tanvi Deshpande Nitya Mani VLM 53 15 0 09 Aug 2021
Disentangling Hate in Online Memes Rui Cao Ziqing Fan Roy Ka-wei Lee Wen-Haw Chong Jing Jiang 65 81 0 09 Aug 2021
Towards A Multi-agent System for Online Hate Speech Detection Gaurav Sahu R. Cohen Olga Vechtomova 55 10 0 03 May 2021
What is Multimodality? Letitia Parcalabescu Nils Trost Anette Frank 56 0 0 10 Mar 2021
Detecting Harmful Content On Online Platforms: What Platforms Need Vs. Where Research Efforts Go Arnav Arora Preslav Nakov Momchil Hardalov Sheikh Muhammad Sarwar Vibha Nayak ... Dimitrina Zlatkova Kyle Dent Ameya Bhatawdekar Guillaume Bouchard Isabelle Augenstein 88 53 0 27 Feb 2021