End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Models

25 May 2022

Lichao Sun

Papers citing "End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Models"

50 / 50 papers shown

Title
Latent Multimodal Reconstruction for Misinformation Detection Stefanos-Iordanis Papadopoulos C. Koutlis Symeon Papadopoulos P. Petrantonakis 34 0 0 08 Apr 2025
Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievals Linda Zeng Rithwik Gupta Divij Motwani Diji Yang Yi Zhang AAML 41 1 0 22 Feb 2025
Ask in Any Modality: A Comprehensive Survey on Multimodal Retrieval-Augmented Generation Mohammad Mahdi Abootorabi Amirhosein Zobeiri Mahdi Dehghani Mohammadali Mohammadkhani Bardia Mohammadi Omid Ghahroodi M. Baghshah Ehsaneddin Asgari RALM 95 3 0 12 Feb 2025
Mitigating GenAI-powered Evidence Pollution for Out-of-Context Multimodal Misinformation Detection Zehong Yan Peng Qi W. Hsu M. Lee 39 0 0 24 Jan 2025
DEFAME: Dynamic Evidence-based FAct-checking with Multimodal Experts Tobias Braun Mark Rothermel Marcus Rohrbach Anna Rohrbach 81 1 0 13 Dec 2024
What Factors Affect Multi-Modal In-Context Learning? An In-Depth Exploration L. Qin Qiguang Chen Hao Fei Zhi Chen Min Li Wanxiang Che 34 5 0 27 Oct 2024
CAMEL-Bench: A Comprehensive Arabic LMM Benchmark Sara Ghaboura Ahmed Heakl Omkar Thawakar Ali Alharthi Ines Riahi Abduljalil Saif Jorma T. Laaksonen F. Khan Salman Khan Rao Muhammad Anwer 40 0 0 24 Oct 2024
AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark Wenhao Chai Enxin Song Y. Du Chenlin Meng Vashisht Madhavan Omer Bar-Tal Jeng-Neng Hwang Saining Xie Christopher D. Manning 3DV 71 25 0 04 Oct 2024
Multimodal Coherent Explanation Generation of Robot Failures Pradip Pramanick Silvia Rossi 16 1 0 01 Oct 2024
Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMs Fengzhu Zeng Wenqian Li Wei Gao Yan Pang 37 2 0 29 Sep 2024
CommunityKG-RAG: Leveraging Community Structures in Knowledge Graphs for Advanced Retrieval-Augmented Generation in Fact-Checking Rong-Ching Chang Jiawei Zhang 41 2 0 16 Aug 2024
LiveFC: A System for Live Fact-Checking of Audio Streams Venktesh V Vinay Setty 23 3 0 14 Aug 2024
Multimodal Misinformation Detection using Large Vision-Language Models Sahar Tahmasebi Eric Müller-Budack Ralph Ewerth 34 4 0 19 Jul 2024
Similarity over Factuality: Are we making progress on multimodal out-of-context misinformation detection? Stefanos-Iordanis Papadopoulos C. Koutlis Symeon Papadopoulos P. Petrantonakis 43 4 0 18 Jul 2024
MetaSumPerceiver: Multimodal Multi-Document Evidence Summarization for Fact-Checking Ting-Chih Chen Chia-Wei Tang Chris Thomas 29 3 0 18 Jul 2024
Automated Justification Production for Claim Veracity in Fact Checking: A Survey on Architectures and Approaches Islam Eldifrawi Shengrui Wang Amine Trabelsi 31 8 0 09 Jul 2024
Merge, Ensemble, and Cooperate! A Survey on Collaborative Strategies in the Era of Large Language Models Jinliang Lu Ziliang Pang Min Xiao Yaochen Zhu Rui Xia Jiajun Zhang MoMe 27 17 0 08 Jul 2024
How to Train Your Fact Verifier: Knowledge Transfer with Multimodal Open Models Jaeyoung Lee Ximing Lu Jack Hessel Faeze Brahman Youngjae Yu Yonatan Bisk Yejin Choi Saadia Gabriel 21 3 0 29 Jun 2024
Fairness and Bias in Multimodal AI: A Survey Tosin P. Adewumi Lama Alkhaled Namrata Gurung G. V. Boven Irene Pagliai 48 9 0 27 Jun 2024
MFC-Bench: Benchmarking Multimodal Fact-Checking with Large Vision-Language Models Shengkang Wang Hongzhan Lin Ziyang Luo Zhen Ye Guang Chen Jing Ma 53 3 0 17 Jun 2024
Retrieval Augmented Fact Verification by Synthesizing Contrastive Arguments Zhenrui Yue Huimin Zeng Lanyu Shang Yifan Liu Yang Zhang Dong Wang RALM 33 1 0 14 Jun 2024
MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMs Xuannan Liu Zekun Li Peipei Li Shuhan Xia Xing Cui Linzhi Huang Huaibo Huang Weihong Deng Zhaofeng He 36 11 0 13 Jun 2024
A Survey of Multimodal Large Language Model from A Data-centric Perspective Tianyi Bai Hao Liang Binwang Wan Yanran Xu Xi Li ... Ping-Chia Huang Jiulong Shan Conghui He Binhang Yuan Wentao Zhang 47 36 0 26 May 2024
ViWikiFC: Fact-Checking for Vietnamese Wikipedia-Based Textual Knowledge Source Hung Tuan Le Long Truong To Manh Trong Nguyen Kiet Van Nguyen 16 3 0 13 May 2024
Credible, Unreliable or Leaked?: Evidence Verification for Enhanced Automated Fact-checking Zacharias Chrysidis Stefanos-Iordanis Papadopoulos Symeon Papadopoulos P. Petrantonakis 23 8 0 29 Apr 2024
Classifying Human-Generated and AI-Generated Election Claims in Social Media A. Dmonte Marcos Zampieri Kevin Lybarger Massimiliano Albanese Genya Coulter DeLMO 31 3 0 24 Apr 2024
RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models M. A. Khaliq P. Chang M. Ma B. Pflugfelder F. Miletić LRM 17 5 0 18 Apr 2024
RU22Fact: Optimizing Evidence for Multilingual Explainable Fact-Checking on Russia-Ukraine Conflict Yirong Zeng Xiao Ding Yi Zhao Xiangyu Li Jie Zhang Chao Yao Ting Liu Bing Qin HILM 24 0 0 25 Mar 2024
CoTBal: Comprehensive Task Balancing for Multi-Task Visual Instruction Tuning Yanqi Dai Dong Jing Nanyi Fei Zhiwu Lu Nanyi Fei Guoxing Yang Zhiwu Lu 43 2 0 07 Mar 2024
Multimodal Large Language Models to Support Real-World Fact-Checking Jiahui Geng Yova Kementchedjhieva Preslav Nakov Iryna Gurevych LRM 19 11 0 06 Mar 2024
Cross-Lingual Learning vs. Low-Resource Fine-Tuning: A Case Study with Fact-Checking in Turkish R. Çekinel Pinar Senkul Çağrı Çöltekin 19 1 0 01 Mar 2024
Assessing News Thumbnail Representativeness: Counterfactual text can enhance the cross-modal matching ability Yejun Yoon Seunghyun Yoon Kunwoo Park 18 0 0 17 Feb 2024
JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claims Fengzhu Zeng Wei Gao 32 15 0 16 Jan 2024
Fact-checking based fake news detection: a review Yuzhou Yang Yangming Zhou Qichao Ying Zhenxing Qian Dan Zeng Liang Liu EgoV 42 0 0 03 Jan 2024
Justifiable Artificial Intelligence: Engineering Large Language Models for Legal Applications Sabine Wehnert AILaw 29 4 0 27 Nov 2023
RED-DOT: Multimodal Fact-checking via Relevant Evidence Detection Stefanos-Iordanis Papadopoulos C. Koutlis Symeon Papadopoulos P. Petrantonakis 19 9 0 16 Nov 2023
Support or Refute: Analyzing the Stance of Evidence to Detect Out-of-Context Mis- and Disinformation Xin Yuan Jie Guo Weidong Qiu Zheng Huang Shujun Li 35 13 0 03 Nov 2023
ReForm-Eval: Evaluating Large Vision Language Models via Unified Re-Formulation of Task-Oriented Benchmarks Zejun Li Ye Wang Mengfei Du Qingwen Liu Binhao Wu ... Zhihao Fan Jie Fu Jingjing Chen Xuanjing Huang Zhongyu Wei 20 13 0 04 Oct 2023
A Survey on Interpretable Cross-modal Reasoning Dizhan Xue Shengsheng Qian Zuyi Zhou Changsheng Xu LRM 24 4 0 05 Sep 2023
M $^3$ IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuning Lei Li Yuwei Yin Shicheng Li Liang Chen Peiyi Wang ... Yazheng Yang Jingjing Xu Xu Sun Lingpeng Kong Qi Liu MLLM VLM 14 113 0 07 Jun 2023
Multimodal Automated Fact-Checking: A Survey Mubashara Akhtar M. Schlichtkrull Zhijiang Guo O. Cocarascu Elena Simperl Andreas Vlachos 18 32 0 22 May 2023
FACTIFY3M: A Benchmark for Multimodal Fact Verification with Explainability through 5W Question-Answering Megha Chakraborty Khusbu Pahwa Anku Rani Shreyas Chatterjee Dwip Dalal ... Shreyash Mishra K. Sensharma Aman Chadha Amit P. Sheth Amitava Das DiffM 14 4 0 22 May 2023
Factify 2: A Multimodal Fake News and Satire News Dataset S. Suryavardan Shreyash Mishra Parth Patwa Megha Chakraborty Anku Rani ... Amitava Das Amit P. Sheth Manoj Kumar Chinnakotla Asif Ekbal Srijan Kumar 12 23 0 08 Apr 2023
IRFL: Image Recognition of Figurative Language Ron Yosef Yonatan Bitton Dafna Shahaf 33 17 0 27 Mar 2023
INO at Factify 2: Structure Coherence based Multi-Modal Fact Verification Yinuo Zhang Zhulin Tao Xi Wang Tongyue Wang 11 5 0 02 Mar 2023
Reading and Reasoning over Chart Images for Evidence-based Automated Fact-Checking Mubashara Akhtar O. Cocarascu Elena Simperl 14 25 0 27 Jan 2023
Logically at Factify 2: A Multi-Modal Fact Checking System Based on Evidence Retrieval techniques and Transformer Encoder Architecture P. Verschuuren Jie Gao A. V. Eeden Stylianos Oikonomou Anil Bandhakavi 8 2 0 09 Jan 2023
MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning Zhiyang Xu Ying Shen Lifu Huang MLLM 16 110 0 21 Dec 2022
Extractive and Abstractive Explanations for Fact-Checking and Evaluation of News Ashkan Kazemi Zehua Li Verónica Pérez-Rosas Rada Mihalcea 19 14 0 27 Apr 2021
Explainable Automated Fact-Checking for Public Health Claims Neema Kotonya Francesca Toni 202 247 0 19 Oct 2020