Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions?

11 June 2016

Devi Parikh

Papers citing "Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions?"

50 / 230 papers shown

Title
Explaining Deep Neural Networks Oana-Maria Camburu XAI FAtt 12 26 0 04 Oct 2020
Describing Unseen Videos via Multi-Modal Cooperative Dialog Agents Ye Zhu Yu Wu Yi Yang Yan Yan 11 13 0 18 Aug 2020
AiR: Attention with Reasoning Capability Shi Chen Ming Jiang Jinhui Yang Qi Zhao LRM 13 36 0 28 Jul 2020
Comprehensive Image Captioning via Scene Graph Decomposition Yiwu Zhong Liwei Wang Jianshu Chen Dong Yu Yin Li 79 124 0 23 Jul 2020
Reducing Language Biases in Visual Question Answering with Visually-Grounded Question Encoder K. Gouthaman Anurag Mittal 42 78 0 13 Jul 2020
The Impact of Explanations on AI Competency Prediction in VQA Kamran Alipour Arijit Ray Xiaoyu Lin J. Schulze Yi Yao Giedrius Burachas 14 9 0 02 Jul 2020
$Improving VQA and its Explanations \\ by Comparing Competing Explanations$ Improving VQA and its Explanations \\ by Comparing Competing Explanations Jialin Wu Liyan Chen Raymond J. Mooney FAtt AAML 33 17 0 28 Jun 2020
Overcoming Statistical Shortcuts for Open-ended Visual Counting Corentin Dancette Rémi Cadène Xinlei Chen Matthieu Cord 8 3 0 17 Jun 2020
Estimating semantic structure for the VQA answer space Corentin Kervadec G. Antipov M. Baccouche Christian Wolf 18 4 0 10 Jun 2020
Cost-effective Interactive Attention Learning with Neural Attention Processes Jay Heo Junhyeong Park Hyewon Jeong Kwang Joon Kim Juho Lee Eunho Yang Sung Ju Hwang 6 8 0 09 Jun 2020
Roses Are Red, Violets Are Blue... but Should Vqa Expect Them To? Corentin Kervadec G. Antipov M. Baccouche Christian Wolf OOD 16 87 0 09 Jun 2020
Human brain activity for machine attention Lukas Muttenthaler Nora Hollenstein Maria Barrett 9 14 0 09 Jun 2020
Counterfactual VQA: A Cause-Effect Look at Language Bias Yulei Niu Kaihua Tang Hanwang Zhang Zhiwu Lu Xiansheng Hua Ji-Rong Wen CML 36 394 0 08 Jun 2020
Visual Question Answering Using Semantic Information from Image Descriptions Tasmia Tasrin Md Sultan al Nahian Brent Harrison 12 0 0 23 Apr 2020
Learning What Makes a Difference from Counterfactual Examples and Gradient Supervision Damien Teney Ehsan Abbasnejad A. Hengel OOD SSL CML 26 118 0 20 Apr 2020
Visual Grounding Methods for VQA are Working for the Wrong Reasons! Robik Shrestha Kushal Kafle Christopher Kanan CML 14 35 0 12 Apr 2020
An Entropy Clustering Approach for Assessing Visual Question Difficulty K. Terao Toru Tamaki B. Raytchev K. Kaneda Shuníchi Satoh OOD AAML 26 1 0 12 Apr 2020
Generating Rationales in Visual Question Answering Hammad A. Ayyubi Md. Mehrab Tanjim Julian McAuley G. Cottrell LRM 14 5 0 04 Apr 2020
Natural Language Processing Advancements By Deep Learning: A Survey A. Torfi Rouzbeh A. Shirvani Yaser Keneshloo Nader Tavvaf Edward A. Fox AI4CE VLM 78 214 0 02 Mar 2020
A Study on Multimodal and Interactive Explanations for Visual Question Answering Kamran Alipour J. Schulze Yi Yao Avi Ziskind Giedrius Burachas 12 27 0 01 Mar 2020
What BERT Sees: Cross-Modal Transfer for Visual Question Generation Thomas Scialom Patrick Bordes Paul-Alexis Dray Jacopo Staiano Patrick Gallinari 23 6 0 25 Feb 2020
Sparse and Structured Visual Attention Pedro Henrique Martins S. Becker Zita Marinho Michael Arens 27 8 0 13 Feb 2020
Uncertainty based Class Activation Maps for Visual Question Answering Badri N. Patro Mayank Lunayach Vinay P. Namboodiri FAtt UQCV 6 1 0 23 Jan 2020
SQuINTing at VQA Models: Introspecting VQA Models with Sub-Questions Ramprasaath R. Selvaraju Purva Tendulkar Devi Parikh Eric Horvitz Marco Tulio Ribeiro Besmira Nushi Ece Kamar LRM 8 14 0 20 Jan 2020
Explainable Deep Relational Networks for Predicting Compound-Protein Affinities and Contacts Mostafa Karimi Di Wu Zhangyang Wang Yang Shen 25 46 0 29 Dec 2019
Deep Exemplar Networks for VQA and VQG Badri N. Patro Vinay P. Namboodiri 11 4 0 19 Dec 2019
Connecting Vision and Language with Localized Narratives Jordi Pont-Tuset J. Uijlings Soravit Changpinyo Radu Soricut V. Ferrari ObjD 20 240 0 06 Dec 2019
Explanation vs Attention: A Two-Player Game to Obtain Attention for VQA Badri N. Patro Anupriy Vinay P. Namboodiri AAML FAtt 32 26 0 19 Nov 2019
Two-Headed Monster And Crossed Co-Attention Networks Yaoyiran Li Jing Jiang 19 0 0 10 Nov 2019
TAB-VCR: Tags and Attributes based Visual Commonsense Reasoning Baselines Jingxiang Lin Unnat Jain A. Schwing LRM ReLM 26 9 0 31 Oct 2019
Deep causal representation learning for unsupervised domain adaptation Raha Moraffah Kai Shu A. Raglin Huan Liu CML OOD 23 11 0 28 Oct 2019
Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI Alejandro Barredo Arrieta Natalia Díaz Rodríguez Javier Del Ser Adrien Bennetot S. Tabik ... S. Gil-Lopez Daniel Molina Richard Benjamins Raja Chatila Francisco Herrera XAI 11 6,106 0 22 Oct 2019
Dynamic Attention Networks for Task Oriented Grounding S. Dasgupta Badri N. Patro Vinay P. Namboodiri 14 1 0 14 Oct 2019
Granular Multimodal Attention Networks for Visual Dialog Badri N. Patro Shivansh Patel Vinay P. Namboodiri 19 1 0 13 Oct 2019
What can computational models learn from human selective attention? A review from an audiovisual crossmodal perspective Di Fu C. Weber Guochun Yang Matthias Kerzel Weizhi Nan Pablo V. A. Barros Haiyan Wu Xun Liu S. Wermter 9 0 0 05 Sep 2019
Semantic-Aware Scene Recognition Alejandro López-Cifuentes Marcos Escudero-Viñolo Jesús Bescós Álvaro García-Martín 11 102 0 05 Sep 2019
A Better Way to Attend: Attention with Trees for Video Question Answering Hongyang Xue Wenqing Chu Zhou Zhao Deng Cai 17 33 0 05 Sep 2019
Saccader: Improving Accuracy of Hard Attention Models for Vision Gamaleldin F. Elsayed Simon Kornblith Quoc V. Le VLM 25 70 0 20 Aug 2019
Towards High-Resolution Salient Object Detection Yi Zeng Pingping Zhang Jianming Zhang Zhe-nan Lin Huchuan Lu 19 197 0 20 Aug 2019
U-CAM: Visual Explanation using Uncertainty based Class Activation Maps Badri N. Patro Mayank Lunayach Shivansh Patel Vinay P. Namboodiri FAtt UQCV 19 76 0 17 Aug 2019
Question-Agnostic Attention for Visual Question Answering M. Farazi Salman H Khan Nick Barnes 13 10 0 09 Aug 2019
Learning by Abstraction: The Neural State Machine Drew A. Hudson Christopher D. Manning NAI OCL 8 258 0 09 Jul 2019
RUBi: Reducing Unimodal Biases in Visual Question Answering Rémi Cadène Corentin Dancette H. Ben-younes Matthieu Cord Devi Parikh CML 19 368 0 24 Jun 2019
Understanding More about Human and Machine Attention in Deep Neural Networks Qiuxia Lai Salman Khan Wenguan Wang Jianbing Shen Hanqiu Sun Ling Shao HAI XAI 8 7 0 20 Jun 2019
Near-Optimal Glimpse Sequences for Improved Hard Attention Neural Network Training William Harvey Michael Teng Frank D. Wood 18 4 0 13 Jun 2019
Learning to Generate Grounded Visual Captions without Localization Supervision Chih-Yao Ma Yannis Kalantidis Ghassan AlRegib Peter Vajda Marcus Rohrbach Z. Kira SSL 6 10 0 01 Jun 2019
Do Human Rationales Improve Machine Explanations? Julia Strout Ye Zhang Raymond J. Mooney 8 57 0 31 May 2019
Recurrent Existence Determination Through Policy Optimization Baoxiang Wang 8 1 0 29 May 2019
Self-Critical Reasoning for Robust Visual Question Answering Jialin Wu Raymond J. Mooney OOD NAI 24 159 0 24 May 2019
TVQA+: Spatio-Temporal Grounding for Video Question Answering Jie Lei Licheng Yu Tamara L. Berg Mohit Bansal 23 227 0 25 Apr 2019