Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions?

11 June 2016

Devi Parikh

Papers citing "Human Attention in Visual Question Answering: Do Humans and Deep Networks Look at the Same Regions?"

50 / 230 papers shown

Title
Behind the Machine's Gaze: Neural Networks with Biologically-inspired Constraints Exhibit Human-like Visual Attention Leo Schwinn Doina Precup Bjoern M. Eskofier Dario Zanca 12 7 0 19 Apr 2022
A General Survey on Attention Mechanisms in Deep Learning Gianni Brauwers Flavius Frasincar 23 295 0 27 Mar 2022
CNN Attention Guidance for Improved Orthopedics Radiographic Fracture Classification Zhibin Liao Kewen Liao Haifeng Shen M. F. van Boxel J. Prijs R. Jaarsma J. Doornberg A. Hengel Johan W. Verjans 21 14 0 21 Mar 2022
Joint Answering and Explanation for Visual Commonsense Reasoning Zhenyang Li Yangyang Guo Ke-Jyun Wang Yin-wei Wei Liqiang Nie Mohan S. Kankanhalli 19 16 0 25 Feb 2022
An experimental study of the vision-bottleneck in VQA Pierre Marza Corentin Kervadec G. Antipov M. Baccouche Christian Wolf 18 1 0 14 Feb 2022
Aligning Eyes between Humans and Deep Neural Network through Interactive Attention Alignment Yuyang Gao Tong Sun Liang Zhao Sungsoo Ray Hong HAI 21 37 0 06 Feb 2022
Grounding Answers for Visual Questions Asked by Visually Impaired People Chongyan Chen Samreen Anjum Danna Gurari 23 50 0 04 Feb 2022
Deep Learning Approaches on Image Captioning: A Review Taraneh Ghandi H. Pourreza H. Mahyar VLM 8 88 0 31 Jan 2022
A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answering Feng Gao Q. Ping Govind Thattai Aishwarya N. Reganti Yingting Wu Premkumar Natarajan 13 16 0 14 Jan 2022
On the Efficacy of Co-Attention Transformer Layers in Visual Question Answering Ankur Sikarwar Gabriel Kreiman ViT 8 1 0 11 Jan 2022
COIN: Counterfactual Image Generation for VQA Interpretation Zeyd Boukhers Timo Hartmann Jan Jurjens 11 7 0 10 Jan 2022
Medical Visual Question Answering: A Survey Zhihong Lin Donghao Zhang Qingyi Tao Danli Shi Gholamreza Haffari Qi Wu M. He Z. Ge 28 112 0 19 Nov 2021
Addressing Multiple Salient Object Detection via Dual-Space Long-Range Dependencies Bowen Deng Andrew P. French Michael P. Pound 6 4 0 04 Nov 2021
Human Attention in Fine-grained Classification Yao Rong Wenjia Xu Zeynep Akata Enkelejda Kasneci 21 35 0 02 Nov 2021
Improving Users' Mental Model with Attention-directed Counterfactual Edits Kamran Alipour Arijit Ray Xiaoyu Lin Michael Cogswell J. Schulze Yi Yao Giedrius Burachas OOD 14 9 0 13 Oct 2021
Beyond Accuracy: A Consolidated Tool for Visual Question Answering Benchmarking Dirk Vath Pascal Tilli Ngoc Thang Vu 33 4 0 11 Oct 2021
Multimodal Integration of Human-Like Attention in Visual Question Answering Ekta Sood Fabian Kögel Philippe Muller Dominike Thomas Mihai Bâce Andreas Bulling 33 16 0 27 Sep 2021
VQA-MHUG: A Gaze Dataset to Study Multimodal Neural Attention in Visual Question Answering Ekta Sood Fabian Kögel Florian Strohm Prajit Dhar Andreas Bulling 29 19 0 27 Sep 2021
Discovering the Unknown Knowns: Turning Implicit Knowledge in the Dataset into Explicit Training Examples for Visual Question Answering Jihyung Kil Cheng Zhang D. Xuan Wei-Lun Chao 56 20 0 13 Sep 2021
On the Significance of Question Encoder Sequence Model in the Out-of-Distribution Performance in Visual Question Answering K. Gouthaman Anurag Mittal CML 37 0 0 28 Aug 2021
LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matching Kun Zhang Guangyi Lv Le Wu Enhong Chen Qi Liu Meng Wang 17 6 0 06 Aug 2021
Greedy Gradient Ensemble for Robust Visual Question Answering Xinzhe Han Shuhui Wang Chi Su Qingming Huang Q. Tian 18 74 0 27 Jul 2021
Separating Skills and Concepts for Novel Visual Question Answering Spencer Whitehead Hui Wu Heng Ji Rogerio Feris Kate Saenko CoGe 30 34 0 19 Jul 2021
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation Junnan Li Ramprasaath R. Selvaraju Akhilesh Deepak Gotmare Shafiq R. Joty Caiming Xiong S. Hoi FaML 48 1,881 0 16 Jul 2021
Passive Attention in Artificial Neural Networks Predicts Human Visual Selectivity Thomas A. Langlois H. C. Zhao Erin Grant Ishita Dasgupta Thomas L. Griffiths Nori Jacoby 42 15 0 14 Jul 2021
Human Attention during Goal-directed Reading Comprehension Relies on Task Optimization Jiajie Zou Yuran Zhang Jialu Li Xing Tian Nai Ding AIMat 25 2 0 13 Jul 2021
Saying the Unseen: Video Descriptions via Dialog Agents Ye Zhu Yu Wu Yi Yang Yan Yan 22 6 0 26 Jun 2021
Supervising the Transfer of Reasoning Patterns in VQA Corentin Kervadec Christian Wolf G. Antipov M. Baccouche Madiha Nadri Wolf 22 10 0 10 Jun 2021
Taxonomy of Machine Learning Safety: A Survey and Primer Sina Mohseni Haotao Wang Zhiding Yu Chaowei Xiao Zhangyang Wang J. Yadawa 19 31 0 09 Jun 2021
LPF: A Language-Prior Feedback Objective Function for De-biased Visual Question Answering Zujie Liang Haifeng Hu Jiaying Zhu 31 38 0 29 May 2021
Connecting What to Say With Where to Look by Modeling Human Attention Traces Zihang Meng Licheng Yu Ning Zhang Tamara L. Berg Babak Damavandi Vikas Singh Amy Bearman 24 25 0 12 May 2021
Comparing Visual Reasoning in Humans and AI Shravan Murlidaran W. Wang M. Eckstein 24 1 0 29 Apr 2021
A First Look: Towards Explainable TextVQA Models via Visual and Textual Explanations Varun Nagaraj Rao Xingjian Zhen K. Hovsepian Mingwei Shen 19 17 0 29 Apr 2021
GraghVQA: Language-Guided Graph Neural Networks for Graph-based Visual Question Answering Weixin Liang Yanhao Jiang Zixuan Liu GNN 39 32 0 20 Apr 2021
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Corentin Dancette Rémi Cadène Damien Teney Matthieu Cord CML 26 74 0 07 Apr 2021
Multimodal Continuous Visual Attention Mechanisms António Farinhas André F. T. Martins P. Aguiar 12 6 0 07 Apr 2021
Generating and Evaluating Explanations of Attended and Error-Inducing Input Regions for VQA Models Arijit Ray Michael Cogswell Xiaoyu Lin Kamran Alipour Ajay Divakaran Yi Yao Giedrius Burachas FAtt 6 4 0 26 Mar 2021
Select, Substitute, Search: A New Benchmark for Knowledge-Augmented Visual Question Answering Aman Jain Mayank Kothyari Vishwajeet Kumar P. Jyothi Ganesh Ramakrishnan Soumen Chakrabarti 11 34 0 09 Mar 2021
Visual Question Answering: which investigated applications? Silvio Barra Carmen Bisogni M. De Marsico S. Ricciardi 13 37 0 04 Mar 2021
Answer Questions with Right Image Regions: A Visual Attention Regularization Approach Y. Liu Yangyang Guo Jianhua Yin Xuemeng Song Weifeng Liu Liqiang Nie 24 28 0 03 Feb 2021
Visual explanation of black-box model: Similarity Difference and Uniqueness (SIDU) method Satya M. Muddamsetty M. N. Jahromi Andreea-Emilia Ciontos Laura M. Fenoy T. Moeslund AAML 19 26 0 26 Jan 2021
Absolute Value Constraint: The Reason for Invalid Performance Evaluation Results of Neural Network Models for Stock Price Prediction Yi Wei 14 1 0 10 Jan 2021
To what extent do human explanations of model behavior align with actual model behavior? Grusha Prasad Yixin Nie Mohit Bansal Robin Jia Douwe Kiela Adina Williams 29 28 0 24 Dec 2020
Object-Centric Diagnosis of Visual Reasoning Jianwei Yang Jiayuan Mao Jiajun Wu Devi Parikh David D. Cox J. Tenenbaum Chuang Gan OCL 19 16 0 21 Dec 2020
Learning content and context with language bias for Visual Question Answering Chao Yang Su Feng Dongsheng Li Huawei Shen Guoqing Wang Bin Jiang 24 21 0 21 Dec 2020
Demystifying Deep Neural Networks Through Interpretation: A Survey Giang Dao Minwoo Lee FaML FAtt 8 1 0 13 Dec 2020
LRTA: A Transparent Neural-Symbolic Reasoning Framework with Modular Supervision for Visual Question Answering Weixin Liang Fei Niu Aishwarya N. Reganti Govind Thattai Gökhan Tür 26 17 0 21 Nov 2020
Machine versus Human Attention in Deep Reinforcement Learning Tasks Sihang Guo Ruohan Zhang Bo Liu Yifeng Zhu M. Hayhoe D. Ballard Peter Stone OffRL 16 25 0 29 Oct 2020
SOrT-ing VQA Models : Contrastive Gradient Learning for Improved Consistency Sameer Dharur Purva Tendulkar Dhruv Batra Devi Parikh Ramprasaath R. Selvaraju 16 2 0 20 Oct 2020
Interpreting Attention Models with Human Visual Attention in Machine Reading Comprehension Ekta Sood Simon Tannert Diego Frassinelli Andreas Bulling Ngoc Thang Vu HAI 16 54 0 13 Oct 2020