Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1902.03751
Cited By
v1
v2 (latest)
Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded
IEEE International Conference on Computer Vision (ICCV), 2019
11 February 2019
Ramprasaath R. Selvaraju
Stefan Lee
Yilin Shen
Hongxia Jin
Shalini Ghosh
Larry Heck
Dhruv Batra
Devi Parikh
FAtt
VLM
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Taking a HINT: Leveraging Explanations to Make Vision and Language Models More Grounded"
50 / 149 papers shown
Language Prior Is Not the Only Shortcut: A Benchmark for Shortcut Learning in VQA
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Q. Si
Fandong Meng
Mingyu Zheng
Zheng Lin
Yuanxin Liu
Peng Fu
Yanan Cao
Weiping Wang
Jie Zhou
165
31
0
10 Oct 2022
Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Q. Si
Yuanxin Liu
Fandong Meng
Zheng Lin
Peng Fu
Yanan Cao
Weiping Wang
Jie Zhou
245
28
0
10 Oct 2022
Impact of Feedback Type on Explanatory Interactive Learning
International Syposium on Methodologies for Intelligent Systems (ISMIS), 2022
Misgina Tsighe Hagos
Kathleen M. Curran
Brian Mac Namee
177
8
0
26 Sep 2022
Overcoming Language Priors in Visual Question Answering via Distinguishing Superficially Similar Instances
International Conference on Computational Linguistics (COLING), 2022
Yike Wu
Yu Zhao
Shiwan Zhao
Ying Zhang
Xiaojie Yuan
Guoqing Zhao
Ning Jiang
223
25
0
18 Sep 2022
Trust in Language Grounding: a new AI challenge for human-robot teams
David M. Bossens
C. Evers
236
1
0
05 Sep 2022
Generative Bias for Robust Visual Question Answering
Computer Vision and Pattern Recognition (CVPR), 2022
Jae-Won Cho
Dong-Jin Kim
H. Ryu
In So Kweon
OOD
CML
357
32
0
01 Aug 2022
Leveraging Explanations in Interactive Machine Learning: An Overview
Frontiers in Artificial Intelligence (FAI), 2022
Stefano Teso
Öznur Alkan
Wolfgang Stammer
Elizabeth M. Daly
XAI
FAtt
LRM
527
76
0
29 Jul 2022
Visual Perturbation-aware Collaborative Learning for Overcoming the Language Prior Problem
Yudong Han
Liqiang Nie
Jianhua Yin
Yue Yu
Yan Yan
236
23
0
24 Jul 2022
Predicting is not Understanding: Recognizing and Addressing Underspecification in Machine Learning
European Conference on Computer Vision (ECCV), 2022
Damien Teney
Maxime Peyrard
Ehsan Abbasnejad
283
32
0
06 Jul 2022
Improving Visual Grounding by Encouraging Consistent Gradient-based Explanations
Computer Vision and Pattern Recognition (CVPR), 2022
Ziyan Yang
Kushal Kafle
Franck Dernoncourt
Vicente Ordónez Román
VLM
407
32
0
30 Jun 2022
VisFIS: Visual Feature Importance Supervision with Right-for-the-Right-Reason Objectives
Neural Information Processing Systems (NeurIPS), 2022
Zhuofan Ying
Peter Hase
Joey Tianyi Zhou
LRM
295
15
0
22 Jun 2022
Concept-level Debugging of Part-Prototype Networks
International Conference on Learning Representations (ICLR), 2022
A. Bontempelli
Stefano Teso
Katya Tentori
Fausto Giunchiglia
Baptiste Caramiaux
369
59
0
31 May 2022
Guiding Visual Question Answering with Attention Priors
IEEE Workshop/Winter Conference on Applications of Computer Vision (WACV), 2022
T. Le
Vuong Le
Sunil R. Gupta
Svetha Venkatesh
T. Tran
214
8
0
25 May 2022
Multimodal Conversational AI: A Survey of Datasets and Approaches
Anirudh S. Sundar
Larry Heck
166
33
0
13 May 2022
Unsupervised Learning of Unbiased Visual Representations
IEEE Transactions on Artificial Intelligence (IEEE TAI), 2022
C. Barbano
Enzo Tartaglione
Marco Grangetto
SSL
CML
OOD
279
1
0
26 Apr 2022
Attention in Reasoning: Dataset, Analysis, and Modeling
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
Shi Chen
Ming Jiang
Jinhui Yang
Qi Zhao
LRM
146
4
0
20 Apr 2022
SwapMix: Diagnosing and Regularizing the Over-Reliance on Visual Context in Visual Question Answering
Computer Vision and Pattern Recognition (CVPR), 2022
Vipul Gupta
Zhuowan Li
Adam Kortylewski
Chenyu Zhang
Yingwei Li
Alan Yuille
175
53
0
05 Apr 2022
CNN Attention Guidance for Improved Orthopedics Radiographic Fracture Classification
IEEE journal of biomedical and health informatics (IEEE JBHI), 2022
Zhibin Liao
Kewen Liao
Haifeng Shen
M. F. van Boxel
J. Prijs
R. Jaarsma
J. Doornberg
Anton Van Den Hengel
Johan Verjans
196
20
0
21 Mar 2022
Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvement
Information Fusion (Inf. Fusion), 2022
Leander Weber
Sebastian Lapuschkin
Alexander Binder
Wojciech Samek
258
128
0
15 Mar 2022
A Typology for Exploring the Mitigation of Shortcut Behavior
Felix Friedrich
Wolfgang Stammer
P. Schramowski
Kristian Kersting
LLMAG
446
7
0
04 Mar 2022
On Modality Bias Recognition and Reduction
Yangyang Guo
Liqiang Nie
Harry Cheng
Zhiyong Cheng
Mohan S. Kankanhalli
Marco Bertini
278
48
0
25 Feb 2022
Joint Answering and Explanation for Visual Commonsense Reasoning
IEEE Transactions on Image Processing (IEEE TIP), 2022
Zhenyang Li
Yangyang Guo
Ke-Jyun Wang
Yin-wei Wei
Liqiang Nie
Mohan S. Kankanhalli
252
25
0
25 Feb 2022
An experimental study of the vision-bottleneck in VQA
Social Science Research Network (SSRN), 2022
Pierre Marza
Corentin Kervadec
G. Antipov
M. Baccouche
Christian Wolf
250
1
0
14 Feb 2022
Keyword localisation in untranscribed speech using visually grounded speech models
IEEE Journal on Selected Topics in Signal Processing (IEEE JSTSP), 2022
Kayode Olaleye
Dan Oneaţă
Herman Kamper
193
7
0
02 Feb 2022
Right for the Right Latent Factors: Debiasing Generative Models via Disentanglement
Xiaoting Shao
Karl Stelzner
Kristian Kersting
CML
DRL
216
3
0
01 Feb 2022
Debiased-CAM to mitigate systematic error with faithful visual explanations of machine learning
Wencan Zhang
Mariella Dimiccoli
Brian Y. Lim
FAtt
210
1
0
30 Jan 2022
From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI
ACM Computing Surveys (ACM CSUR), 2022
Meike Nauta
Jan Trienes
Shreyasi Pathak
Elisa Nguyen
Michelle Peters
Yasmin Schmitt
Jorg Schlotterer
M. V. Keulen
C. Seifert
ELM
XAI
611
568
0
20 Jan 2022
General Greedy De-bias Learning
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2021
Xinzhe Han
Shuhui Wang
Chi Su
Qingming Huang
Qi Tian
480
17
0
20 Dec 2021
Interpretable Image Classification with Differentiable Prototypes Assignment
European Conference on Computer Vision (ECCV), 2021
Dawid Rymarczyk
Lukasz Struski
Michal Górszczak
K. Lewandowska
Jacek Tabor
Bartosz Zieliñski
379
127
0
06 Dec 2021
Interactive Disentanglement: Learning Concepts by Interacting with their Prototype Representations
Computer Vision and Pattern Recognition (CVPR), 2021
Wolfgang Stammer
Marius Memmel
P. Schramowski
Kristian Kersting
425
30
0
04 Dec 2021
Language bias in Visual Question Answering: A Survey and Taxonomy
Desen Yuan
225
15
0
16 Nov 2021
Introspective Distillation for Robust Question Answering
Neural Information Processing Systems (NeurIPS), 2021
Yulei Niu
Hanwang Zhang
262
72
0
01 Nov 2021
Counterfactual Samples Synthesizing and Training for Robust Visual Question Answering
Long Chen
Yuhang Zheng
Yulei Niu
Hanwang Zhang
Jun Xiao
AAML
OOD
283
47
0
03 Oct 2021
Multimodal Integration of Human-Like Attention in Visual Question Answering
Ekta Sood
Fabian Kögel
Philippe Muller
Dominike Thomas
Mihai Bâce
Andreas Bulling
172
23
0
27 Sep 2021
Toward a Unified Framework for Debugging Concept-based Models
A. Bontempelli
Fausto Giunchiglia
Baptiste Caramiaux
Stefano Teso
184
6
0
23 Sep 2021
Discovering the Unknown Knowns: Turning Implicit Knowledge in the Dataset into Explicit Training Examples for Visual Question Answering
Jihyung Kil
Cheng Zhang
D. Xuan
Wei-Lun Chao
264
23
0
13 Sep 2021
Panoptic Narrative Grounding
IEEE International Conference on Computer Vision (ICCV), 2021
Cristina González
Nicolás Ayobi
Isabela Hernández
José Hernández
Jordi Pont-Tuset
Pablo Arbeláez
251
28
0
10 Sep 2021
Interactively Providing Explanations for Transformer Language Models
Felix Friedrich
P. Schramowski
Christopher Tauchmann
Kristian Kersting
LRM
389
6
0
02 Sep 2021
On the Significance of Question Encoder Sequence Model in the Out-of-Distribution Performance in Visual Question Answering
K. Gouthaman
Anurag Mittal
CML
224
0
0
28 Aug 2021
ProtoMIL: Multiple Instance Learning with Prototypical Parts for Whole-Slide Image Classification
Dawid Rymarczyk
Adam Pardyl
Jaroslaw Kraus
Aneta Kaczyńska
M. Skomorowski
Bartosz Zieliñski
118
29
0
24 Aug 2021
Greedy Gradient Ensemble for Robust Visual Question Answering
IEEE International Conference on Computer Vision (ICCV), 2021
Xinzhe Han
Shuhui Wang
Chi Su
Qingming Huang
Q. Tian
238
89
0
27 Jul 2021
X-GGM: Graph Generative Modeling for Out-of-Distribution Generalization in Visual Question Answering
ACM Multimedia (ACM MM), 2021
Jingjing Jiang
Zi-yi Liu
Yifan Liu
Jingjing Jiang
N. Zheng
OOD
226
20
0
24 Jul 2021
Separating Skills and Concepts for Novel Visual Question Answering
Computer Vision and Pattern Recognition (CVPR), 2021
Spencer Whitehead
Hui Wu
Heng Ji
Rogerio Feris
Kate Saenko
CoGe
185
38
0
19 Jul 2021
Leveraging Explainability for Comprehending Referring Expressions in the Real World
Fethiye Irmak Dogan
G. I. Melsión
Iolanda Leite
198
8
0
12 Jul 2021
Using Depth for Improving Referring Expression Comprehension in Real-World Environments
Fethiye Irmak Dogan
Iolanda Leite
219
5
0
09 Jul 2021
Check It Again: Progressive Visual Question Answering via Visual Entailment
Annual Meeting of the Association for Computational Linguistics (ACL), 2021
Q. Si
Zheng Lin
Mingyu Zheng
Peng Fu
Weiping Wang
151
52
0
08 Jun 2021
Interactive Label Cleaning with Example-based Explanations
Neural Information Processing Systems (NeurIPS), 2021
Stefano Teso
A. Bontempelli
Fausto Giunchiglia
Baptiste Caramiaux
312
55
0
07 Jun 2021
LPF: A Language-Prior Feedback Objective Function for De-biased Visual Question Answering
Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2021
Zujie Liang
Haifeng Hu
Jiaying Zhu
203
44
0
29 May 2021
Explainable Machine Learning with Prior Knowledge: An Overview
Katharina Beckh
Sebastian Müller
Matthias Jakobs
Vanessa Toborek
Hanxiao Tan
Raphael Fischer
Pascal Welke
Sebastian Houben
Laura von Rueden
XAI
285
31
0
21 May 2021
A Review on Explainability in Multimodal Deep Neural Nets
IEEE Access (IEEE Access), 2021
Gargi Joshi
Rahee Walambe
K. Kotecha
373
171
0
17 May 2021
Previous
1
2
3
Next
