On the Value of Out-of-Distribution Testing: An Example of Goodhart's
Law

On the Value of Out-of-Distribution Testing: An Example of Goodhart's Law

19 May 2020

Ehsan Abbasnejad

Christopher Kanan

Papers citing "On the Value of Out-of-Distribution Testing: An Example of Goodhart's Law"

14 / 14 papers shown

Title
Holistic chemical evaluation reveals pitfalls in reaction prediction models Victor Sabanza Gil Andres M Bran Malte Franke Remi Schlama J. Luterbacher Philippe Schwaller ELM 21 1 0 14 Dec 2023
Classical Out-of-Distribution Detection Methods Benchmark in Text Classification Tasks M. Baran Joanna Baran Mateusz Wójcik Maciej Ziȩba Adam Gonczarek OODD 19 4 0 13 Jul 2023
HICO-DET-SG and V-COCO-SG: New Data Splits for Evaluating the Systematic Generalization Performance of Human-Object Interaction Detection Models Kenta Takemoto Moyuru Yamada Tomotake Sasaki H. Akima 25 0 0 17 May 2023
Towards Robust Visual Question Answering: Making the Most of Biased Samples via Contrastive Learning Q. Si Yuanxin Liu Fandong Meng Zheng Lin Peng Fu Yanan Cao Weiping Wang Jie Zhou 32 23 0 10 Oct 2022
Predicting is not Understanding: Recognizing and Addressing Underspecification in Machine Learning Damien Teney Maxime Peyrard Ehsan Abbasnejad 19 29 0 06 Jul 2022
Systematicity, Compositionality and Transitivity of Deep NLP Models: a Metamorphic Testing Perspective Edoardo Manino Julia Rozanova Danilo S. Carvalho André Freitas Lucas C. Cordeiro 20 7 0 26 Apr 2022
Weakly-Supervised Video Object Grounding via Causal Intervention Wei Wang Junyu Gao Changsheng Xu CML 23 20 0 01 Dec 2021
Language bias in Visual Question Answering: A Survey and Taxonomy Desen Yuan 16 12 0 16 Nov 2021
Discovering the Unknown Knowns: Turning Implicit Knowledge in the Dataset into Explicit Training Examples for Visual Question Answering Jihyung Kil Cheng Zhang D. Xuan Wei-Lun Chao 53 20 0 13 Sep 2021
Evading the Simplicity Bias: Training a Diverse Set of Models Discovers Solutions with Superior OOD Generalization Damien Teney Ehsan Abbasnejad Simon Lucey A. Hengel 20 86 0 12 May 2021
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Corentin Dancette Rémi Cadène Damien Teney Matthieu Cord CML 26 74 0 07 Apr 2021
Detecting Spurious Correlations with Sanity Tests for Artificial Intelligence Guided Radiology Systems U. Mahmood Robik Shrestha D. Bates L. Mannelli G. Corrias Y. Erdi Christopher Kanan 16 16 0 04 Mar 2021
Answer Questions with Right Image Regions: A Visual Attention Regularization Approach Y. Liu Yangyang Guo Jianhua Yin Xuemeng Song Weifeng Liu Liqiang Nie 24 28 0 03 Feb 2021
Counterfactual Samples Synthesizing for Robust Visual Question Answering Long Chen Xin Yan Jun Xiao Hanwang Zhang Shiliang Pu Yueting Zhuang OOD AAML 142 290 0 14 Mar 2020