Automatic Generation of Contrast Sets from Scene Graphs: Probing the
Compositional Consistency of GQA

Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA

17 March 2021

Gabriel Stanovsky

Michael Elhadad

Papers citing "Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA"

8 / 8 papers shown

Title
What You See is What You Read? Improving Text-Image Alignment Evaluation Michal Yarom Yonatan Bitton Soravit Changpinyo Roee Aharoni Jonathan Herzig Oran Lang E. Ofek Idan Szpektor EGVM 33 73 0 17 May 2023
Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality Anuj Diwan Layne Berry Eunsol Choi David F. Harwath Kyle Mahowald CoGe 101 41 0 01 Nov 2022
Generalization Differences between End-to-End and Neuro-Symbolic Vision-Language Reasoning Systems Wang Zhu Jesse Thomason Robin Jia VLM OOD NAI LRM 21 6 0 26 Oct 2022
CORE: A Retrieve-then-Edit Framework for Counterfactual Data Generation Tanay Dixit Bhargavi Paranjape Hannaneh Hajishirzi Luke Zettlemoyer SyDa 138 23 0 10 Oct 2022
Can Visual Dialogue Models Do Scorekeeping? Exploring How Dialogue Representations Incrementally Encode Shared Knowledge Brielen Madureira David Schlangen 17 4 0 14 Apr 2022
VLP: A Survey on Vision-Language Pre-training Feilong Chen Duzhen Zhang Minglun Han Xiuyi Chen Jing Shi Shuang Xu Bo Xu VLM 82 212 0 18 Feb 2022
Linguistically-Informed Transformations (LIT): A Method for Automatically Generating Contrast Sets Chuanrong Li Lin Shengshuo Leo Z. Liu Xinyi Wu Xuhui Zhou Shane Steinert-Threlkeld VLM 128 38 0 16 Oct 2020
Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets Mor Geva Yoav Goldberg Jonathan Berant 237 319 0 21 Aug 2019