Generalized Quantifiers as a Source of Error in Multilingual NLU
Benchmarks

Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks

22 April 2022

Daniel Hershcovich

Anders Søgaard

Papers citing "Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks"

8 / 8 papers shown

Title
FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models Yiyuan Li Shichao Sun Pengfei Liu LRM 51 0 0 01 Jul 2024
LaSQuE: Improved Zero-Shot Classification from Explanations Through Quantifier Modeling and Curriculum Learning Sayan Ghosh Rakesh R Menon Shashank Srivastava 22 2 0 18 Dec 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 111 93 0 06 Oct 2022
Analyzing the Effects of Reasoning Types on Cross-Lingual Transfer Performance Karthikeyan K Aalok Sathe Somak Aditya Monojit Choudhury LRM 19 10 0 05 Oct 2021
ANLIzing the Adversarial Natural Language Inference Dataset Adina Williams Tristan Thrush Douwe Kiela AAML 166 45 0 24 Oct 2020
The Sensitivity of Language Models and Humans to Winograd Schema Perturbations Mostafa Abdou Vinit Ravishankar Maria Barrett Yonatan Belinkov Desmond Elliott Anders Søgaard ReLM LRM 54 34 0 04 May 2020
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages Peng Qi Yuhao Zhang Yuhui Zhang Jason Bolton Christopher D. Manning AI4TS 199 1,653 0 16 Mar 2020
MLQA: Evaluating Cross-lingual Extractive Question Answering Patrick Lewis Barlas Oğuz Ruty Rinott Sebastian Riedel Holger Schwenk ELM 246 491 0 16 Oct 2019