Generalized Quantifiers as a Source of Error in Multilingual NLU
Benchmarks

Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks

22 April 2022

Daniel Hershcovich

Anders Søgaard

Papers citing "Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks"

13 / 13 papers shown

Title
FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models Yiyuan Li Shichao Sun Pengfei Liu LRM 53 0 0 01 Jul 2024
Categorical Syllogisms Revisited: A Review of the Logical Reasoning Abilities of LLMs for Analyzing Categorical Syllogism Shi Zong Jimmy Lin ELM LRM 40 2 0 26 Jun 2024
Superlatives in Context: Explicit and Implicit Domain Restrictions for Superlative Frames Valentina Pyatkin Bonnie Webber Ido Dagan Reut Tsarfaty ELM AILaw 23 0 0 31 May 2024
Scope Ambiguities in Large Language Models Gaurav Kamath Sebastian Schuster Sowmya Vajjala Siva Reddy 29 2 0 05 Apr 2024
Pragmatic Reasoning Unlocks Quantifier Semantics for Foundation Models Yiyuan Li Rakesh R Menon Sayan Ghosh Shashank Srivastava LRM 14 2 0 08 Nov 2023
Formalising Natural Language Quantifiers for Human-Robot Interactions Stefan Morar Adrian Groza M. Pomarlan 15 2 0 25 Aug 2023
LaSQuE: Improved Zero-Shot Classification from Explanations Through Quantifier Modeling and Curriculum Learning Sayan Ghosh Rakesh R Menon Shashank Srivastava 22 2 0 18 Dec 2022
State-of-the-art generalisation research in NLP: A taxonomy and review Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Ryan Cotterell Zhijing Jin 114 93 0 06 Oct 2022
Analyzing the Effects of Reasoning Types on Cross-Lingual Transfer Performance Karthikeyan K Aalok Sathe Somak Aditya Monojit Choudhury LRM 21 10 0 05 Oct 2021
ANLIzing the Adversarial Natural Language Inference Dataset Adina Williams Tristan Thrush Douwe Kiela AAML 168 46 0 24 Oct 2020
The Sensitivity of Language Models and Humans to Winograd Schema Perturbations Mostafa Abdou Vinit Ravishankar Maria Barrett Yonatan Belinkov Desmond Elliott Anders Søgaard ReLM LRM 59 34 0 04 May 2020
Stanza: A Python Natural Language Processing Toolkit for Many Human Languages Peng Qi Yuhao Zhang Yuhui Zhang Jason Bolton Christopher D. Manning AI4TS 204 1,653 0 16 Mar 2020
MLQA: Evaluating Cross-lingual Extractive Question Answering Patrick Lewis Barlas Oğuz Ruty Rinott Sebastian Riedel Holger Schwenk ELM 246 491 0 16 Oct 2019