Did the Cat Drink the Coffee? Challenging Transformers with Generalized
Event Knowledge

Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge

22 July 2021

Paolo Pedinotti

Giulia Rambelli

Emmanuele Chersoni

Alessandro Lenci

ArXiv (abs)PDF HTML

Papers citing "Did the Cat Drink the Coffee? Challenging Transformers with Generalized Event Knowledge"

13 / 13 papers shown

Title
Modelling Adjectival Modification Effects on Semantic Plausibility Anna Golub Beate Zywietz Annerose Eichel 104 0 0 29 Jul 2025
Uncovering Autoregressive LLM Knowledge of Thematic Fit in Event Representation Safeyah Khaled Alshemali Daniel Bauer Yuval Marton BDL 832 0 0 19 Oct 2024
Elements of World Knowledge (EWoK): A Cognition-Inspired Framework for Evaluating Basic World Knowledge in Language ModelsTransactions of the Association for Computational Linguistics (TACL), 2024 Anna A. Ivanova Aalok Sathe Benjamin Lipkin Unnathi Kumar S. Radkani ... Leshem Choshen Roger Levy Evelina Fedorenko Josh Tenenbaum Jacob Andreas 293 54 0 15 May 2024
A Dataset for Physical and Abstract Plausibility and Sources of Human Disagreement Annerose Eichel Sabine Schulte im Walde 195 3 0 05 Apr 2024
Plausibility Processing in Transformer Language Models: Focusing on the Role of Attention Heads in GPT Soo Hyun Ryu 138 0 0 20 Oct 2023
Multi-lingual and Multi-cultural Figurative Language UnderstandingAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Anubha Kabra Emmy Liu Simran Khanuja Alham Fikri Aji Genta Indra Winata Samuel Cahyawijaya Anuoluwapo Aremu Perez Ogayo Graham Neubig 165 51 0 25 May 2023
EvEval: A Comprehensive Evaluation of Event Semantics for Large Language Models Zhengwei Tao Zhi Jin Xiaoying Bai Haiyan Zhao Yanlin Feng Jia Li Wenpeng Hu 204 7 0 24 May 2023
Language Model Behavior: A Comprehensive SurveyInternational Conference on Computational Logic (ICCL), 2023 Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 328 137 0 20 Mar 2023
Understanding Natural Language Understanding Systems. A Critical Analysis Alessandro Lenci ELM 172 14 0 01 Mar 2023
Stress Test for BERT and Deep Models: Predicting Words from Italian PoetryInternational Journal on Natural Language Computing (IJNLC), 2022 Rodolfo Delmonte Nicolò Busetto 52 3 0 21 Jan 2023
Event knowledge in large language models: the gap between the impossible and the unlikelyCognitive Sciences (CS), 2022 Carina Kauf Anna A. Ivanova Giulia Rambelli Emmanuele Chersoni Jingyuan Selena She Zawad Chowdhury Evelina Fedorenko Alessandro Lenci 465 86 0 02 Dec 2022
State-of-the-art generalisation research in NLP: A taxonomy and reviewNature Machine Intelligence (Nat. Mach. Intell.), 2022 Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Robert Bamler Zhijing Jin 588 130 0 06 Oct 2022
Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible ScenariosInternational Conference on Computational Linguistics (COLING), 2022 Mana Ashida Saku Sugawara 177 6 0 16 Sep 2022