v1v2 (latest)

A fine-grained comparison of pragmatic language understanding in humans and language models

13 December 2022

Papers citing "A fine-grained comparison of pragmatic language understanding in humans and language models"

36 / 36 papers shown

Title
How important is language for human-like intelligence? Gary Lupyan Hunter Gentry Martin Zettersten 0 0 0 19 Sep 2025
Mixture of Cognitive Reasoners: Modular Reasoning with Brain-Like Specialization Badr AlKhamissi C. Nicolò De Sabbata Zeming Chen Martin Schrimpf Antoine Bosselut MoE LRM 82 0 0 16 Jun 2025
Understand the Implication: Learning to Think for Pragmatic Understanding S. Sravanthi Kishan Maharaj Sravani Gunnu Abhijit Mishra Pushpak Bhattacharyya ReLM LRM 81 0 0 16 Jun 2025
$(RSA)^2$ : A Rhetorical-Strategy-Aware Rational Speech Act Framework for Figurative Language Understanding Cesare Spinoso-Di Piano David Austin Pablo Piantanida Jackie Chi Kit Cheung 65 0 0 10 Jun 2025
They want to pretend not to understand: The Limits of Current LLMs in Interpreting Implicit Content of Political Discourse Walter Paci Alessandro Panunzi Sandro Pezzelle 62 0 0 07 Jun 2025
You Prefer This One, I Prefer Yours: Using Reference Words is Harder Than Vocabulary Words for Humans and Multimodal Language Models Dota Tianai Dong Yifan Luo Po-Ya Angela Wang Asli Ozyurek Paula Rubio-Fernandez 66 0 0 29 May 2025
Vision-Language Models Are Not Pragmatically Competent in Referring Expression Generation Ziqiao Ma Jing Ding Xuejun Zhang Dezhi Luo Jiahe Ding Sihan Xu Yuchen Huang Run Peng Joyce Chai 324 1 0 22 Apr 2025
Playpen: An Environment for Exploring Learning Through Conversational Interaction Nicola Horst Davide Mazzaccara Antonia Schmidt Michael Sullivan Filippo Momentè ... Alexander Koller Oliver Lemon David Schlangen Mario Giulianelli Alessandro Suglia OffRL 212 0 0 11 Apr 2025
Leveraging Human Production-Interpretation Asymmetries to Test LLM Cognitive Plausibility S. Lam Qingcheng Zeng Jingyi Wu Rob Voigt 127 0 0 21 Mar 2025
Pragmatic Inference Chain (PIC) Improving LLMs' Reasoning of Authentic Implicit Toxic Language Xi Chen Shuo Wang ReLM LRM 196 1 0 03 Mar 2025
Re-evaluating Theory of Mind evaluation in large language models Jennifer Hu Felix Sosa T. Ullman 193 5 0 28 Feb 2025
Pragmatics in the Era of Large Language Models: A Survey on Datasets, Evaluation, Opportunities and Challenges Bolei Ma Yuting Li Wei Zhou Ziwei Gong Teli Ma Katja Jasinskaja Annemarie Friedrich Julia Hirschberg Frauke Kreuter Barbara Plank ELM LRM 157 9 0 17 Feb 2025
Are LLMs good pragmatic speakers? Mingyue Jian Siddharth Narayanaswamy 91 4 0 03 Nov 2024
How Well Do LLMs Identify Cultural Unity in Diversity? Jialin Li Junli Wang Junjie Hu Ming Jiang 104 5 0 09 Aug 2024
Do language models capture implied discourse meanings? An investigation with exhaustivity implicatures of Korean morphology Hagyeong Shin Sean Trott 80 0 0 15 May 2024
Do Large Language Models Understand Conversational Implicature -- A case study with a chinese sitcom Shisen Yue Siyuan Song Xinyuan Cheng Hai Hu 125 4 0 30 Apr 2024
Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers Kabir Ahuja Vidhisha Balachandran Madhur Panwar Tianxing He Noah A. Smith Navin Goyal Yulia Tsvetkov 156 8 0 25 Apr 2024
Towards a Fully Interpretable and More Scalable RSA Model for Metaphor Understanding Gaia Carenini L. Bischetti Walter Schaeken V. Bambini 86 3 0 03 Apr 2024
NLP Systems That Can't Tell Use from Mention Censor Counterspeech, but Teaching the Distinction Helps Kristina Gligorić Myra Cheng Lucia Zheng Esin Durmus Dan Jurafsky 99 10 0 02 Apr 2024
Predictions from language models for multiple-choice tasks are not robust under variation of scoring methods Polina Tsvilodub Hening Wang Sharon Grosch Michael Franke 103 10 0 01 Mar 2024
FAC $^2$ E: Better Understanding Large Language Model Capabilities by Dissociating Language and Cognition Xiaoqiang Wang Bang Liu Lingfei Wu 107 0 0 29 Feb 2024
PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities S. Sravanthi Meet Doshi Tankala Pavan Kalyan Rudra Murthy Pushpak Bhattacharyya Raj Dabre 112 37 0 13 Jan 2024
"We Demand Justice!": Towards Social Context Grounding of Political Texts Rajkumar Pujari Chengfei Wu Dan Goldwasser AILaw 121 5 0 15 Nov 2023
Towards A Holistic Landscape of Situated Theory of Mind in Large Language Models Ziqiao Ma Jacob Sansom Run Peng Joyce Chai 154 22 0 30 Oct 2023
Large Language Models are biased to overestimate profoundness Eugenio Herrera-Berg Tomás Vergara Browne Pablo León-Villagrá Marc-Lluís Vives Cristian Buc Calderon ELM 62 7 0 22 Oct 2023
Enhancing Interpretability using Human Similarity Judgements to Prune Word Embeddings Natalia Flechas Manrique Wanqian Bao Aurélie Herbelot Uri Hasson 89 5 0 16 Oct 2023
Are Multilingual LLMs Culturally-Diverse Reasoners? An Investigation into Multicultural Proverbs and Sayings Chen Cecilia Liu Fajri Koto Timothy Baldwin Iryna Gurevych LRM 131 26 0 15 Sep 2023
Dealing with Semantic Underspecification in Multimodal NLP Sandro Pezzelle 92 11 0 08 Jun 2023
Do LLMs Understand Social Knowledge? Evaluating the Sociability of Large Language Models with SocKET Benchmark Minje Choi Jiaxin Pei Sagar Kumar Chang Shu David Jurgens ALM LLMAG 201 76 0 24 May 2023
Evaluating statistical language models as pragmatic reasoners Benjamin Lipkin L. Wong Gabriel Grand J. Tenenbaum 151 17 0 01 May 2023
Language Model Behavior: A Comprehensive Survey Tyler A. Chang Benjamin Bergen VLM LRM LM&MA 172 119 0 20 Mar 2023
Understanding Natural Language Understanding Systems. A Critical Analysis Alessandro Lenci ELM 84 12 0 01 Mar 2023
How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection Biyang Guo Xin Zhang Ziyuan Wang Minqi Jiang Jinran Nie Yuxuan Ding Jianwei Yue Yupeng Wu DeLMO ELM 155 664 0 18 Jan 2023
Dissociating language and thought in large language models Kyle Mahowald Anna A. Ivanova I. Blank Nancy Kanwisher J. Tenenbaum Evelina Fedorenko ELM ReLM 172 218 0 16 Jan 2023
Define, Evaluate, and Improve Task-Oriented Cognitive Capabilities for Instruction Generation Models Lingjun Zhao Khanh Nguyen Hal Daumé ELM 145 6 0 21 Dec 2022
Pragmatics in Language Grounding: Phenomena, Tasks, and Modeling Approaches Daniel Fried Nicholas Tomlin Jennifer Hu Roma Patel Aida Nematzadeh 116 7 0 15 Nov 2022