v1v2 (latest)

Probing Linguistic Systematicity

8 May 2020

Papers citing "Probing Linguistic Systematicity"

39 / 39 papers shown

Title
Natural Language Satisfiability: Exploring the Problem Distribution and Evaluating Transformer-based Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2025 Tharindu Madusanka Ian Pratt-Hartmann Riza Batista-Navarro LRM 68 2 0 23 Aug 2025
Logic Haystacks: Probing LLMs Long-Context Logical Reasoning (Without Easily Identifiable Unrelated Padding) Damien Sileo RALM LRM 135 1 0 24 Feb 2025
Evaluating Morphological Compositional Generalization in Large Language ModelsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024 Mete Ismayilzada Yuan Chiang Jonne Sälevä Hale Sirin Abdullatif Köksal Bhuwan Dhingra Antoine Bosselut Lonneke van der Plas Duygu Ataman 255 11 0 16 Oct 2024
DeepCodeProbe: Towards Understanding What Models Trained on Code Learn Vahid Majdinasab Amin Nikanjam Foutse Khomh 148 1 0 11 Jul 2024
Scaling Synthetic Logical Reasoning Datasets with Context-Sensitive Declarative Grammars Damien Sileo LRM ReLM 184 5 0 16 Jun 2024
Exploring Continual Learning of Compositional Generalization in NLI Xiyan Fu Anette Frank CLL LRM 150 5 0 07 Mar 2024
EntailE: Introducing Textual Entailment in Commonsense Knowledge Graph Completion Ying Su Tianqing Fang Huiru Xiao Weiqi Wang Yangqiu Song Tong Zhang Lei Chen 119 0 0 15 Feb 2024
Systematic word meta-sense extensionConference on Empirical Methods in Natural Language Processing (EMNLP), 2023 Lei Yu 118 2 0 21 Nov 2023
Dynamic MOdularized Reasoning for Compositional Structured Explanation Generation Xiyan Fu Anette Frank LRM 123 2 0 14 Sep 2023
Do PLMs Know and Understand Ontological Knowledge?Annual Meeting of the Association for Computational Linguistics (ACL), 2023 Weiqi Wu Chengyue Jiang Yong Jiang Pengjun Xie Kewei Tu 149 33 0 12 Sep 2023
SETI: Systematicity Evaluation of Textual InferenceAnnual Meeting of the Association for Computational Linguistics (ACL), 2023 Xiyan Fu Anette Frank LRM 94 6 0 24 May 2023
Simple Linguistic Inferences of Large Language Models (LLMs): Blind Spots and Blinds Victoria Basmov Yoav Goldberg Reut Tsarfaty ReLM LRM 144 7 0 24 May 2023
Understanding Natural Language Understanding Systems. A Critical Analysis Alessandro Lenci ELM 108 12 0 01 Mar 2023
Can Transformers Reason in Fragments of Natural Language?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022 Viktor Schlegel Kamen V. Pavlov Ian Pratt-Hartmann LRM ReLM 142 9 0 10 Nov 2022
State-of-the-art generalisation research in NLP: A taxonomy and reviewNature Machine Intelligence (Nat. Mach. Intell.), 2022 Dieuwke Hupkes Mario Giulianelli Verna Dankers Mikel Artetxe Yanai Elazar ... Leila Khalatbari Maria Ryskina Rita Frieske Robert Bamler Zhijing Jin 440 123 0 06 Oct 2022
Towards Faithful Model Explanation in NLP: A SurveyComputational Linguistics (CL), 2022 Qing Lyu Marianna Apidianaki Chris Callison-Burch XAI 326 157 0 22 Sep 2022
Compositional Evaluation on Japanese Textual Entailment and SimilarityTransactions of the Association for Computational Linguistics (TACL), 2022 Hitomi Yanaka K. Mineshima 139 28 0 09 Aug 2022
Unit Testing for Concepts in Neural NetworksTransactions of the Association for Computational Linguistics (TACL), 2022 Charles Lovering Ellie Pavlick 144 30 0 28 Jul 2022
Systematicity, Compositionality and Transitivity of Deep NLP Models: a Metamorphic Testing PerspectiveFindings (Findings), 2022 Edoardo Manino Julia Rozanova Danilo S. Carvalho André Freitas Lucas C. Cordeiro 109 10 0 26 Apr 2022
When classifying grammatical role, BERT doesn't care about word order... except when it mattersAnnual Meeting of the Association for Computational Linguistics (ACL), 2022 Isabel Papadimitriou Richard Futrell Kyle Mahowald MILM 157 34 0 11 Mar 2022
Neuro-symbolic Natural Logic with Introspective Revision for Natural Language InferenceTransactions of the Association for Computational Linguistics (TACL), 2022 Yufei Feng Xiaoyu Yang Xiao-Dan Zhu Michael A. Greenspan LRM NAI 243 13 0 09 Mar 2022
Do Transformers know symbolic rules, and would we know if they did? Tommi Gröndahl Yu-Wen Guo Nirmal Asokan 158 0 0 19 Feb 2022
A Latent-Variable Model for Intrinsic ProbingAAAI Conference on Artificial Intelligence (AAAI), 2022 Karolina Stañczak Lucas Torroba Hennigen Adina Williams Robert Bamler Isabelle Augenstein 216 4 0 20 Jan 2022
Decomposing Natural Logic Inferences in Neural NLI Julia Rozanova Deborah Ferreira Marco Valentino Mokanrarangan Thayaparan André Freitas NAI LRM 150 4 0 15 Dec 2021
Frequency Effects on Syntactic Rule Learning in Transformers Jason W. Wei Dan Garrette Tal Linzen Ellie Pavlick 194 71 0 14 Sep 2021
How Does Fine-tuning Affect the Geometry of Embedding Space: A Case Study on IsotropyConference on Empirical Methods in Natural Language Processing (EMNLP), 2021 S. Rajaee Mohammad Taher Pilehvar 204 24 0 10 Sep 2021
Synthesizing Adversarial Negative Responses for Robust Response Ranking and EvaluationFindings (Findings), 2021 Prakhar Gupta Yulia Tsvetkov Jeffrey P. Bigham 120 24 0 10 Jun 2021
Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language InferenceFindings (Findings), 2021 Hai Hu He Zhou Zuoyu Tian Yiwen Zhang Yina Ma Yanting Li Yixin Nie Kyle Richardson 117 11 0 07 Jun 2021
Structured Reordering for Modeling Latent Alignments in Sequence TransductionNeural Information Processing Systems (NeurIPS), 2021 Bailin Wang Mirella Lapata Ivan Titov BDL 154 20 0 06 Jun 2021
SyGNS: A Systematic Generalization Testbed Based on Natural Language SemanticsFindings (Findings), 2021 Hitomi Yanaka K. Mineshima Kentaro Inui NAI AI4CE 187 11 0 02 Jun 2021
Supporting Context Monotonicity Abstractions in Neural NLI Models Julia Rozanova Deborah Ferreira Mokanarangan Thayaparan Marco Valentino André Freitas 68 10 0 17 May 2021
Modeling Event Plausibility with Consistent Conceptual AbstractionNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Ian Porada Kaheer Suleman Adam Trischler Jackie C.K. Cheung 187 20 0 20 Apr 2021
DirectProbe: Studying Representations without ClassifiersNorth American Chapter of the Association for Computational Linguistics (NAACL), 2021 Yichu Zhou Vivek Srikumar 137 35 0 13 Apr 2021
Exploring Transitivity in Neural NLI Models through VeridicalityConference of the European Chapter of the Association for Computational Linguistics (EACL), 2021 Hitomi Yanaka K. Mineshima Kentaro Inui 130 23 0 26 Jan 2021
Situation and Behavior Understanding by Trope Detection on FilmsThe Web Conference (WWW), 2021 Chen-Hsi Chang Hung-Ting Su Jui-Heng Hsu Yu-Siang Wang Yu-Cheng Chang Zhe-Yu Liu Ya-Liang Chang Wen-Feng Cheng Ke-Jyun Wang Winston H. Hsu 178 7 0 19 Jan 2021
Inferring symmetry in natural language Chelsea Tanchip Lei Yu Aotao Xu Yang Xu 84 5 0 16 Oct 2020
Measuring Systematic Generalization in Neural Proof Generation with Transformers Nicolas Angelard-Gontier Koustuv Sinha Siva Reddy C. Pal LRM 151 67 0 30 Sep 2020
Relational reasoning and generalization using non-symbolic neural networksAnnual Meeting of the Cognitive Science Society (CogSci), 2020 Atticus Geiger Alexandra Carstensen Michael C. Frank Michael C. Frank Christopher Potts NAI 159 22 0 14 Jun 2020
Discovering the Compositional Structure of Vector Representations with Role Learning NetworksBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2019 Paul Soulos R. Thomas McCoy Tal Linzen P. Smolensky CoGe 231 45 0 21 Oct 2019