Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1909.02597
Cited By
v1
v2 (latest)
Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019
5 September 2019
Alex Warstadt
Yuning Cao
Ioana Grosu
Wei Peng
Hagen Blix
Yining Nie
Anna Alsop
Shikha Bordia
Haokun Liu
Alicia Parrish
Sheng-Fu Wang
Jason Phang
Anhad Mohananey
Phu Mon Htut
Paloma Jeretic
Samuel R. Bowman
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIs"
50 / 83 papers shown
Different types of syntactic agreement recruit the same units within large language models
Daria Kryvosheieva
Andrea de Varda
Evelina Fedorenko
Greta Tuckute
162
1
0
03 Dec 2025
Steering Prepositional Phrases in Language Models: A Case of with-headed Adjectival and Adverbial Complements in Gemma-2
Stefan Arnold
Rene Gröbner
LLMSV
173
0
0
27 Sep 2025
Let's CONFER: A Dataset for Evaluating Natural Language Inference Models on CONditional InFERence and Presupposition
Tara Azin
Daniel Dumitrescu
Diana Inkpen
Raj Singh
250
4
0
06 Jun 2025
FLUKE: A Linguistically-Driven and Task-Agnostic Framework for Robustness Evaluation
Yulia Otmakhova
Hung Thinh Truong
Rahmad Mahendra
Zenan Zhai
Rongxin Zhu
Daniel Beck
Jey Han Lau
ELM
575
1
0
24 Apr 2025
Probing structural constraints of negation in Pretrained Language Models
Nordic Conference of Computational Linguistics (NoDaLiDa), 2024
David Kletz
Marie Candito
Pascal Amsili
323
0
0
06 Aug 2024
RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
Ekaterina Taktasheva
Maxim Bazhukov
Kirill Koncha
Alena Fenogenova
Ekaterina Artemova
Vladislav Mikhailov
369
24
0
27 Jun 2024
What Makes Language Models Good-enough?
Daiki Asami
Saku Sugawara
271
2
0
06 Jun 2024
Filtered Corpus Training (FiCT) Shows that Language Models can Generalize from Indirect Evidence
Abhinav Patil
Jaap Jumelet
Yu Ying Chiu
Andy Lapastora
Peter Shen
Lexie Wang
Clevis Willrich
Shane Steinert-Threlkeld
267
26
0
24 May 2024
Dissecting Paraphrases: The Impact of Prompt Syntax and supplementary Information on Knowledge Retrieval from Pretrained Language Models
North American Chapter of the Association for Computational Linguistics (NAACL), 2024
Stephan Linzbach
Dimitar Dimitrov
Laura Kallmeyer
Kilian Evang
Hajira Jabeen
Stefan Dietze
KELM
244
1
0
02 Apr 2024
KnowledgeVIS: Interpreting Language Models by Comparing Fill-in-the-Blank Prompts
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023
Adam Joseph Coscia
Alex Endert
VLM
295
18
0
07 Mar 2024
ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models
International Conference on Learning Representations (ICLR), 2023
.Ilker Kesen
Andrea Pedrotti
Mustafa Dogan
Michele Cafagna
Emre Can Acikgoz
...
Iacer Calixto
Anette Frank
Albert Gatt
Aykut Erdem
Erkut Erdem
307
25
0
13 Nov 2023
Can Language Models Be Tricked by Language Illusions? Easier with Syntax, Harder with Semantics
Conference on Computational Natural Language Learning (CoNLL), 2023
Yuhan Zhang
Edward Gibson
Forrest Davis
397
8
0
02 Nov 2023
Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Sophie Hao
Tal Linzen
221
10
0
23 Oct 2023
Assessing Step-by-Step Reasoning against Lexical Negation: A Case Study on Syllogism
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Mengyu Ye
Tatsuki Kuribayashi
Jun Suzuki
Goro Kobayashi
Hiroaki Funayama
LRM
363
11
0
23 Oct 2023
Revealing the Unwritten: Visual Investigation of Beam Search Trees to Address Language Model Prompting Challenges
Thilo Spinner
Rebecca Kehlbeck
Rita Sevastjanova
Tobias Stähle
Daniel A. Keim
Oliver Deussen
Andreas Spitz
Mennatallah El-Assady
282
3
0
17 Oct 2023
CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Models
International Conference on Learning Representations (ICLR), 2023
Sreyan Ghosh
Ashish Seth
Sonal Kumar
Utkarsh Tyagi
Chandra Kiran Reddy Evuru
S. Ramaneswaran
S. Sakshi
Oriol Nieto
R. Duraiswami
Dinesh Manocha
AuLLM
VLM
CoGe
606
51
0
12 Oct 2023
Language models are not naysayers: An analysis of language models on negation benchmarks
Thinh Hung Truong
Timothy Baldwin
Karin Verspoor
Trevor Cohn
331
91
0
14 Jun 2023
Morphosyntactic probing of multilingual BERT models
Natural Language Engineering (NLE), 2023
Judit Ács
Endre Hamerlik
Roy Schwartz
Noah A. Smith
András Kornai
258
19
0
09 Jun 2023
Decouple knowledge from parameters for plug-and-play language modeling
Xin Cheng
Yankai Lin
Preslav Nakov
Dongyan Zhao
Rui Yan
KELM
281
2
0
19 May 2023
Language Model Behavior: A Comprehensive Survey
International Conference on Computational Logic (ICCL), 2023
Tyler A. Chang
Benjamin Bergen
VLM
LRM
LM&MA
535
157
0
20 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey
Machine Intelligence Research (MIR), 2023
Boxi Cao
Hongyu Lin
Xianpei Han
Le Sun
KELM
305
31
0
14 Mar 2023
Does Deep Learning Learn to Abstract? A Systematic Probing Framework
International Conference on Learning Representations (ICLR), 2023
Shengnan An
Zeqi Lin
B. Chen
Qiang Fu
Nanning Zheng
Jian-Guang Lou
296
6
0
23 Feb 2023
Dissociating language and thought in large language models
Kyle Mahowald
Anna A. Ivanova
I. Blank
Nancy Kanwisher
J. Tenenbaum
Evelina Fedorenko
ELM
ReLM
412
233
0
16 Jan 2023
Topics in Contextualised Attention Embeddings
European Conference on Information Retrieval (ECIR), 2023
Mozhgan Talebpour
A. G. S. D. Herrera
Shoaib Jameel
287
3
0
11 Jan 2023
Reconstruction Probing
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Najoung Kim
Jatin Khilnani
Alex Warstadt
Abed Qaddoumi
163
3
0
21 Dec 2022
Do Charge Prediction Models Learn Legal Theory?
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Zhenwei An
Quzhe Huang
Cong Jiang
Yansong Feng
Dongyan Zhao
ELM
AILaw
186
8
0
31 Oct 2022
What do Large Language Models Learn beyond Language?
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Avinash Madasu
Shashank Srivastava
LRM
AI4CE
249
7
0
21 Oct 2022
State-of-the-art generalisation research in NLP: A taxonomy and review
Nature Machine Intelligence (Nat. Mach. Intell.), 2022
Dieuwke Hupkes
Mario Giulianelli
Verna Dankers
Mikel Artetxe
Yanai Elazar
...
Leila Khalatbari
Maria Ryskina
Rita Frieske
Robert Bamler
Zhijing Jin
721
140
0
06 Oct 2022
DECK: Behavioral Tests to Improve Interpretability and Generalizability of BERT Models Detecting Depression from Text
Jekaterina Novikova
Ksenia Shkaruta
AI4MH
209
6
0
12 Sep 2022
Getting BART to Ride the Idiomatic Train: Learning to Represent Idiomatic Expressions
Transactions of the Association for Computational Linguistics (TACL), 2022
Ziheng Zeng
S. Bhat
265
9
0
08 Jul 2022
SBERT studies Meaning Representations: Decomposing Sentence Embeddings into Explainable Semantic Features
Juri Opitz
Anette Frank
369
49
0
14 Jun 2022
Is the Computation of Abstract Sameness Relations Human-Like in Neural Language Models?
Lukas Thoma
Benjamin Roth
222
0
0
12 May 2022
Evaluation Benchmarks for Spanish Sentence Representations
International Conference on Language Resources and Evaluation (LREC), 2022
Vladimir Araujo
Andrés Carvallo
Souvik Kundu
J. Canete
Marcelo Mendoza
Robert E. Mercer
Felipe Bravo-Marquez
Marie-Francine Moens
Alvaro Soto
ELM
188
10
0
15 Apr 2022
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
Computer Vision and Pattern Recognition (CVPR), 2022
Tristan Thrush
Ryan Jiang
Max Bartolo
Amanpreet Singh
Adina Williams
Douwe Kiela
Candace Ross
CoGe
475
564
0
07 Apr 2022
An Analysis of Negation in Natural Language Understanding Corpora
Annual Meeting of the Association for Computational Linguistics (ACL), 2022
Md Mosharaf Hossain
Dhivya Chinnappa
Eduardo Blanco
261
51
0
16 Mar 2022
Analysis and Prediction of NLP Models Via Task Embeddings
Damien Sileo
Marie-Francine Moens
144
6
0
10 Dec 2021
Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations
Arabella J. Sinclair
Jaap Jumelet
Willem H. Zuidema
Raquel Fernández
360
52
0
30 Sep 2021
Transformers Generalize Linearly
Jackson Petty
Robert Frank
AI4CE
432
18
0
24 Sep 2021
Connecting degree and polarity: An artificial language learning study
Lisa Bylinina
Alexey Tikhonov
Ekaterina Garmash
AI4CE
231
1
0
13 Sep 2021
COMBO: State-of-the-Art Morphosyntactic Analysis
Mateusz Klimaszewski
Alina Wróblewska
AI4CE
228
7
0
11 Sep 2021
Transformers in the loop: Polarity in neural models of language
Annual Meeting of the Association for Computational Linguistics (ACL), 2021
Lisa Bylinina
Alexey Tikhonov
161
0
0
08 Sep 2021
Structural Guidance for Transformer Language Models
Annual Meeting of the Association for Computational Linguistics (ACL), 2021
Peng Qian
Tahira Naseem
R. Levy
Ramón Fernández Astudillo
324
35
0
30 Jul 2021
Turning Tables: Generating Examples from Semi-structured Tables for Endowing Language Models with Reasoning Skills
Annual Meeting of the Association for Computational Linguistics (ACL), 2021
Ori Yoran
Alon Talmor
Jonathan Berant
ReLM
LRM
434
56
0
15 Jul 2021
Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Bases
Boxi Cao
Hongyu Lin
Xianpei Han
Le Sun
Lingyong Yan
M. Liao
Tong Xue
Jin Xu
305
151
0
17 Jun 2021
Do Syntactic Probes Probe Syntax? Experiments with Jabberwocky Probing
North American Chapter of the Association for Computational Linguistics (NAACL), 2021
Rowan Hall Maudslay
Robert Bamler
239
42
0
04 Jun 2021
Uncovering Constraint-Based Behavior in Neural Models via Targeted Fine-Tuning
Annual Meeting of the Association for Computational Linguistics (ACL), 2021
Forrest Davis
Marten van Schijndel
AI4CE
290
7
0
02 Jun 2021
Using Integrated Gradients and Constituency Parse Trees to explain Linguistic Acceptability learnt by BERT
ICON (ICON), 2021
Anmol Nayak
Hariprasad Timmapathini
207
7
0
01 Jun 2021
Language Models Use Monotonicity to Assess NPI Licensing
Findings (Findings), 2021
Jaap Jumelet
Milica Denić
Jakub Szymanik
Dieuwke Hupkes
Shane Steinert-Threlkeld
KELM
244
36
0
28 May 2021
Masked Language Modeling and the Distributional Hypothesis: Order Word Matters Pre-training for Little
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021
Koustuv Sinha
Robin Jia
Dieuwke Hupkes
J. Pineau
Adina Williams
Douwe Kiela
368
284
0
14 Apr 2021
Dynabench: Rethinking Benchmarking in NLP
North American Chapter of the Association for Computational Linguistics (NAACL), 2021
Douwe Kiela
Max Bartolo
Yixin Nie
Divyansh Kaushik
Atticus Geiger
...
Pontus Stenetorp
Robin Jia
Joey Tianyi Zhou
Christopher Potts
Adina Williams
446
508
0
07 Apr 2021
1
2
Next
Page 1 of 2
