Communities
Connect sessions
AI calendar
Organizations
Join Slack
Contact Sales
Search
Open menu
Home
Papers
1905.06316
Cited By
What do you learn from context? Probing for sentence structure in contextualized word representations
International Conference on Learning Representations (ICLR), 2019
15 May 2019
Ian Tenney
Patrick Xia
Berlin Chen
Alex Jinpeng Wang
Adam Poliak
R. Thomas McCoy
Najoung Kim
Benjamin Van Durme
Samuel R. Bowman
Dipanjan Das
Ellie Pavlick
Re-assign community
ArXiv (abs)
PDF
HTML
Papers citing
"What do you learn from context? Probing for sentence structure in contextualized word representations"
50 / 555 papers shown
Language Models are Open Knowledge Graphs
Chenguang Wang
Xiao Liu
Basel Alomair
SSL
KELM
219
144
0
22 Oct 2020
Cold-start Active Learning through Self-supervised Language Modeling
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Michelle Yuan
Hsuan-Tien Lin
Jordan L. Boyd-Graber
538
197
0
19 Oct 2020
Does Chinese BERT Encode Word Structure?
Yile Wang
Leyang Cui
Yue Zhang
203
7
0
15 Oct 2020
Text Classification Using Label Names Only: A Language Model Self-Training Approach
Yu Meng
Yunyi Zhang
Jiaxin Huang
Chenyan Xiong
Heng Ji
Chao Zhang
Jiawei Han
VLM
208
83
0
14 Oct 2020
Neural Databases
James Thorne
Majid Yazdani
Marzieh Saeidi
Fabrizio Silvestri
Sebastian Riedel
A. Halevy
NAI
216
9
0
14 Oct 2020
A Self-supervised Representation Learning of Sentence Structure for Authorship Attribution
Fereshteh Jafariakinabad
K. Hua
NAI
SSL
268
21
0
14 Oct 2020
Measuring and Reducing Gendered Correlations in Pre-trained Models
Kellie Webster
Xuezhi Wang
Ian Tenney
Alex Beutel
Emily Pitler
Ellie Pavlick
Jilin Chen
Ed Chi
Slav Petrov
FaML
523
296
0
12 Oct 2020
Learning Which Features Matter: RoBERTa Acquires a Preference for Linguistic Generalizations (Eventually)
Alex Warstadt
Yian Zhang
Haau-Sing Li
Haokun Liu
Samuel R. Bowman
SSL
AI4CE
201
26
0
11 Oct 2020
Unsupervised Distillation of Syntactic Information from Contextualized Word Representations
BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020
Shauli Ravfogel
Yanai Elazar
Jacob Goldberger
Yoav Goldberg
204
13
0
11 Oct 2020
Recurrent babbling: evaluating the acquisition of grammar from limited input data
Conference on Computational Natural Language Learning (CoNLL), 2020
Ludovica Pannitto
Aurélie Herbelot
130
16
0
09 Oct 2020
Precise Task Formalization Matters in Winograd Schema Evaluations
Haokun Liu
William Huang
Dhara Mungra
Samuel R. Bowman
ReLM
144
12
0
08 Oct 2020
Assessing Phrasal Representation and Composition in Transformers
Lang-Chi Yu
Allyson Ettinger
CoGe
257
71
0
08 Oct 2020
Intrinsic Probing through Dimension Selection
Lucas Torroba Hennigen
Adina Williams
Robert Bamler
200
60
0
06 Oct 2020
Analyzing Individual Neurons in Pre-trained Language Models
Nadir Durrani
Hassan Sajjad
Fahim Dalvi
Yonatan Belinkov
MILM
204
119
0
06 Oct 2020
On the Sub-Layer Functionalities of Transformer Decoder
Findings (Findings), 2020
Yilin Yang
Longyue Wang
Shuming Shi
Prasad Tadepalli
Stefan Lee
Zhaopeng Tu
226
28
0
06 Oct 2020
On the Interplay Between Fine-tuning and Sentence-level Probing for Linguistic Knowledge in Pre-trained Transformers
BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020
Marius Mosbach
A. Khokhlova
Michael A. Hedderich
Dietrich Klakow
163
51
0
06 Oct 2020
Pretrained Language Model Embryology: The Birth of ALBERT
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Cheng-Han Chiang
Sung-Feng Huang
Hung-yi Lee
161
46
0
06 Oct 2020
On the Branching Bias of Syntax Extracted from Pre-trained Language Models
Findings (Findings), 2020
Huayang Li
Lemao Liu
Guoping Huang
Shuming Shi
132
7
0
06 Oct 2020
Pareto Probing: Trading Off Accuracy for Complexity
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Tiago Pimentel
Naomi Saphra
Adina Williams
Robert Bamler
283
66
0
05 Oct 2020
Linguistic Profiling of a Neural Language Model
International Conference on Computational Linguistics (COLING), 2020
Alessio Miaschi
D. Brunato
F. Dell’Orletta
Giulia Venturi
271
49
0
05 Oct 2020
My Body is a Cage: the Role of Morphology in Graph-Based Incompatible Control
International Conference on Learning Representations (ICLR), 2020
Vitaly Kurin
Maximilian Igl
Tim Rocktaschel
Wendelin Boehmer
Shimon Whiteson
AI4CE
355
99
0
05 Oct 2020
Which *BERT? A Survey Organizing Contextualized Encoders
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Patrick Xia
Shijie Wu
Benjamin Van Durme
214
53
0
02 Oct 2020
Measuring Systematic Generalization in Neural Proof Generation with Transformers
Nicolas Angelard-Gontier
Koustuv Sinha
Siva Reddy
C. Pal
LRM
219
67
0
30 Sep 2020
TaxiNLI: Taking a Ride up the NLU Hill
Pratik M. Joshi
Somak Aditya
Aalok Sathe
Monojit Choudhury
166
37
0
30 Sep 2020
What does it mean to be language-agnostic? Probing multilingual sentence encoders for typological properties
Rochelle Choenni
Ekaterina Shutova
268
40
0
27 Sep 2020
Persian Ezafe Recognition Using Transformers and Its Role in Part-Of-Speech Tagging
Findings (Findings), 2020
Ehsan Doostmohammadi
Minoo Nassajian
Adel Rahimi
ViT
125
12
0
20 Sep 2020
Conditionally Adaptive Multi-Task Learning: Improving Transfer Learning in NLP Using Fewer Parameters & Less Data
International Conference on Learning Representations (ICLR), 2020
Jonathan Pilault
Amine Elhattami
C. Pal
CLL
MoE
284
102
0
19 Sep 2020
ISCAS at SemEval-2020 Task 5: Pre-trained Transformers for Counterfactual Statement Modeling
International Workshop on Semantic Evaluation (SemEval), 2020
Yaojie Lu
Annan Li
Hongyu Lin
Xianpei Han
Le Sun
86
5
0
17 Sep 2020
End-to-End Neural Event Coreference Resolution
Artificial Intelligence (AIJ), 2020
Yaojie Lu
Hongyu Lin
Jialong Tang
Xianpei Han
Le Sun
127
38
0
17 Sep 2020
Retrofitting Structure-aware Transformer Language Model for End Tasks
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Hao Fei
Yafeng Ren
Donghong Ji
118
46
0
16 Sep 2020
An information theoretic view on selecting linguistic probes
Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Zining Zhu
Frank Rudzicz
169
21
0
15 Sep 2020
Investigating Gender Bias in BERT
Cognitive Computation (Cogn Comput), 2020
Rishabh Bhardwaj
Navonil Majumder
Soujanya Poria
213
119
0
10 Sep 2020
Duluth at SemEval-2020 Task 7: Using Surprise as a Key to Unlock Humorous Headlines
International Workshop on Semantic Evaluation (SemEval), 2020
Shuning Jin
Yue Yin
XianE Tang
Ted Pedersen
150
2
0
06 Sep 2020
Visually Analyzing Contextualized Embeddings
Visual .. (VISUAL), 2020
M. Berger
107
15
0
05 Sep 2020
Analysis and Evaluation of Language Models for Word Sense Disambiguation
Daniel Loureiro
Kiamehr Rezaee
Mohammad Taher Pilehvar
Jose Camacho-Collados
300
14
0
26 Aug 2020
Is Supervised Syntactic Parsing Beneficial for Language Understanding? An Empirical Investigation
Goran Glavaš
Ivan Vulić
249
70
0
15 Aug 2020
On Commonsense Cues in BERT for Solving Commonsense Tasks
Findings (Findings), 2020
Leyang Cui
Sijie Cheng
Yu Wu
Yue Zhang
SSL
CML
LRM
261
15
0
10 Aug 2020
Evaluating German Transformer Language Models with Syntactic Agreement Tests
Karolina Zaczynska
Nils Feldhus
Robert Schwarzenberg
Aleksandra Gabryszak
Sebastian Möller
121
7
0
07 Jul 2020
Knowledge-Aware Language Model Pretraining
Corby Rosset
Chenyan Xiong
M. Phan
Xia Song
Paul N. Bennett
Saurabh Tiwary
KELM
252
88
0
29 Jun 2020
How to Probe Sentence Embeddings in Low-Resource Languages: On Structural Design Choices for Probing Task Evaluation
Steffen Eger
Johannes Daxenberger
Iryna Gurevych
243
12
0
16 Jun 2020
Revisiting Few-sample BERT Fine-tuning
International Conference on Learning Representations (ICLR), 2020
Tianyi Zhang
Felix Wu
Arzoo Katiyar
Kilian Q. Weinberger
Yoav Artzi
406
488
0
10 Jun 2020
Detecting Emergent Intersectional Biases: Contextualized Word Embeddings Contain a Distribution of Human-like Biases
W. Guo
Aylin Caliskan
366
271
0
06 Jun 2020
A Cross-Task Analysis of Text Span Representations
Shubham Toshniwal
Freda Shi
Bowen Shi
Lingyu Gao
Karen Livescu
Kevin Gimpel
169
37
0
06 Jun 2020
Understanding Self-Attention of Self-Supervised Audio Transformers
Shu-Wen Yang
Andy T. Liu
Hung-yi Lee
140
31
0
05 Jun 2020
CompGuessWhat?!: A Multi-task Evaluation Framework for Grounded Language Learning
Annual Meeting of the Association for Computational Linguistics (ACL), 2020
Alessandro Suglia
Ioannis Konstas
Andrea Vanzo
E. Bastianelli
Desmond Elliott
Stella Frank
Oliver Lemon
135
17
0
03 Jun 2020
A Pairwise Probe for Understanding BERT Fine-Tuning on Machine Reading Comprehension
Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2020
Jie Cai
Zhengzhou Zhu
Ping Nie
Qian Liu
AAML
107
7
0
02 Jun 2020
Emergence of Separable Manifolds in Deep Language Representations
International Conference on Machine Learning (ICML), 2020
Jonathan Mamou
Hang Le
Miguel Angel del Rio
Cory Stephenson
Hanlin Tang
Yoon Kim
SueYeon Chung
AAML
AI4CE
320
46
0
01 Jun 2020
Probing Emergent Semantics in Predictive Agents via Question Answering
International Conference on Machine Learning (ICML), 2020
Abhishek Das
Federico Carnevale
Hamza Merzic
Laura Rimell
R. Schneider
...
Alden Hung
Arun Ahuja
S. Clark
Greg Wayne
Felix Hill
221
18
0
01 Jun 2020
Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals
Yanai Elazar
Shauli Ravfogel
Alon Jacovi
Yoav Goldberg
383
25
0
01 Jun 2020
Syntactic Structure Distillation Pretraining For Bidirectional Encoders
Transactions of the Association for Computational Linguistics (TACL), 2020
A. Kuncoro
Lingpeng Kong
Daniel Fried
Dani Yogatama
Laura Rimell
Chris Dyer
Phil Blunsom
203
36
0
27 May 2020
Previous
1
2
3
...
10
11
12
8
9
Next
