ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1905.06316
  4. Cited By
What do you learn from context? Probing for sentence structure in
  contextualized word representations

What do you learn from context? Probing for sentence structure in contextualized word representations

International Conference on Learning Representations (ICLR), 2019
15 May 2019
Ian Tenney
Patrick Xia
Berlin Chen
Alex Jinpeng Wang
Adam Poliak
R. Thomas McCoy
Najoung Kim
Benjamin Van Durme
Samuel R. Bowman
Dipanjan Das
Ellie Pavlick
ArXiv (abs)PDFHTML

Papers citing "What do you learn from context? Probing for sentence structure in contextualized word representations"

50 / 555 papers shown
Title
Why Do Masked Neural Language Models Still Need Common Sense Knowledge?
Why Do Masked Neural Language Models Still Need Common Sense Knowledge?
Sunjae Kwon
Cheongwoong Kang
Jiyeon Han
Jaesik Choi
197
16
0
08 Nov 2019
BERTs of a feather do not generalize together: Large variability in
  generalization across models with similar test set performance
BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performanceBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2019
R. Thomas McCoy
Junghyun Min
Tal Linzen
332
156
0
07 Nov 2019
On the Linguistic Representational Power of Neural Machine Translation
  Models
On the Linguistic Representational Power of Neural Machine Translation ModelsInternational Conference on Computational Logic (ICCL), 2019
Yonatan Belinkov
Nadir Durrani
Fahim Dalvi
Hassan Sajjad
James R. Glass
MILM
187
74
0
01 Nov 2019
A Neural Entity Coreference Resolution Review
A Neural Entity Coreference Resolution ReviewExpert systems with applications (ESWA), 2019
Nikolaos Stylianou
I. Vlahavas
245
42
0
21 Oct 2019
Diversify Your Datasets: Analyzing Generalization via Controlled
  Variance in Adversarial Datasets
Diversify Your Datasets: Analyzing Generalization via Controlled Variance in Adversarial DatasetsConference on Computational Natural Language Learning (CoNLL), 2019
Ohad Rozen
Vered Shwartz
Roee Aharoni
Ido Dagan
AAML
174
39
0
21 Oct 2019
Discovering the Compositional Structure of Vector Representations with
  Role Learning Networks
Discovering the Compositional Structure of Vector Representations with Role Learning NetworksBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2019
Paul Soulos
R. Thomas McCoy
Tal Linzen
P. Smolensky
CoGe
315
45
0
21 Oct 2019
exBERT: A Visual Analysis Tool to Explore Learned Representations in
  Transformers Models
exBERT: A Visual Analysis Tool to Explore Learned Representations in Transformers Models
Benjamin Hoover
Hendrik Strobelt
Sebastian Gehrmann
108
89
0
11 Oct 2019
Specializing Word Embeddings (for Parsing) by Information Bottleneck
Specializing Word Embeddings (for Parsing) by Information BottleneckConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Xiang Lisa Li
Jason Eisner
137
67
0
01 Oct 2019
Graph Convolutions over Constituent Trees for Syntax-Aware Semantic Role
  Labeling
Graph Convolutions over Constituent Trees for Syntax-Aware Semantic Role LabelingConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Diego Marcheggiani
Ivan Titov
GNN
119
39
0
21 Sep 2019
How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer
  Representations
How Does BERT Answer Questions? A Layer-Wise Analysis of Transformer RepresentationsInternational Conference on Information and Knowledge Management (CIKM), 2019
Betty van Aken
B. Winter
Alexander Loser
Felix Alexander Gers
105
169
0
11 Sep 2019
Designing and Interpreting Probes with Control Tasks
Designing and Interpreting Probes with Control TasksConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
John Hewitt
Abigail Z. Jacobs
369
586
0
08 Sep 2019
Effective Use of Transformer Networks for Entity Tracking
Effective Use of Transformer Networks for Entity TrackingConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Aditya Gupta
Greg Durrett
115
20
0
05 Sep 2019
MoverScore: Text Generation Evaluating with Contextualized Embeddings
  and Earth Mover Distance
MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover DistanceConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Wei Zhao
Maxime Peyrard
Fei Liu
Yang Gao
Christian M. Meyer
Steffen Eger
411
648
0
05 Sep 2019
Investigating BERT's Knowledge of Language: Five Analysis Methods with
  NPIs
Investigating BERT's Knowledge of Language: Five Analysis Methods with NPIsConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Alex Warstadt
Yuning Cao
Ioana Grosu
Wei Peng
Hagen Blix
...
Jason Phang
Anhad Mohananey
Phu Mon Htut
Paloma Jeretic
Samuel R. Bowman
133
126
0
05 Sep 2019
Investigating Multilingual NMT Representations at Scale
Investigating Multilingual NMT Representations at ScaleConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Sneha Kudugunta
Ankur Bapna
Isaac Caswell
N. Arivazhagan
Orhan Firat
LRM
320
130
0
05 Sep 2019
The Bottom-up Evolution of Representations in the Transformer: A Study
  with Machine Translation and Language Modeling Objectives
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling ObjectivesConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Elena Voita
Rico Sennrich
Ivan Titov
408
200
0
03 Sep 2019
Language Models as Knowledge Bases?
Language Models as Knowledge Bases?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Fabio Petroni
Tim Rocktaschel
Patrick Lewis
A. Bakhtin
Yuxiang Wu
Alexander H. Miller
Sebastian Riedel
KELMAI4MH
884
2,945
0
03 Sep 2019
How Contextual are Contextualized Word Representations? Comparing the
  Geometry of BERT, ELMo, and GPT-2 Embeddings
How Contextual are Contextualized Word Representations? Comparing the Geometry of BERT, ELMo, and GPT-2 EmbeddingsConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Kawin Ethayarajh
215
990
0
02 Sep 2019
QuASE: Question-Answer Driven Sentence Encoding
QuASE: Question-Answer Driven Sentence Encoding
Hangfeng He
Qiang Ning
Dan Roth
140
1
0
01 Sep 2019
Higher-order Comparisons of Sentence Encoder Representations
Higher-order Comparisons of Sentence Encoder RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Mostafa Abdou
Artur Kulmizev
Felix Hill
D. Low
Anders Søgaard
145
17
0
01 Sep 2019
Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence
  Representations
Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Mingda Chen
Zewei Chu
Kevin Gimpel
254
49
0
31 Aug 2019
Learning Latent Parameters without Human Response Patterns: Item
  Response Theory with Artificial Crowds
Learning Latent Parameters without Human Response Patterns: Item Response Theory with Artificial CrowdsConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
John P. Lalor
Hao Wu
Hong-ye Yu
226
50
0
29 Aug 2019
Shallow Syntax in Deep Water
Shallow Syntax in Deep Water
Swabha Swayamdipta
Matthew E. Peters
Brendan Roof
Chris Dyer
Noah A. Smith
162
10
0
29 Aug 2019
Compositionality decomposed: how do neural networks generalise?
Compositionality decomposed: how do neural networks generalise?Journal of Artificial Intelligence Research (JAIR), 2019
Dieuwke Hupkes
Verna Dankers
Mathijs Mul
Elia Bruni
CoGe
314
369
0
22 Aug 2019
Deep Contextualized Word Embeddings in Transition-Based and Graph-Based
  Dependency Parsing -- A Tale of Two Parsers Revisited
Deep Contextualized Word Embeddings in Transition-Based and Graph-Based Dependency Parsing -- A Tale of Two Parsers RevisitedConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Artur Kulmizev
Miryam de Lhoneux
Johannes Gontrum
Elena Fano
Joakim Nivre
163
57
0
20 Aug 2019
Visualizing and Understanding the Effectiveness of BERT
Visualizing and Understanding the Effectiveness of BERTConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Y. Hao
Li Dong
Furu Wei
Ke Xu
246
198
0
15 Aug 2019
On Identifiability in Transformers
On Identifiability in TransformersInternational Conference on Learning Representations (ICLR), 2019
Gino Brunner
Yang Liu
Damian Pascual
Oliver Richter
Massimiliano Ciaramita
Roger Wattenhofer
ViT
235
200
0
12 Aug 2019
What BERT is not: Lessons from a new suite of psycholinguistic
  diagnostics for language models
What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelsTransactions of the Association for Computational Linguistics (TACL), 2019
Allyson Ettinger
291
633
0
31 Jul 2019
Multi-Task Learning for Coherence Modeling
Multi-Task Learning for Coherence ModelingAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Youmna Farag
H. Yannakoudakis
150
26
0
04 Jul 2019
A Comparative Analysis of Knowledge-Intensive and Data-Intensive
  Semantic Parsers
A Comparative Analysis of Knowledge-Intensive and Data-Intensive Semantic Parsers
Junjie Cao
Zi-yu Lin
Weiwei SUN
Xiaojun Wan
106
1
0
04 Jul 2019
Measuring Bias in Contextualized Word Representations
Measuring Bias in Contextualized Word Representations
Keita Kurita
Nidhi Vyas
Ayush Pareek
A. Black
Yulia Tsvetkov
220
492
0
18 Jun 2019
What Does BERT Look At? An Analysis of BERT's Attention
What Does BERT Look At? An Analysis of BERT's Attention
Kevin Clark
Urvashi Khandelwal
Omer Levy
Christopher D. Manning
MILM
538
1,788
0
11 Jun 2019
A Survey of Reinforcement Learning Informed by Natural Language
A Survey of Reinforcement Learning Informed by Natural LanguageInternational Joint Conference on Artificial Intelligence (IJCAI), 2019
Jelena Luketina
Nantas Nardelli
Gregory Farquhar
Jakob N. Foerster
Jacob Andreas
Edward Grefenstette
Shimon Whiteson
Tim Rocktaschel
LM&RoKELMOffRLLRM
177
299
0
10 Jun 2019
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves
  Classification
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Tu Vu
Mohit Iyyer
110
2
0
09 Jun 2019
Probing for Semantic Classes: Diagnosing the Meaning Content of Word
  Embeddings
Probing for Semantic Classes: Diagnosing the Meaning Content of Word EmbeddingsAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Yadollah Yaghoobzadeh
Katharina Kann
Timothy J. Hazen
Eneko Agirre
Hinrich Schütze
133
38
0
09 Jun 2019
Visualizing and Measuring the Geometry of BERT
Visualizing and Measuring the Geometry of BERTNeural Information Processing Systems (NeurIPS), 2019
Andy Coenen
Emily Reif
Ann Yuan
Been Kim
Adam Pearce
F. Viégas
Martin Wattenberg
MILM
208
447
0
06 Jun 2019
Entity-Centric Contextual Affective Analysis
Entity-Centric Contextual Affective AnalysisAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Anjalie Field
Yulia Tsvetkov
139
33
0
05 Jun 2019
Open Sesame: Getting Inside BERT's Linguistic Knowledge
Open Sesame: Getting Inside BERT's Linguistic Knowledge
Yongjie Lin
Y. Tan
Robert Frank
166
307
0
04 Jun 2019
How multilingual is Multilingual BERT?
How multilingual is Multilingual BERT?Annual Meeting of the Association for Computational Linguistics (ACL), 2019
Telmo Pires
Eva Schlinger
Dan Garrette
LRMVLM
450
1,550
0
04 Jun 2019
Resolving Gendered Ambiguous Pronouns with BERT
Resolving Gendered Ambiguous Pronouns with BERT
Kellie Webster
Marta Recasens
Ken Krige
Vera Axelrod
Denis Logvinenko
Jason Baldridge
178
50
0
03 Jun 2019
Assessing the Ability of Self-Attention Networks to Learn Word Order
Assessing the Ability of Self-Attention Networks to Learn Word OrderAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Baosong Yang
Longyue Wang
Yang Li
Lidia S. Chao
Zhaopeng Tu
141
32
0
03 Jun 2019
AMR Parsing as Sequence-to-Graph Transduction
AMR Parsing as Sequence-to-Graph TransductionAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Sheng Zhang
Xutai Ma
Kevin Duh
Benjamin Van Durme
175
155
0
21 May 2019
BERT Rediscovers the Classical NLP Pipeline
BERT Rediscovers the Classical NLP PipelineAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Ian Tenney
Dipanjan Das
Ellie Pavlick
MILMSSeg
622
1,618
0
15 May 2019
Correlating neural and symbolic representations of language
Correlating neural and symbolic representations of languageAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Grzegorz Chrupała
Afra Alishahi
NAI
145
73
0
14 May 2019
Taming Pretrained Transformers for Extreme Multi-label Text
  Classification
Taming Pretrained Transformers for Extreme Multi-label Text Classification
Wei-Cheng Chang
Hsiang-Fu Yu
Kai Zhong
Yiming Yang
Inderjit Dhillon
214
20
0
07 May 2019
SuperGLUE: A Stickier Benchmark for General-Purpose Language
  Understanding Systems
SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding SystemsNeural Information Processing Systems (NeurIPS), 2019
Alex Jinpeng Wang
Yada Pruksachatkun
Nikita Nangia
Amanpreet Singh
Julian Michael
Felix Hill
Omer Levy
Samuel R. Bowman
ELM
592
2,571
0
02 May 2019
Probing What Different NLP Tasks Teach Machines about Function Word
  Comprehension
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension
Najoung Kim
Roma Patel
Adam Poliak
Alex Jinpeng Wang
Patrick Xia
...
Alexis Ross
Tal Linzen
Benjamin Van Durme
Samuel R. Bowman
Ellie Pavlick
189
111
0
25 Apr 2019
From News to Medical: Cross-domain Discourse Segmentation
From News to Medical: Cross-domain Discourse Segmentation
Elisa Ferracane
Titan Page
Junyi Jessy Li
K. Erk
79
4
0
14 Apr 2019
Probing Biomedical Embeddings from Language Models
Probing Biomedical Embeddings from Language Models
Qiao Jin
Bhuwan Dhingra
William W. Cohen
Xinghua Lu
190
121
0
03 Apr 2019
PAWS: Paraphrase Adversaries from Word Scrambling
PAWS: Paraphrase Adversaries from Word Scrambling
Yuan Zhang
Jason Baldridge
Luheng He
197
568
0
01 Apr 2019
Previous
123...101112
Next