ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1905.06316
  4. Cited By
What do you learn from context? Probing for sentence structure in
  contextualized word representations

What do you learn from context? Probing for sentence structure in contextualized word representations

International Conference on Learning Representations (ICLR), 2019
15 May 2019
Ian Tenney
Patrick Xia
Berlin Chen
Alex Jinpeng Wang
Adam Poliak
R. Thomas McCoy
Najoung Kim
Benjamin Van Durme
Samuel R. Bowman
Dipanjan Das
Ellie Pavlick
ArXiv (abs)PDFHTML

Papers citing "What do you learn from context? Probing for sentence structure in contextualized word representations"

50 / 555 papers shown
Title
Characterizing and Measuring Linguistic Dataset Drift
Characterizing and Measuring Linguistic Dataset DriftAnnual Meeting of the Association for Computational Linguistics (ACL), 2023
Tyler A. Chang
Kishaloy Halder
Neha Ann John
Yogarshi Vyas
Yassine Benajiba
Miguel Ballesteros
Dan Roth
175
3
0
26 May 2023
Structural Ambiguity and its Disambiguation in Language Model Based
  Parsers: the Case of Dutch Clause Relativization
Structural Ambiguity and its Disambiguation in Language Model Based Parsers: the Case of Dutch Clause RelativizationConference on Computational Natural Language Learning (CoNLL), 2023
G. Wijnholds
M. Moortgat
148
4
0
24 May 2023
Measuring the Knowledge Acquisition-Utilization Gap in Pretrained
  Language Models
Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Amirhossein Kazemnejad
Mehdi Rezagholizadeh
Prasanna Parthasarathi
Sarath Chandar
ELM
141
2
0
24 May 2023
On Robustness of Finetuned Transformer-based NLP Models
On Robustness of Finetuned Transformer-based NLP ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Pavan Kalyan Reddy Neerudu
R. Mamidi
Mounika Marreddy
Venkateswara Rao Kagita
Subba Reddy Oota
303
12
0
23 May 2023
Can Language Models Understand Physical Concepts?
Can Language Models Understand Physical Concepts?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
Lei Li
Jingjing Xu
Qingxiu Dong
Ce Zheng
Qi Liu
Lingpeng Kong
Xu Sun
ALM
131
25
0
23 May 2023
Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned
  Language Models
Distilling Semantic Concept Embeddings from Contrastively Fine-Tuned Language ModelsAnnual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), 2023
Na Li
Hanane Kteich
Zied Bouraoui
Steven Schockaert
205
11
0
16 May 2023
Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism
  of Language Models
Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language ModelsInternational Conference on Language Resources and Evaluation (LREC), 2023
Boxi Cao
Qiaoyu Tang
Hongyu Lin
Shanshan Jiang
Bin Dong
Xianpei Han
Jiawei Chen
Tianshu Wang
Le Sun
CLLKELM
175
23
0
16 May 2023
Investigating Forgetting in Pre-Trained Representations Through
  Continual Learning
Investigating Forgetting in Pre-Trained Representations Through Continual Learning
Yun Luo
Zhen Yang
Xuefeng Bai
Fandong Meng
Jie Zhou
Yue Zhang
CLLKELM
243
21
0
10 May 2023
Finding Neurons in a Haystack: Case Studies with Sparse Probing
Finding Neurons in a Haystack: Case Studies with Sparse Probing
Wes Gurnee
Neel Nanda
Matthew Pauly
Katherine Harvey
Dmitrii Troitskii
Dimitris Bertsimas
MILM
511
285
0
02 May 2023
What does BERT learn about prosody?
What does BERT learn about prosody?
Sofoklis Kakouros
Johannah O'Mahony
MILM
109
7
0
25 Apr 2023
LasUIE: Unifying Information Extraction with Latent Adaptive
  Structure-aware Generative Language Model
LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language ModelNeural Information Processing Systems (NeurIPS), 2023
Hao Fei
Shengqiong Wu
Jingye Li
Bobo Li
Fei Li
Libo Qin
Meishan Zhang
Hao Fei
Tat-Seng Chua
223
103
0
13 Apr 2023
Towards Efficient Fine-tuning of Pre-trained Code Models: An
  Experimental Study and Beyond
Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and BeyondInternational Symposium on Software Testing and Analysis (ISSTA), 2023
Ensheng Shi
Yanlin Wang
Hongyu Zhang
Lun Du
Shi Han
Dongmei Zhang
Hongbin Sun
199
55
0
11 Apr 2023
Scaling Pre-trained Language Models to Deeper via Parameter-efficient
  Architecture
Scaling Pre-trained Language Models to Deeper via Parameter-efficient Architecture
Peiyu Liu
Ze-Feng Gao
Yushuo Chen
Wayne Xin Zhao
Ji-Rong Wen
MoE
210
0
0
27 Mar 2023
Analyzing the Generalizability of Deep Contextualized Language
  Representations For Text Classification
Analyzing the Generalizability of Deep Contextualized Language Representations For Text Classification
Berfu Buyukoz
150
2
0
22 Mar 2023
Trained on 100 million words and still in shape: BERT meets British
  National Corpus
Trained on 100 million words and still in shape: BERT meets British National CorpusFindings (Findings), 2023
David Samuel
Andrey Kutuzov
Lilja Øvrelid
Erik Velldal
337
41
0
17 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey
The Life Cycle of Knowledge in Big Language Models: A SurveyMachine Intelligence Research (MIR), 2023
Boxi Cao
Hongyu Lin
Xianpei Han
Le Sun
KELM
250
30
0
14 Mar 2023
An Overview on Language Models: Recent Developments and Outlook
An Overview on Language Models: Recent Developments and OutlookAPSIPA Transactions on Signal and Information Processing (TASIP), 2023
Chengwei Wei
Yun Cheng Wang
Bin Wang
C.-C. Jay Kuo
265
52
0
10 Mar 2023
Can BERT Refrain from Forgetting on Sequential Tasks? A Probing Study
Can BERT Refrain from Forgetting on Sequential Tasks? A Probing StudyInternational Conference on Learning Representations (ICLR), 2023
Mingxu Tao
Yansong Feng
Dongyan Zhao
CLLKELM
164
11
0
02 Mar 2023
Targeted Adversarial Attacks against Neural Machine Translation
Targeted Adversarial Attacks against Neural Machine TranslationIEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2023
Sahar Sadrizadeh
AmirHossein Dabiri Aghdam
Ljiljana Dolamic
P. Frossard
AAML
240
14
0
02 Mar 2023
Understanding Natural Language Understanding Systems. A Critical
  Analysis
Understanding Natural Language Understanding Systems. A Critical Analysis
Alessandro Lenci
ELM
184
14
0
01 Mar 2023
Does Deep Learning Learn to Abstract? A Systematic Probing Framework
Does Deep Learning Learn to Abstract? A Systematic Probing FrameworkInternational Conference on Learning Representations (ICLR), 2023
Shengnan An
Zeqi Lin
B. Chen
Qiang Fu
Nanning Zheng
Jian-Guang Lou
214
6
0
23 Feb 2023
Language-Specific Representation of Emotion-Concept Knowledge Causally
  Supports Emotion Inference
Language-Specific Representation of Emotion-Concept Knowledge Causally Supports Emotion InferenceiScience (iScience), 2023
Ming Li
Yusheng Su
Hsiu-Yuan Huang
Jiali Cheng
Xin Hu
...
Yujia Qin
Xiaozhi Wang
Kristen A. Lindquist
Zhi-Yun Liu
Dan Zhang
128
11
0
19 Feb 2023
False perspectives on human language: why statistics needs linguistics
False perspectives on human language: why statistics needs linguistics
Matteo Greco
Andrea Cometa
F. Artoni
Robert Frank
A. Moro
68
6
0
17 Feb 2023
Trust, but Verify: Using Self-Supervised Probing to Improve
  Trustworthiness
Trust, but Verify: Using Self-Supervised Probing to Improve TrustworthinessEuropean Conference on Computer Vision (ECCV), 2023
Ailin Deng
Shen Li
Miao Xiong
Zhirui Chen
Bryan Hooi
148
4
0
06 Feb 2023
Representation Deficiency in Masked Language Modeling
Representation Deficiency in Masked Language ModelingInternational Conference on Learning Representations (ICLR), 2023
Yu Meng
Jitin Krishnan
Sinong Wang
Qifan Wang
Yuning Mao
Han Fang
Marjan Ghazvininejad
Jiawei Han
Luke Zettlemoyer
216
9
0
04 Feb 2023
TransFool: An Adversarial Attack against Neural Machine Translation
  Models
TransFool: An Adversarial Attack against Neural Machine Translation Models
Sahar Sadrizadeh
Ljiljana Dolamic
P. Frossard
SILMAAML
280
15
0
02 Feb 2023
Do Multi-Document Summarization Models Synthesize?
Do Multi-Document Summarization Models Synthesize?Transactions of the Association for Computational Linguistics (TACL), 2023
Jay DeYoung
Stephanie C. Martinez
Iain J. Marshall
Byron C. Wallace
276
13
0
31 Jan 2023
Can We Use Probing to Better Understand Fine-tuning and Knowledge
  Distillation of the BERT NLU?
Can We Use Probing to Better Understand Fine-tuning and Knowledge Distillation of the BERT NLU?International Conference on Agents and Artificial Intelligence (ICAART), 2023
Jakub Ho'scilowicz
Marcin Sowanski
Piotr Czubowski
Artur Janicki
149
2
0
27 Jan 2023
The Role of Interactive Visualization in Explaining (Large) NLP Models:
  from Data to Inference
The Role of Interactive Visualization in Explaining (Large) NLP Models: from Data to Inference
R. Brath
Daniel A. Keim
Johannes Knittel
Shimei Pan
Pia Sommerauer
Hendrik Strobelt
132
14
0
11 Jan 2023
Counteracts: Testing Stereotypical Representation in Pre-trained
  Language Models
Counteracts: Testing Stereotypical Representation in Pre-trained Language Models
Damin Zhang
Julia Taylor Rayz
Romila Pradhan
281
2
0
11 Jan 2023
Topics as Entity Clusters: Entity-based Topics from Language Models and
  Graph Neural Networks
Topics as Entity Clusters: Entity-based Topics from Language Models and Graph Neural NetworksInternational Conference on Language Resources and Evaluation (LREC), 2023
Manuel V. Loureiro
Steven Derby
Tri Kurniawan Wijaya
169
0
0
06 Jan 2023
Examining Political Rhetoric with Epistemic Stance Detection
Examining Political Rhetoric with Epistemic Stance Detection
Ankita Gupta
Su Lin Blodgett
Justin H. Gross
Brendan O'Connor
130
1
0
29 Dec 2022
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is
  It and How Does It Affect Transfer?
Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Ningyu Xu
Tao Gui
Ruotian Ma
Tao Gui
Jingting Ye
Menghan Zhang
Xuanjing Huang
221
14
0
21 Dec 2022
Reconstruction Probing
Reconstruction ProbingAnnual Meeting of the Association for Computational Linguistics (ACL), 2022
Najoung Kim
Jatin Khilnani
Alex Warstadt
Abed Qaddoumi
95
2
0
21 Dec 2022
Analyzing Semantic Faithfulness of Language Models via Input
  Intervention on Question Answering
Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question AnsweringInternational Conference on Computational Logic (ICCL), 2022
Akshay Chaturvedi
Swarnadeep Bhar
Soumadeep Saha
Utpal Garain
Nicholas Asher
221
8
0
21 Dec 2022
Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics
  Capacities
Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics CapacitiesACM Transactions on Software Engineering and Methodology (TOSEM), 2022
Wei Ma
Shangqing Liu
Mengjie Zhao
Xiaofei Xie
Wenhan Wang
Q. Hu
Jiexin Zhang
Yang Liu
382
37
0
20 Dec 2022
Explainability of Text Processing and Retrieval Methods: A Survey
Explainability of Text Processing and Retrieval Methods: A Survey
Sourav Saha
Debapriyo Majumdar
Mandar Mitra
290
5
0
14 Dec 2022
Assessing the Capacity of Transformer to Abstract Syntactic
  Representations: A Contrastive Analysis Based on Long-distance Agreement
Assessing the Capacity of Transformer to Abstract Syntactic Representations: A Contrastive Analysis Based on Long-distance AgreementTransactions of the Association for Computational Linguistics (TACL), 2022
Bingzhi Li
Guillaume Wisniewski
Benoît Crabbé
265
16
0
08 Dec 2022
Harnessing Knowledge and Reasoning for Human-Like Natural Language
  Generation: A Brief Review
Harnessing Knowledge and Reasoning for Human-Like Natural Language Generation: A Brief ReviewIEEE Data Engineering Bulletin (DEB), 2022
Jiangjie Chen
Yanghua Xiao
216
5
0
07 Dec 2022
Localization vs. Semantics: Visual Representations in Unimodal and
  Multimodal Models
Localization vs. Semantics: Visual Representations in Unimodal and Multimodal ModelsConference of the European Chapter of the Association for Computational Linguistics (EACL), 2022
Zhuowan Li
Cihang Xie
Benjamin Van Durme
Yaoyao Liu
VLMSSL
147
2
0
01 Dec 2022
Penalizing Confident Predictions on Largely Perturbed Inputs Does Not
  Improve Out-of-Distribution Generalization in Question Answering
Penalizing Confident Predictions on Largely Perturbed Inputs Does Not Improve Out-of-Distribution Generalization in Question Answering
Kazutoshi Shinoda
Saku Sugawara
Akiko Aizawa
OODAAML
121
1
0
29 Nov 2022
Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in
  Hex
Evaluation Beyond Task Performance: Analyzing Concepts in AlphaZero in HexNeural Information Processing Systems (NeurIPS), 2022
Charles Lovering
Jessica Zosa Forde
George Konidaris
Ellie Pavlick
Michael L. Littman
111
12
0
26 Nov 2022
TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense
  Question Answering
TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Yueqing Sun
Yu Zhang
Le Qi
Qi Shi
ReLMRALMLRM
147
6
0
24 Nov 2022
Probing for Incremental Parse States in Autoregressive Language Models
Probing for Incremental Parse States in Autoregressive Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Tiwalayo Eisape
Vineet Gangireddy
R. Levy
Yoon Kim
229
16
0
17 Nov 2022
On the Effect of Pre-training for Transformer in Different Modality on
  Offline Reinforcement Learning
On the Effect of Pre-training for Transformer in Different Modality on Offline Reinforcement LearningNeural Information Processing Systems (NeurIPS), 2022
S. Takagi
OffRL
168
8
0
17 Nov 2022
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
BigScience Workshop
:
Teven Le Scao
Angela Fan
Christopher Akiki
...
Zhongli Xie
Zifan Ye
M. Bras
Younes Belkada
Thomas Wolf
VLM
836
2,735
0
09 Nov 2022
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models
COPEN: Probing Conceptual Knowledge in Pre-trained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Hao Peng
Xiaozhi Wang
Shengding Hu
Hailong Jin
Lei Hou
Juanzi Li
Zhiyuan Liu
Qun Liu
202
30
0
08 Nov 2022
Do Charge Prediction Models Learn Legal Theory?
Do Charge Prediction Models Learn Legal Theory?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Zhenwei An
Quzhe Huang
Cong Jiang
Yansong Feng
Dongyan Zhao
ELMAILaw
132
8
0
31 Oct 2022
Probing for targeted syntactic knowledge through grammatical error
  detection
Probing for targeted syntactic knowledge through grammatical error detectionConference on Computational Natural Language Learning (CoNLL), 2022
Christopher Davis
Christopher Bryant
Andrew Caines
Marek Rei
P. Buttery
122
4
0
28 Oct 2022
IELM: An Open Information Extraction Benchmark for Pre-Trained Language
  Models
IELM: An Open Information Extraction Benchmark for Pre-Trained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2022
Chenguang Wang
Xiao Liu
Dawn Song
VLM
124
2
0
25 Oct 2022
Previous
12345...101112
Next