ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1905.06316
  4. Cited By
What do you learn from context? Probing for sentence structure in
  contextualized word representations

What do you learn from context? Probing for sentence structure in contextualized word representations

International Conference on Learning Representations (ICLR), 2019
15 May 2019
Ian Tenney
Patrick Xia
Berlin Chen
Alex Jinpeng Wang
Adam Poliak
R. Thomas McCoy
Najoung Kim
Benjamin Van Durme
Samuel R. Bowman
Dipanjan Das
Ellie Pavlick
ArXiv (abs)PDFHTML

Papers citing "What do you learn from context? Probing for sentence structure in contextualized word representations"

50 / 555 papers shown
Measuring Sound Symbolism in Audio-visual Models
Measuring Sound Symbolism in Audio-visual ModelsSpoken Language Technology Workshop (SLT), 2024
Wei-Cheng Tseng
Yi-Jen Shih
David Harwath
Raymond Mooney
309
2
0
18 Sep 2024
Prevailing Research Areas for Music AI in the Era of Foundation Models
Prevailing Research Areas for Music AI in the Era of Foundation Models
Megan Wei
M. Modrzejewski
Aswin Sivaraman
Dorien Herremans
MedIm
428
3
0
14 Sep 2024
Exploring syntactic information in sentence embeddings through
  multilingual subject-verb agreement
Exploring syntactic information in sentence embeddings through multilingual subject-verb agreement
Vivi Nastase
Chunyang Jiang
Giuseppe Samo
Paola Merlo
160
6
0
10 Sep 2024
The representation landscape of few-shot learning and fine-tuning in
  large language models
The representation landscape of few-shot learning and fine-tuning in large language modelsNeural Information Processing Systems (NeurIPS), 2024
Diego Doimo
Alessandro Serra
A. Ansuini
Alberto Cazzaniga
345
13
0
05 Sep 2024
Analysis of Argument Structure Constructions in the Large Language Model
  BERT
Analysis of Argument Structure Constructions in the Large Language Model BERT
Pegah Ramezani
Achim Schilling
Patrick Krauss
290
5
0
08 Aug 2024
SARA: Singular-Value Based Adaptive Low-Rank Adaption
SARA: Singular-Value Based Adaptive Low-Rank Adaption
Jihao Gu
Shuai Chen
Zelin Wang
Yibo Zhang
Ping Gong
120
3
0
06 Aug 2024
Tracking linguistic information in transformer-based sentence embeddings
  through targeted sparsification
Tracking linguistic information in transformer-based sentence embeddings through targeted sparsification
Vivi Nastase
Paola Merlo
193
6
0
25 Jul 2024
LLMs' morphological analyses of complex FST-generated Finnish words
LLMs' morphological analyses of complex FST-generated Finnish words
Anssi Moisio
Mathias Creutz
M. Kurimo
233
2
0
11 Jul 2024
A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models
A Practical Review of Mechanistic Interpretability for Transformer-Based Language Models
Daking Rai
Yilun Zhou
Shi Feng
Abulhair Saparov
Ziyu Yao
623
80
0
02 Jul 2024
Monitoring Latent World States in Language Models with Propositional
  Probes
Monitoring Latent World States in Language Models with Propositional Probes
Jiahai Feng
Stuart Russell
Jacob Steinhardt
HILM
232
21
0
27 Jun 2024
Are there identifiable structural parts in the sentence embedding whole?
Are there identifiable structural parts in the sentence embedding whole?
Vivi Nastase
Paola Merlo
198
6
0
24 Jun 2024
Unveiling LLM Mechanisms Through Neural ODEs and Control Theory
Unveiling LLM Mechanisms Through Neural ODEs and Control Theory
Yukun Zhang
Qi Dong
300
0
0
23 Jun 2024
What Should Embeddings Embed? Autoregressive Models Represent Latent Generating Distributions
What Should Embeddings Embed? Autoregressive Models Represent Latent Generating Distributions
Liyi Zhang
Michael Y. Li
Thomas Griffiths
Theodore R. Sumers
Jian-Qiao Zhu
Thomas L. Griffiths
197
5
0
06 Jun 2024
Probing the Category of Verbal Aspect in Transformer Language Models
Probing the Category of Verbal Aspect in Transformer Language Models
Anisia Katinskaia
R. Yangarber
302
6
0
04 Jun 2024
Towards Trustworthy AI: A Review of Ethical and Robust Large Language
  Models
Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models
Meftahul Ferdaus
Mahdi Abdelguerfi
Elias Ioup
Kendall N. Niles
Ken Pathak
Steve Sloan
398
26
0
01 Jun 2024
SF-DQN: Provable Knowledge Transfer using Successor Feature for Deep
  Reinforcement Learning
SF-DQN: Provable Knowledge Transfer using Successor Feature for Deep Reinforcement Learning
Shuai Zhang
Heshan Devaka Fernando
Miao Liu
K. Murugesan
Songtao Lu
Pin-Yu Chen
Tianyi Chen
Meng Wang
243
3
0
24 May 2024
Do language models capture implied discourse meanings? An investigation
  with exhaustivity implicatures of Korean morphology
Do language models capture implied discourse meanings? An investigation with exhaustivity implicatures of Korean morphology
Hagyeong Shin
Sean Trott
126
0
0
15 May 2024
Do Pretrained Contextual Language Models Distinguish between Hebrew
  Homograph Analyses?
Do Pretrained Contextual Language Models Distinguish between Hebrew Homograph Analyses?
Avi Shmidman
C. Shmidman
Dan Bareket
Moshe Koppel
Reut Tsarfaty
122
4
0
11 May 2024
Potential and Limitations of LLMs in Capturing Structured Semantics: A
  Case Study on SRL
Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRL
Ning Cheng
Zhaohui Yan
Ziming Wang
Zhijie Li
Jiaming Yu
Zilong Zheng
Kewei Tu
Jinan Xu
Wenjuan Han
182
14
0
10 May 2024
Natural Language Processing RELIES on Linguistics
Natural Language Processing RELIES on LinguisticsComputational Linguistics (CL), 2024
Juri Opitz
Shira Wein
Nathan Schneider
AI4CE
629
11
0
09 May 2024
Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers
Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers
Kabir Ahuja
Vidhisha Balachandran
Madhur Panwar
Tianxing He
Noah A. Smith
Navin Goyal
Yulia Tsvetkov
274
2
0
25 Apr 2024
mOthello: When Do Cross-Lingual Representation Alignment and
  Cross-Lingual Transfer Emerge in Multilingual Models?
mOthello: When Do Cross-Lingual Representation Alignment and Cross-Lingual Transfer Emerge in Multilingual Models?
Tianze Hua
Tian Yun
Ellie Pavlick
LRM
176
16
0
18 Apr 2024
Large language models and linguistic intentionality
Large language models and linguistic intentionality
J. Grindrod
236
15
0
15 Apr 2024
Explainable Generative AI (GenXAI): A Survey, Conceptualization, and
  Research Agenda
Explainable Generative AI (GenXAI): A Survey, Conceptualization, and Research Agenda
Johannes Schneider
258
74
0
15 Apr 2024
Adjusting Interpretable Dimensions in Embedding Space with Human
  Judgments
Adjusting Interpretable Dimensions in Embedding Space with Human JudgmentsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024
Katrin Erk
Marianna Apidianaki
280
5
0
03 Apr 2024
On Linearizing Structured Data in Encoder-Decoder Language Models:
  Insights from Text-to-SQL
On Linearizing Structured Data in Encoder-Decoder Language Models: Insights from Text-to-SQLNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024
Yutong Shao
N. Nakashole
258
3
0
03 Apr 2024
Toward Informal Language Processing: Knowledge of Slang in Large
  Language Models
Toward Informal Language Processing: Knowledge of Slang in Large Language ModelsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024
Zhewei Sun
Qian Hu
Rahul Gupta
Richard Zemel
Yang Xu
228
10
0
02 Apr 2024
Dissecting Paraphrases: The Impact of Prompt Syntax and supplementary
  Information on Knowledge Retrieval from Pretrained Language Models
Dissecting Paraphrases: The Impact of Prompt Syntax and supplementary Information on Knowledge Retrieval from Pretrained Language ModelsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2024
Stephan Linzbach
Dimitar Dimitrov
Laura Kallmeyer
Kilian Evang
Hajira Jabeen
Stefan Dietze
KELM
208
1
0
02 Apr 2024
Using Domain Knowledge to Guide Dialog Structure Induction via Neural
  Probabilistic Soft Logic
Using Domain Knowledge to Guide Dialog Structure Induction via Neural Probabilistic Soft Logic
Connor Pryor
Quan Yuan
J. Liu
Mehran Kazemi
Deepak Ramachandran
Tania Bedrax-Weiss
Lise Getoor
270
5
0
26 Mar 2024
Decoding Probing: Revealing Internal Linguistic Structures in Neural
  Language Models using Minimal Pairs
Decoding Probing: Revealing Internal Linguistic Structures in Neural Language Models using Minimal Pairs
Linyang He
Peili Chen
Ercong Nie
Yuanning Li
Jonathan R. Brennan
166
16
0
26 Mar 2024
Embedded Named Entity Recognition using Probing Classifiers
Embedded Named Entity Recognition using Probing ClassifiersConference on Empirical Methods in Natural Language Processing (EMNLP), 2024
Nicholas Popovic
Michael Färber
229
3
0
18 Mar 2024
Code-Mixed Probes Show How Pre-Trained Models Generalise On
  Code-Switched Text
Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched TextInternational Conference on Language Resources and Evaluation (LREC), 2024
Frances Adriana Laureano De Leon
Harish Tayyar Madabushi
Mark Lee
215
8
0
07 Mar 2024
Word Importance Explains How Prompts Affect Language Model Outputs
Word Importance Explains How Prompts Affect Language Model Outputs
Stefan Hackmann
Haniyeh Mahmoudian
Mark Steadman
Michael Schmidt
AAML
470
9
0
05 Mar 2024
What has LeBenchmark Learnt about French Syntax?
What has LeBenchmark Learnt about French Syntax?
Zdravko Dugonjić
Adrien Pupier
Benjamin Lecouteux
Maximin Coavoux
130
1
0
04 Mar 2024
Topic Aware Probing: From Sentence Length Prediction to Idiom
  Identification how reliant are Neural Language Models on Topic?
Topic Aware Probing: From Sentence Length Prediction to Idiom Identification how reliant are Neural Language Models on Topic?
Vasudevan Nedumpozhimana
John D. Kelleher
188
2
0
04 Mar 2024
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period
  of Large Language Models
Towards Tracing Trustworthiness Dynamics: Revisiting Pre-training Period of Large Language Models
Chao Qian
Jie Zhang
Wei Yao
Dongrui Liu
Zhen-fei Yin
Yu Qiao
Yong Liu
Jing Shao
LLMSVLRM
217
16
0
29 Feb 2024
Probing Multimodal Large Language Models for Global and Local Semantic
  Representations
Probing Multimodal Large Language Models for Global and Local Semantic Representations
Mingxu Tao
Quzhe Huang
Kun Xu
Liwei Chen
Yansong Feng
Dongyan Zhao
309
9
0
27 Feb 2024
How Large Language Models Encode Context Knowledge? A Layer-Wise Probing
  Study
How Large Language Models Encode Context Knowledge? A Layer-Wise Probing Study
Tianjie Ju
Weiwei Sun
Wei Du
Xinwei Yuan
Zhaochun Ren
Gongshen Liu
KELM
214
56
0
25 Feb 2024
Metric Learning Encoding Models: A Multivariate Framework for Interpreting Neural Representations
Metric Learning Encoding Models: A Multivariate Framework for Interpreting Neural Representations
Louis Jalouzot
Robin Sobczyk
Bastien Lhopitallier
Jeanne Salle
222
3
0
18 Feb 2024
Strong hallucinations from negation and how to fix them
Strong hallucinations from negation and how to fix them
Nicholas Asher
Swarnadeep Bhar
ReLMLRM
176
10
0
16 Feb 2024
The Queen of England is not England's Queen: On the Lack of Factual
  Coherency in PLMs
The Queen of England is not England's Queen: On the Lack of Factual Coherency in PLMs
Paul Youssef
Jorg Schlotterer
Christin Seifert
KELM
308
3
0
02 Feb 2024
Dive into the Chasm: Probing the Gap between In- and Cross-Topic
  Generalization
Dive into the Chasm: Probing the Gap between In- and Cross-Topic Generalization
Andreas Waldis
Yufang Hou
Iryna Gurevych
ELM
229
9
0
02 Feb 2024
Towards Visual Syntactical Understanding
Towards Visual Syntactical Understanding
Sayeed Shafayet Chowdhury
Soumyadeep Chandra
Kaushik Roy
NAI
265
0
0
30 Jan 2024
Textual Entailment for Effective Triple Validation in Object Prediction
Textual Entailment for Effective Triple Validation in Object Prediction
Andrés García-Silva
Cristian Berrío
José Manuél Gómez-Pérez
KELM
175
1
0
29 Jan 2024
Explicitly Representing Syntax Improves Sentence-to-layout Prediction of
  Unexpected Situations
Explicitly Representing Syntax Improves Sentence-to-layout Prediction of Unexpected SituationsTransactions of the Association for Computational Linguistics (TACL), 2024
Wolf Nuyts
Ruben Cartuyvels
Marie-Francine Moens
353
2
0
25 Jan 2024
Mission: Impossible Language Models
Mission: Impossible Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2024
Julie Kallini
Isabel Papadimitriou
Richard Futrell
Kyle Mahowald
Christopher Potts
ELMLRM
311
30
0
12 Jan 2024
A Vision Check-up for Language Models
A Vision Check-up for Language ModelsComputer Vision and Pattern Recognition (CVPR), 2024
Pratyusha Sharma
Tamar Rott Shaham
Manel Baradad
Stephanie Fu
Adrian Rodriguez-Munoz
Shivam Duggal
Phillip Isola
Antonio Torralba
VLMLRM
300
40
0
03 Jan 2024
Language Model as an Annotator: Unsupervised Context-aware Quality
  Phrase Generation
Language Model as an Annotator: Unsupervised Context-aware Quality Phrase GenerationKnowledge-Based Systems (KBS), 2023
Zhihao Zhang
Yuan Zuo
Chenghua Lin
Junjie Wu
191
6
0
28 Dec 2023
Deep de Finetti: Recovering Topic Distributions from Large Language
  Models
Deep de Finetti: Recovering Topic Distributions from Large Language Models
Liyi Zhang
R. Thomas McCoy
T. Sumers
Jian-Qiao Zhu
Thomas Griffiths
BDL
212
8
0
21 Dec 2023
Assessing Logical Reasoning Capabilities of Encoder-Only Transformer
  Models
Assessing Logical Reasoning Capabilities of Encoder-Only Transformer Models
Paulo Pirozelli
M. M. José
Paulo de Tarso P. Filho
A. Brandão
Fabio Gagliardi Cozman
LRMELM
320
4
0
18 Dec 2023
Previous
12345...101112
Next