Title
Finding Experts in Transformer Models Xavier Suau Luca Zappella N. Apostoloff 149 32 0 15 May 2020
Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models Jize Cao Zhe Gan Yu Cheng Licheng Yu Yen-Chun Chen Jingjing Liu VLM 248 137 0 15 May 2020
On the Robustness of Language Encoders against Grammatical Errors Fan Yin Quanyu Long Tao Meng Kai-Wei Chang 172 39 0 12 May 2020
How Context Affects Language Models' Factual Predictions Fabio Petroni Patrick Lewis Aleksandra Piktus Tim Rocktaschel Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM 190 252 0 10 May 2020
Finding Universal Grammatical Relations in Multilingual BERT Ethan A. Chi John Hewitt Christopher D. Manning 190 161 0 09 May 2020
Weakly-Supervised Neural Response Selection from an Ensemble of Task-Specialised Dialogue Agents Asir Saeed Khai Mai Pham Quang Nhat Minh Nguyen Tuan Duc Danushka Bollegala 92 0 0 06 May 2020
Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding wordsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Josef Klafka Allyson Ettinger 184 47 0 04 May 2020
Emergence of Syntax Needs Minimal SupervisionAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Raphaël Bailly Kata Gábor 164 5 0 03 May 2020
Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?Annual Meeting of the Association for Computational Linguistics (ACL), 2020 Yada Pruksachatkun Jason Phang Haokun Liu Phu Mon Htut Xiaoyi Zhang Richard Yuanzhe Pang Clara Vania Katharina Kann Samuel R. Bowman CLL LRM 205 204 0 01 May 2020
Probing Contextual Language Models for Common Ground with Visual Representations Gabriel Ilharco Rowan Zellers Ali Farhadi Hannaneh Hajishirzi 300 14 0 01 May 2020
Selecting Informative Contexts Improves Language Model FinetuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Richard Antonello Nicole M. Beckage Javier S. Turek Alexander G. Huth 313 13 0 01 May 2020
Does Data Augmentation Improve Generalization in NLP? Rohan Jha Charles Lovering Ellie Pavlick 202 10 0 30 Apr 2020
A Matter of Framing: The Impact of Linguistic Formalism on Probing ResultsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Ilia Kuznetsov Iryna Gurevych 104 27 0 30 Apr 2020
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable MaskingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Nicola De Cao Michael Schlichtkrull Wilker Aziz Ivan Titov 168 92 0 30 Apr 2020
Investigating Transferability in Pretrained Language ModelsFindings (Findings), 2020 Alex Tamkin Trisha Singh D. Giovanardi Noah D. Goodman MILM 132 48 0 30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Julian Michael Jan A. Botha Ian Tenney 270 44 0 29 Apr 2020
What Happens To BERT Embeddings During Fine-tuning?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020 Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney 212 206 0 29 Apr 2020
Do Neural Language Models Show Preferences for Syntactic Formalisms?Annual Meeting of the Association for Computational Linguistics (ACL), 2020 Artur Kulmizev Vinit Ravishankar Mostafa Abdou Joakim Nivre MILM 153 46 0 29 Apr 2020
Quantifying the Contextualization of Word Representations with Semantic Class ProbingFindings (Findings), 2020 Mengjie Zhao Philipp Dufter Yadollah Yaghoobzadeh Hinrich Schütze 219 28 0 25 Apr 2020
Contextualized Representations Using Textual Encyclopedic Knowledge Mandar Joshi Kenton Lee Yi Luan Kristina Toutanova 268 31 0 24 Apr 2020
Syntactic Data Augmentation Increases Robustness to Inference HeuristicsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Junghyun Min R. Thomas McCoy Dipanjan Das Emily Pitler Tal Linzen 240 190 0 24 Apr 2020
Attention is Not Only a Weight: Analyzing Transformers with Vector Norms Goro Kobayashi Tatsuki Kuribayashi Sho Yokoi Kentaro Inui 183 15 0 21 Apr 2020
Exploring the Combination of Contextual Word Embeddings and Knowledge Graph Embeddings Lea Dieudonat Kelvin Han Phyllicia Leavitt Esteban Marquer 121 4 0 17 Apr 2020
TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented DialogueConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Chien-Sheng Wu Guosheng Lin R. Socher Caiming Xiong 327 337 0 15 Apr 2020
What's so special about BERT's layers? A closer look at the NLP pipeline in monolingual and multilingual modelsFindings (Findings), 2020 Wietse de Vries Andreas van Cranenburgh Malvina Nissim MILM SSeg MoE 245 70 0 14 Apr 2020
Cross-Lingual Semantic Role Labeling with High-Quality Translated Training CorpusAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Hao Fei Meishan Zhang Donghong Ji 181 113 0 14 Apr 2020
Probing Neural Language Models for Human Tacit Assumptions Nathaniel Weir Adam Poliak Benjamin Van Durme 134 6 0 10 Apr 2020
On the Effect of Dropping Layers of Pre-trained Transformer ModelsComputer Speech and Language (CSL), 2020 Hassan Sajjad Fahim Dalvi Nadir Durrani Preslav Nakov 259 172 0 08 Apr 2020
Understanding Cross-Lingual Syntactic Transfer in Multilingual Recurrent Neural NetworksNordic Conference of Computational Linguistics (NODALIDA), 2020 Prajit Dhar Arianna Bisazza 214 10 0 31 Mar 2020
Information-Theoretic Probing with Minimum Description LengthConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Elena Voita Ivan Titov 222 296 0 27 Mar 2020
Pre-trained Models for Natural Language Processing: A SurveyScience China Technological Sciences (Sci China Technol Sci), 2020 Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 933 1,607 0 18 Mar 2020
A Survey on Contextual Embeddings Qi Liu Matt J. Kusner Phil Blunsom 433 169 0 16 Mar 2020
jiant: A Software Toolkit for Research on General-Purpose Text Understanding ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Yada Pruksachatkun Philip Yeres Haokun Liu Jason Phang Phu Mon Htut Alex Jinpeng Wang Ian Tenney Samuel R. Bowman SSeg 230 96 0 04 Mar 2020
A Primer in BERTology: What we know about how BERT worksTransactions of the Association for Computational Linguistics (TACL), 2020 Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 393 1,690 0 27 Feb 2020
Echo State Neural Machine Translation Ankush Garg Yuan Cao Qi Ge 165 5 0 27 Feb 2020
Differentiable Reasoning over a Virtual Knowledge BaseInternational Conference on Learning Representations (ICLR), 2020 Bhuwan Dhingra Manzil Zaheer Vidhisha Balachandran Graham Neubig Ruslan Salakhutdinov William W. Cohen 151 91 0 25 Feb 2020
A Hierarchy of Limitations in Machine Learning M. Malik 159 66 0 12 Feb 2020
Parsing as PretrainingAAAI Conference on Artificial Intelligence (AAAI), 2020 David Vilares Michalina Strzyz Anders Søgaard Carlos Gómez-Rodríguez 179 32 0 05 Feb 2020
BERT's output layer recognizes all hidden layers? Some Intriguing Phenomena and a simple way to boost BERT Wei-Tsung Kao Tsung-Han Wu Po-Han Chi Chun-Cheng Hsieh Hung-yi Lee SSL 134 5 0 25 Jan 2020
oLMpics -- On what Language Model Pre-training CapturesTransactions of the Association for Computational Linguistics (TACL), 2019 Alon Talmor Yanai Elazar Yoav Goldberg Jonathan Berant LRM 289 306 0 31 Dec 2019
The performance evaluation of Multi-representation in the Deep Learning models for Relation Extraction Task Jefferson A. Peña Torres R. Gutierrez Víctor A. Bucheli Fabio Gonzalez 54 0 0 17 Dec 2019
Dynamic Prosody Generation for Speech Synthesis using Linguistics-Driven Acoustic Embedding SelectionInterspeech (Interspeech), 2019 Shubhi Tyagi M. Nicolis Jonas Rohnke Thomas Drugman Jaime Lorenzo-Trueba 173 32 0 02 Dec 2019
BLiMP: The Benchmark of Linguistic Minimal Pairs for EnglishTransactions of the Association for Computational Linguistics (TACL), 2019 Alex Warstadt Alicia Parrish Haokun Liu Anhad Mohananey Wei Peng Sheng-Fu Wang Samuel R. Bowman 393 609 0 02 Dec 2019
How Can We Know What Language Models Know?Transactions of the Association for Computational Linguistics (TACL), 2019 Zhengbao Jiang Frank F. Xu Jun Araki Graham Neubig KELM 629 1,546 0 28 Nov 2019
Do Attention Heads in BERT Track Syntactic Dependencies? Phu Mon Htut Jason Phang Shikha Bordia Samuel R. Bowman 183 142 0 27 Nov 2019
Evaluating Commonsense in Pre-trained Language ModelsAAAI Conference on Artificial Intelligence (AAAI), 2019 Xuhui Zhou Yue Zhang Leyang Cui Dandan Huang AI4MH LRM 194 194 0 27 Nov 2019
Attending to Entities for Better Text UnderstandingAAAI Conference on Artificial Intelligence (AAAI), 2019 Pengxiang Cheng K. Erk LRM 149 38 0 11 Nov 2019
Deep Contextualized Self-training for Low Resource Dependency ParsingTransactions of the Association for Computational Linguistics (TACL), 2019 Guy Rotman Roi Reichart 189 52 0 11 Nov 2019
Generalizing Natural Language Analysis through Span-relation RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Zhengbao Jiang Wenyuan Xu Jun Araki Graham Neubig 223 60 0 10 Nov 2019
Multi-Sentence Argument LinkingAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Seth Ebner Patrick Xia Ryan Culkin Kyle Rawlins Benjamin Van Durme HAI 384 187 0 09 Nov 2019

1 2 3...10 11 12 9

Home
Papers
1905.06316
Cited By

What do you learn from context? Probing for sentence structure in contextualized word representations

International Conference on Learning Representations (ICLR), 2019

15 May 2019

Berlin Chen

Papers citing "What do you learn from context? Probing for sentence structure in contextualized word representations"

50 / 555 papers shown

Title
Finding Experts in Transformer Models Xavier Suau Luca Zappella N. Apostoloff 149 32 0 15 May 2020
Behind the Scene: Revealing the Secrets of Pre-trained Vision-and-Language Models Jize Cao Zhe Gan Yu Cheng Licheng Yu Yen-Chun Chen Jingjing Liu VLM 248 137 0 15 May 2020
On the Robustness of Language Encoders against Grammatical Errors Fan Yin Quanyu Long Tao Meng Kai-Wei Chang 172 39 0 12 May 2020
How Context Affects Language Models' Factual Predictions Fabio Petroni Patrick Lewis Aleksandra Piktus Tim Rocktaschel Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM 190 252 0 10 May 2020
Finding Universal Grammatical Relations in Multilingual BERT Ethan A. Chi John Hewitt Christopher D. Manning 190 161 0 09 May 2020
Weakly-Supervised Neural Response Selection from an Ensemble of Task-Specialised Dialogue Agents Asir Saeed Khai Mai Pham Quang Nhat Minh Nguyen Tuan Duc Danushka Bollegala 92 0 0 06 May 2020
Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding wordsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Josef Klafka Allyson Ettinger 184 47 0 04 May 2020
Emergence of Syntax Needs Minimal SupervisionAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Raphaël Bailly Kata Gábor 164 5 0 03 May 2020
Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?Annual Meeting of the Association for Computational Linguistics (ACL), 2020 Yada Pruksachatkun Jason Phang Haokun Liu Phu Mon Htut Xiaoyi Zhang Richard Yuanzhe Pang Clara Vania Katharina Kann Samuel R. Bowman CLL LRM 205 204 0 01 May 2020
Probing Contextual Language Models for Common Ground with Visual Representations Gabriel Ilharco Rowan Zellers Ali Farhadi Hannaneh Hajishirzi 300 14 0 01 May 2020
Selecting Informative Contexts Improves Language Model FinetuningAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Richard Antonello Nicole M. Beckage Javier S. Turek Alexander G. Huth 313 13 0 01 May 2020
Does Data Augmentation Improve Generalization in NLP? Rohan Jha Charles Lovering Ellie Pavlick 202 10 0 30 Apr 2020
A Matter of Framing: The Impact of Linguistic Formalism on Probing ResultsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Ilia Kuznetsov Iryna Gurevych 104 27 0 30 Apr 2020
How do Decisions Emerge across Layers in Neural Models? Interpretation with Differentiable MaskingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Nicola De Cao Michael Schlichtkrull Wilker Aziz Ivan Titov 168 92 0 30 Apr 2020
Investigating Transferability in Pretrained Language ModelsFindings (Findings), 2020 Alex Tamkin Trisha Singh D. Giovanardi Noah D. Goodman MILM 132 48 0 30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Julian Michael Jan A. Botha Ian Tenney 270 44 0 29 Apr 2020
What Happens To BERT Embeddings During Fine-tuning?BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackboxNLP), 2020 Amil Merchant Elahe Rahimtoroghi Ellie Pavlick Ian Tenney 212 206 0 29 Apr 2020
Do Neural Language Models Show Preferences for Syntactic Formalisms?Annual Meeting of the Association for Computational Linguistics (ACL), 2020 Artur Kulmizev Vinit Ravishankar Mostafa Abdou Joakim Nivre MILM 153 46 0 29 Apr 2020
Quantifying the Contextualization of Word Representations with Semantic Class ProbingFindings (Findings), 2020 Mengjie Zhao Philipp Dufter Yadollah Yaghoobzadeh Hinrich Schütze 219 28 0 25 Apr 2020
Contextualized Representations Using Textual Encyclopedic Knowledge Mandar Joshi Kenton Lee Yi Luan Kristina Toutanova 268 31 0 24 Apr 2020
Syntactic Data Augmentation Increases Robustness to Inference HeuristicsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Junghyun Min R. Thomas McCoy Dipanjan Das Emily Pitler Tal Linzen 240 190 0 24 Apr 2020
Attention is Not Only a Weight: Analyzing Transformers with Vector Norms Goro Kobayashi Tatsuki Kuribayashi Sho Yokoi Kentaro Inui 183 15 0 21 Apr 2020
Exploring the Combination of Contextual Word Embeddings and Knowledge Graph Embeddings Lea Dieudonat Kelvin Han Phyllicia Leavitt Esteban Marquer 121 4 0 17 Apr 2020
TOD-BERT: Pre-trained Natural Language Understanding for Task-Oriented DialogueConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Chien-Sheng Wu Guosheng Lin R. Socher Caiming Xiong 327 337 0 15 Apr 2020
What's so special about BERT's layers? A closer look at the NLP pipeline in monolingual and multilingual modelsFindings (Findings), 2020 Wietse de Vries Andreas van Cranenburgh Malvina Nissim MILM SSeg MoE 245 70 0 14 Apr 2020
Cross-Lingual Semantic Role Labeling with High-Quality Translated Training CorpusAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Hao Fei Meishan Zhang Donghong Ji 181 113 0 14 Apr 2020
Probing Neural Language Models for Human Tacit Assumptions Nathaniel Weir Adam Poliak Benjamin Van Durme 134 6 0 10 Apr 2020
On the Effect of Dropping Layers of Pre-trained Transformer ModelsComputer Speech and Language (CSL), 2020 Hassan Sajjad Fahim Dalvi Nadir Durrani Preslav Nakov 259 172 0 08 Apr 2020
Understanding Cross-Lingual Syntactic Transfer in Multilingual Recurrent Neural NetworksNordic Conference of Computational Linguistics (NODALIDA), 2020 Prajit Dhar Arianna Bisazza 214 10 0 31 Mar 2020
Information-Theoretic Probing with Minimum Description LengthConference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Elena Voita Ivan Titov 222 296 0 27 Mar 2020
Pre-trained Models for Natural Language Processing: A SurveyScience China Technological Sciences (Sci China Technol Sci), 2020 Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 933 1,607 0 18 Mar 2020
A Survey on Contextual Embeddings Qi Liu Matt J. Kusner Phil Blunsom 433 169 0 16 Mar 2020
jiant: A Software Toolkit for Research on General-Purpose Text Understanding ModelsAnnual Meeting of the Association for Computational Linguistics (ACL), 2020 Yada Pruksachatkun Philip Yeres Haokun Liu Jason Phang Phu Mon Htut Alex Jinpeng Wang Ian Tenney Samuel R. Bowman SSeg 230 96 0 04 Mar 2020
A Primer in BERTology: What we know about how BERT worksTransactions of the Association for Computational Linguistics (TACL), 2020 Anna Rogers Olga Kovaleva Anna Rumshisky OffRL 393 1,690 0 27 Feb 2020
Echo State Neural Machine Translation Ankush Garg Yuan Cao Qi Ge 165 5 0 27 Feb 2020
Differentiable Reasoning over a Virtual Knowledge BaseInternational Conference on Learning Representations (ICLR), 2020 Bhuwan Dhingra Manzil Zaheer Vidhisha Balachandran Graham Neubig Ruslan Salakhutdinov William W. Cohen 151 91 0 25 Feb 2020
A Hierarchy of Limitations in Machine Learning M. Malik 159 66 0 12 Feb 2020
Parsing as PretrainingAAAI Conference on Artificial Intelligence (AAAI), 2020 David Vilares Michalina Strzyz Anders Søgaard Carlos Gómez-Rodríguez 179 32 0 05 Feb 2020
BERT's output layer recognizes all hidden layers? Some Intriguing Phenomena and a simple way to boost BERT Wei-Tsung Kao Tsung-Han Wu Po-Han Chi Chun-Cheng Hsieh Hung-yi Lee SSL 134 5 0 25 Jan 2020
oLMpics -- On what Language Model Pre-training CapturesTransactions of the Association for Computational Linguistics (TACL), 2019 Alon Talmor Yanai Elazar Yoav Goldberg Jonathan Berant LRM 289 306 0 31 Dec 2019
The performance evaluation of Multi-representation in the Deep Learning models for Relation Extraction Task Jefferson A. Peña Torres R. Gutierrez Víctor A. Bucheli Fabio Gonzalez 54 0 0 17 Dec 2019
Dynamic Prosody Generation for Speech Synthesis using Linguistics-Driven Acoustic Embedding SelectionInterspeech (Interspeech), 2019 Shubhi Tyagi M. Nicolis Jonas Rohnke Thomas Drugman Jaime Lorenzo-Trueba 173 32 0 02 Dec 2019
BLiMP: The Benchmark of Linguistic Minimal Pairs for EnglishTransactions of the Association for Computational Linguistics (TACL), 2019 Alex Warstadt Alicia Parrish Haokun Liu Anhad Mohananey Wei Peng Sheng-Fu Wang Samuel R. Bowman 393 609 0 02 Dec 2019
How Can We Know What Language Models Know?Transactions of the Association for Computational Linguistics (TACL), 2019 Zhengbao Jiang Frank F. Xu Jun Araki Graham Neubig KELM 629 1,546 0 28 Nov 2019
Do Attention Heads in BERT Track Syntactic Dependencies? Phu Mon Htut Jason Phang Shikha Bordia Samuel R. Bowman 183 142 0 27 Nov 2019
Evaluating Commonsense in Pre-trained Language ModelsAAAI Conference on Artificial Intelligence (AAAI), 2019 Xuhui Zhou Yue Zhang Leyang Cui Dandan Huang AI4MH LRM 194 194 0 27 Nov 2019
Attending to Entities for Better Text UnderstandingAAAI Conference on Artificial Intelligence (AAAI), 2019 Pengxiang Cheng K. Erk LRM 149 38 0 11 Nov 2019
Deep Contextualized Self-training for Low Resource Dependency ParsingTransactions of the Association for Computational Linguistics (TACL), 2019 Guy Rotman Roi Reichart 189 52 0 11 Nov 2019
Generalizing Natural Language Analysis through Span-relation RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Zhengbao Jiang Wenyuan Xu Jun Araki Graham Neubig 223 60 0 10 Nov 2019
Multi-Sentence Argument LinkingAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Seth Ebner Patrick Xia Ryan Culkin Kyle Rawlins Benjamin Van Durme HAI 384 187 0 09 Nov 2019

1 2 3...10 11 12 9