ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1801.07772
  4. Cited By
Evaluating Layers of Representation in Neural Machine Translation on
  Part-of-Speech and Semantic Tagging Tasks

Evaluating Layers of Representation in Neural Machine Translation on Part-of-Speech and Semantic Tagging Tasks

23 January 2018
Yonatan Belinkov
Lluís Màrquez i Villodre
Hassan Sajjad
Nadir Durrani
Fahim Dalvi
James R. Glass
ArXiv (abs)PDFHTML

Papers citing "Evaluating Layers of Representation in Neural Machine Translation on Part-of-Speech and Semantic Tagging Tasks"

50 / 105 papers shown
Probing Classifiers: Promises, Shortcomings, and Advances
Probing Classifiers: Promises, Shortcomings, and AdvancesInternational Conference on Computational Logic (ICCL), 2021
Yonatan Belinkov
767
600
0
24 Feb 2021
Does injecting linguistic structure into language models lead to better
  alignment with brain recordings?
Does injecting linguistic structure into language models lead to better alignment with brain recordings?
Mostafa Abdou
Ana Valeria González
Mariya Toneva
Daniel Hershcovich
Anders Søgaard
145
18
0
29 Jan 2021
The Parallel Meaning Bank: A Framework for Semantically Annotating
  Multiple Languages
The Parallel Meaning Bank: A Framework for Semantically Annotating Multiple Languages
Lasha Abzianidze
Rik van Noord
Chunliu Wang
Johan Bos
160
6
0
29 Dec 2020
DoLFIn: Distributions over Latent Features for Interpretability
DoLFIn: Distributions over Latent Features for Interpretability
Phong Le
Willem H. Zuidema
FAtt
178
0
0
10 Nov 2020
Understanding Pure Character-Based Neural Machine Translation: The Case
  of Translating Finnish into English
Understanding Pure Character-Based Neural Machine Translation: The Case of Translating Finnish into English
Gongbo Tang
Rico Sennrich
Joakim Nivre
205
7
0
06 Nov 2020
Analyzing Individual Neurons in Pre-trained Language Models
Analyzing Individual Neurons in Pre-trained Language Models
Nadir Durrani
Hassan Sajjad
Fahim Dalvi
Yonatan Belinkov
MILM
217
119
0
06 Oct 2020
On the Sub-Layer Functionalities of Transformer Decoder
On the Sub-Layer Functionalities of Transformer DecoderFindings (Findings), 2020
Yilin Yang
Longyue Wang
Shuming Shi
Prasad Tadepalli
Stefan Lee
Zhaopeng Tu
244
28
0
06 Oct 2020
Pareto Probing: Trading Off Accuracy for Complexity
Pareto Probing: Trading Off Accuracy for ComplexityConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Tiago Pimentel
Naomi Saphra
Adina Williams
Robert Bamler
303
67
0
05 Oct 2020
Linguistic Profiling of a Neural Language Model
Linguistic Profiling of a Neural Language ModelInternational Conference on Computational Linguistics (COLING), 2020
Alessio Miaschi
D. Brunato
F. Dell’Orletta
Giulia Venturi
282
50
0
05 Oct 2020
Syntax Representation in Word Embeddings and Neural Networks -- A Survey
Syntax Representation in Word Embeddings and Neural Networks -- A SurveyConference on Theory and Practice of Information Technologies (TPIT), 2020
Tomasz Limisiewicz
David Marecek
NAI
188
9
0
02 Oct 2020
An Empirical Investigation Towards Efficient Multi-Domain Language Model
  Pre-training
An Empirical Investigation Towards Efficient Multi-Domain Language Model Pre-trainingConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Kristjan Arumae
Q. Sun
Parminder Bhatia
193
15
0
01 Oct 2020
Measuring Memorization Effect in Word-Level Neural Networks Probing
Measuring Memorization Effect in Word-Level Neural Networks Probing
Rudolf Rosa
Tomáš Musil
David Marevcek
179
4
0
29 Jun 2020
Encodings of Source Syntax: Similarities in NMT Representations Across
  Target Languages
Encodings of Source Syntax: Similarities in NMT Representations Across Target Languages
Tyler A. Chang
Anna N. Rafferty
227
2
0
17 May 2020
The Cascade Transformer: an Application for Efficient Answer Sentence
  Selection
The Cascade Transformer: an Application for Efficient Answer Sentence SelectionAnnual Meeting of the Association for Computational Linguistics (ACL), 2020
Luca Soldaini
Alessandro Moschitti
185
45
0
05 May 2020
Universal Dependencies according to BERT: both more specific and more
  general
Universal Dependencies according to BERT: both more specific and more generalFindings (Findings), 2020
Tomasz Limisiewicz
Rudolf Rosa
David Marevcek
150
19
0
30 Apr 2020
Asking without Telling: Exploring Latent Ontologies in Contextual
  Representations
Asking without Telling: Exploring Latent Ontologies in Contextual RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Julian Michael
Jan A. Botha
Ian Tenney
321
45
0
29 Apr 2020
Quantifying the Contextualization of Word Representations with Semantic
  Class Probing
Quantifying the Contextualization of Word Representations with Semantic Class ProbingFindings (Findings), 2020
Mengjie Zhao
Philipp Dufter
Yadollah Yaghoobzadeh
Hinrich Schütze
276
28
0
25 Apr 2020
On the Effect of Dropping Layers of Pre-trained Transformer Models
On the Effect of Dropping Layers of Pre-trained Transformer ModelsComputer Speech and Language (CSL), 2020
Hassan Sajjad
Fahim Dalvi
Nadir Durrani
Preslav Nakov
321
174
0
08 Apr 2020
On the Integration of LinguisticFeatures into Statistical and Neural
  Machine Translation
On the Integration of LinguisticFeatures into Statistical and Neural Machine Translation
Eva Vanmassenhove
171
0
0
31 Mar 2020
Balancing Cost and Benefit with Tied-Multi Transformers
Balancing Cost and Benefit with Tied-Multi TransformersWorkshop on Neural Generation and Translation (WNGT), 2020
Mary Dabre
Raphaël Rubino
Atsushi Fujita
132
6
0
20 Feb 2020
On the Linguistic Representational Power of Neural Machine Translation
  Models
On the Linguistic Representational Power of Neural Machine Translation ModelsInternational Conference on Computational Logic (ICCL), 2019
Yonatan Belinkov
Nadir Durrani
Fahim Dalvi
Hassan Sajjad
James R. Glass
MILM
243
75
0
01 Nov 2019
Discovering the Compositional Structure of Vector Representations with
  Role Learning Networks
Discovering the Compositional Structure of Vector Representations with Role Learning NetworksBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2019
Paul Soulos
R. Thomas McCoy
Tal Linzen
P. Smolensky
CoGe
415
46
0
21 Oct 2019
Designing and Interpreting Probes with Control Tasks
Designing and Interpreting Probes with Control TasksConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
John Hewitt
Abigail Z. Jacobs
461
593
0
08 Sep 2019
Investigating Multilingual NMT Representations at Scale
Investigating Multilingual NMT Representations at ScaleConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Sneha Kudugunta
Ankur Bapna
Isaac Caswell
N. Arivazhagan
Orhan Firat
LRM
386
131
0
05 Sep 2019
The Bottom-up Evolution of Representations in the Transformer: A Study
  with Machine Translation and Language Modeling Objectives
The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling ObjectivesConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Elena Voita
Rico Sennrich
Ivan Titov
498
204
0
03 Sep 2019
Higher-order Comparisons of Sentence Encoder Representations
Higher-order Comparisons of Sentence Encoder RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Mostafa Abdou
Artur Kulmizev
Felix Hill
D. Low
Anders Søgaard
171
18
0
01 Sep 2019
Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence
  Representations
Evaluation Benchmarks and Learning Criteria for Discourse-Aware Sentence RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Mingda Chen
Zewei Chu
Kevin Gimpel
340
49
0
31 Aug 2019
EntEval: A Holistic Evaluation Benchmark for Entity Representations
EntEval: A Holistic Evaluation Benchmark for Entity RepresentationsConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Mingda Chen
Zewei Chu
Yang Chen
K. Stratos
Kevin Gimpel
274
12
0
31 Aug 2019
Encoders Help You Disambiguate Word Senses in Neural Machine Translation
Encoders Help You Disambiguate Word Senses in Neural Machine TranslationConference on Empirical Methods in Natural Language Processing (EMNLP), 2019
Gongbo Tang
Rico Sennrich
Joakim Nivre
196
22
0
30 Aug 2019
Multi-Layer Softmaxing during Training Neural Machine Translation for
  Flexible Decoding with Fewer Layers
Multi-Layer Softmaxing during Training Neural Machine Translation for Flexible Decoding with Fewer Layers
Mary Dabre
Atsushi Fujita
AI4CE
119
0
0
27 Aug 2019
Compositionality decomposed: how do neural networks generalise?
Compositionality decomposed: how do neural networks generalise?Journal of Artificial Intelligence Research (JAIR), 2019
Dieuwke Hupkes
Verna Dankers
Mathijs Mul
Elia Bruni
CoGe
465
372
0
22 Aug 2019
Hard but Robust, Easy but Sensitive: How Encoder and Decoder Perform in
  Neural Machine Translation
Hard but Robust, Easy but Sensitive: How Encoder and Decoder Perform in Neural Machine Translation
Tianyu He
Xu Tan
Tao Qin
196
12
0
17 Aug 2019
Understanding Neural Machine Translation by Simplification: The Case of
  Encoder-free Models
Understanding Neural Machine Translation by Simplification: The Case of Encoder-free Models
Gongbo Tang
Rico Sennrich
Joakim Nivre
AI4CE
130
14
0
18 Jul 2019
A Comparative Analysis of Knowledge-Intensive and Data-Intensive
  Semantic Parsers
A Comparative Analysis of Knowledge-Intensive and Data-Intensive Semantic Parsers
Junjie Cao
Zi-yu Lin
Weiwei SUN
Xiaojun Wan
123
1
0
04 Jul 2019
Widening the Representation Bottleneck in Neural Machine Translation
  with Lexical Shortcuts
Widening the Representation Bottleneck in Neural Machine Translation with Lexical ShortcutsConference on Machine Translation (WMT), 2019
Denis Emelin
Ivan Titov
Rico Sennrich
148
10
0
28 Jun 2019
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves
  Classification
Encouraging Paragraph Embeddings to Remember Sentence Identity Improves ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Tu Vu
Mohit Iyyer
127
2
0
09 Jun 2019
Examining Structure of Word Embeddings with PCA
Examining Structure of Word Embeddings with PCAInternational Conference on Text, Speech and Dialogue (TSD), 2019
Tomáš Musil
198
13
0
31 May 2019
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy
  Lifting, the Rest Can Be Pruned
Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be PrunedAnnual Meeting of the Association for Computational Linguistics (ACL), 2019
Elena Voita
David Talbot
F. Moiseev
Rico Sennrich
Ivan Titov
782
1,345
0
23 May 2019
What do you learn from context? Probing for sentence structure in
  contextualized word representations
What do you learn from context? Probing for sentence structure in contextualized word representationsInternational Conference on Learning Representations (ICLR), 2019
Ian Tenney
Patrick Xia
Berlin Chen
Alex Jinpeng Wang
Adam Poliak
...
Najoung Kim
Benjamin Van Durme
Samuel R. Bowman
Dipanjan Das
Ellie Pavlick
515
921
0
15 May 2019
Linguistic Knowledge and Transferability of Contextual Representations
Linguistic Knowledge and Transferability of Contextual RepresentationsNorth American Chapter of the Association for Computational Linguistics (NAACL), 2019
Nelson F. Liu
Matt Gardner
Yonatan Belinkov
Matthew E. Peters
Noah A. Smith
938
794
0
21 Mar 2019
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications
  to Zero-shot Dependency Parsing
Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsing
Tal Schuster
Ori Ram
Regina Barzilay
Amir Globerson
283
219
0
25 Feb 2019
What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in
  Deep NLP Models
What Is One Grain of Sand in the Desert? Analyzing Individual Neurons in Deep NLP Models
Fahim Dalvi
Nadir Durrani
Hassan Sajjad
Yonatan Belinkov
A. Bau
James R. Glass
MILM
226
215
0
21 Dec 2018
Analysis Methods in Neural Language Processing: A Survey
Analysis Methods in Neural Language Processing: A Survey
Yonatan Belinkov
James R. Glass
283
597
0
21 Dec 2018
Understanding Learning Dynamics Of Language Models with SVCCA
Understanding Learning Dynamics Of Language Models with SVCCA
Naomi Saphra
Adam Lopez
433
112
0
01 Nov 2018
Counting in Language with RNNs
He Fun
Sergiy V. Bokhnyak
Francesco Saverio Zuppichini
119
0
0
29 Oct 2018
Language Modeling Teaches You More Syntax than Translation Does: Lessons
  Learned Through Auxiliary Task Analysis
Language Modeling Teaches You More Syntax than Translation Does: Lessons Learned Through Auxiliary Task Analysis
Kelly W. Zhang
Samuel R. Bowman
219
71
0
26 Sep 2018
RNNs as psycholinguistic subjects: Syntactic state and grammatical
  dependency
RNNs as psycholinguistic subjects: Syntactic state and grammatical dependency
Richard Futrell
Ethan Gotlieb Wilcox
Takashi Morita
R. Levy
180
61
0
05 Sep 2018
What can we learn from Semantic Tagging?
What can we learn from Semantic Tagging?
Mostafa Abdou
Artur Kulmizev
Vinit Ravishankar
Lasha Abzianidze
Johan Bos
FedML
146
9
0
29 Aug 2018
Analyzing Learned Representations of a Deep ASR Performance Prediction
  Model
Analyzing Learned Representations of a Deep ASR Performance Prediction Model
Z. Elloumi
Laurent Besacier
Olivier Galibert
Benjamin Lecouteux
184
14
0
26 Aug 2018
Neural Machine Translation for Bilingually Scarce Scenarios: A Deep
  Multi-task Learning Approach
Neural Machine Translation for Bilingually Scarce Scenarios: A Deep Multi-task Learning Approach
Poorya Zaremoodi
Gholamreza Haffari
139
20
0
11 May 2018
Previous
123
Next
Page 2 of 3