ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1907.12009
  4. Cited By
Representation Degeneration Problem in Training Natural Language
  Generation Models

Representation Degeneration Problem in Training Natural Language Generation Models

International Conference on Learning Representations (ICLR), 2019
28 July 2019
Jun Gao
Di He
Xu Tan
Tao Qin
Liwei Wang
Tie-Yan Liu
ArXiv (abs)PDFHTML

Papers citing "Representation Degeneration Problem in Training Natural Language Generation Models"

11 / 161 papers shown
Positional Artefacts Propagate Through Masked Language Model Embeddings
Positional Artefacts Propagate Through Masked Language Model Embeddings
Ziyang Luo
Artur Kulmizev
Xiaoxi Mao
305
41
0
09 Nov 2020
On the Sentence Embeddings from Pre-trained Language Models
On the Sentence Embeddings from Pre-trained Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP), 2020
Bohan Li
Hao Zhou
Junxian He
Mingxuan Wang
Yiming Yang
Lei Li
203
238
0
02 Nov 2020
A Discrete Variational Recurrent Topic Model without the
  Reparametrization Trick
A Discrete Variational Recurrent Topic Model without the Reparametrization Trick
Mehdi Rezaee
Francis Ferraro
BDLDRL
127
29
0
22 Oct 2020
Improving Low Compute Language Modeling with In-Domain Embedding
  Initialisation
Improving Low Compute Language Modeling with In-Domain Embedding Initialisation
Charles F Welch
Amélie Reymond
Jonathan K. Kummerfeld
AI4CE
248
5
0
29 Sep 2020
Taking Notes on the Fly Helps BERT Pre-training
Taking Notes on the Fly Helps BERT Pre-training
Qiyu Wu
Chen Xing
Yatao Li
Guolin Ke
Di He
Tie-Yan Liu
217
10
0
04 Aug 2020
Trojaning Language Models for Fun and Profit
Trojaning Language Models for Fun and ProfitEuropean Symposium on Security and Privacy (EuroS&P), 2020
Xinyang Zhang
Zheng Zhang
Shouling Ji
Ting Wang
SILMAAML
338
155
0
01 Aug 2020
Norm-Based Curriculum Learning for Neural Machine Translation
Norm-Based Curriculum Learning for Neural Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL), 2020
Xuebo Liu
Houtim Lai
Yang Li
Lidia S. Chao
179
128
0
03 Jun 2020
IsoBN: Fine-Tuning BERT with Isotropic Batch Normalization
IsoBN: Fine-Tuning BERT with Isotropic Batch NormalizationAAAI Conference on Artificial Intelligence (AAAI), 2020
Wenxuan Zhou
Bill Yuchen Lin
Xiang Ren
229
27
0
02 May 2020
PowerNorm: Rethinking Batch Normalization in Transformers
PowerNorm: Rethinking Batch Normalization in TransformersInternational Conference on Machine Learning (ICML), 2020
Sheng Shen
Z. Yao
A. Gholami
Michael W. Mahoney
Kurt Keutzer
BDL
267
17
0
17 Mar 2020
In Conclusion Not Repetition: Comprehensive Abstractive Summarization
  With Diversified Attention Based On Determinantal Point Processes
In Conclusion Not Repetition: Comprehensive Abstractive Summarization With Diversified Attention Based On Determinantal Point ProcessesConference on Computational Natural Language Learning (CoNLL), 2019
Lei Li
Wei Liu
Marina Litvak
N. Vanetik
Zuying Huang
114
12
0
24 Sep 2019
Improving Neural Language Modeling via Adversarial Training
Improving Neural Language Modeling via Adversarial TrainingInternational Conference on Machine Learning (ICML), 2019
Dilin Wang
Chengyue Gong
Qiang Liu
AAML
290
123
0
10 Jun 2019
Previous
1234
Page 4 of 4