Title
Transformer on a Diet Chenguang Wang Zihao Ye Aston Zhang Zheng Zhang Alex Smola 220 9 0 14 Feb 2020
CBAG: Conditional Biomedical Abstract GenerationPLoS ONE (PLOS ONE), 2020 Justin Sybrandt Ilya Safro MedIm AI4CE 117 10 0 13 Feb 2020
GLU Variants Improve Transformer Noam M. Shazeer 523 1,446 0 12 Feb 2020
How Much Knowledge Can You Pack Into the Parameters of a Language Model?Conference on Empirical Methods in Natural Language Processing (EMNLP), 2020 Adam Roberts Colin Raffel Noam M. Shazeer KELM 556 988 0 10 Feb 2020
REALM: Retrieval-Augmented Language Model Pre-TrainingInternational Conference on Machine Learning (ICML), 2020 Kelvin Guu Kenton Lee Zora Tung Panupong Pasupat Ming-Wei Chang RALM 1.1K 2,578 0 10 Feb 2020
Semi-Supervised Class Discovery Jeremy Nixon J. Liu David Berthelot 225 2 0 10 Feb 2020
Momentum Improves Normalized SGDInternational Conference on Machine Learning (ICML), 2020 Ashok Cutkosky Harsh Mehta ODL 417 158 0 09 Feb 2020
Segmented Graph-Bert for Graph Instance Modeling Jiawei Zhang SSeg 128 6 0 09 Feb 2020
Description Based Text Classification with Reinforcement LearningInternational Conference on Machine Learning (ICML), 2020 Duo Chai Wei Wu Qinghong Han Leilei Gan Jiwei Li VLM 368 70 0 08 Feb 2020
Aligning the Pretraining and Finetuning Objectives of Language Models Nuo Wang Pierse Jing Lu AI4CE 99 2 0 05 Feb 2020
K-Adapter: Infusing Knowledge into Pre-Trained Models with AdaptersFindings (Findings), 2020 Ruize Wang Duyu Tang Nan Duan Zhongyu Wei Xuanjing Huang Jianshu Ji Guihong Cao Daxin Jiang Ming Zhou KELM 504 593 0 05 Feb 2020
DUMA: Reading Comprehension with Transposition ThinkingIEEE/ACM Transactions on Audio Speech and Language Processing (TASLP), 2020 Q. Hu Hai Zhao Xiaoguang Li AI4CE 389 36 0 26 Jan 2020
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language GenerationInternational Joint Conference on Artificial Intelligence (IJCAI), 2020 Dongling Xiao Han Zhang Yukun Li Yu Sun Hao Tian Hua Wu Haifeng Wang 206 133 0 26 Jan 2020
Scaling Laws for Neural Language Models Jared Kaplan Sam McCandlish T. Henighan Tom B. Brown B. Chess R. Child Scott Gray Alec Radford Jeff Wu Dario Amodei 1.8K 6,606 0 23 Jan 2020
Multilingual Denoising Pre-training for Neural Machine TranslationTransactions of the Association for Computational Linguistics (TACL), 2020 Yinhan Liu Jiatao Gu Naman Goyal Xian Li Sergey Edunov Marjan Ghazvininejad M. Lewis Luke Zettlemoyer AI4CE AIMat 862 1,968 0 22 Jan 2020
Normalization of Input-output Shared Embeddings in Text Generation Models Jinyang Liu Yujia Zhai Zizhong Chen 121 0 0 22 Jan 2020
FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceNeural Information Processing Systems (NeurIPS), 2020 Kihyuk Sohn David Berthelot Chun-Liang Li Zizhao Zhang Nicholas Carlini E. D. Cubuk Alexey Kurakin Han Zhang Colin Raffel AAML 439 4,235 0 21 Jan 2020
Exploiting Cloze Questions for Few Shot Text Classification and Natural Language InferenceConference of the European Chapter of the Association for Computational Linguistics (EACL), 2020 Timo Schick Hinrich Schütze 1.0K 1,751 0 21 Jan 2020
Length-controllable Abstractive Summarization by Guiding with Summary Prototype Itsumi Saito Kyosuke Nishida Kosuke Nishida Atsushi Otsuka Hisako Asano J. Tomita Hiroyuki Shindo Yuji Matsumoto 230 37 0 21 Jan 2020
A multimodal deep learning approach for named entity recognition from social media M. Asgari-Chenaghlu M. Feizi-Derakhshi Leili Farzinvash M. Balafar C. Motamed 243 36 0 19 Jan 2020
RobBERT: a Dutch RoBERTa-based Language ModelFindings (Findings), 2020 Pieter Delobelle Thomas Winters Bettina Berendt 196 261 0 17 Jan 2020
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-trainingFindings (Findings), 2020 Weizhen Qi Yu Yan Yeyun Gong Dayiheng Liu Nan Duan Jiusheng Chen Ruofei Zhang Ming Zhou AI4TS 362 470 0 13 Jan 2020
Learning Accurate Integer Transformer Machine-Translation ModelsSN Computer Science (SN Comput. Sci.), 2020 Ephrem Wu 96 4 0 03 Jan 2020
What Does My QA Model Know? Devising Controlled Probes using Expert KnowledgeTransactions of the Association for Computational Linguistics (TACL), 2019 Kyle Richardson Ashish Sabharwal 207 47 0 31 Dec 2019
All-in-One Image-Grounded Conversational Agents Da Ju Kurt Shuster Y-Lan Boureau Jason Weston LLMAG 145 9 0 28 Dec 2019
Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures TranslationInternational Conference on Language Resources and Evaluation (LREC), 2019 Israfel Salazar Mary Dabre Atsushi Fujita Sadao Kurohashi 194 6 0 26 Dec 2019
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive SummarizationInternational Conference on Machine Learning (ICML), 2019 Jingqing Zhang Yao-Min Zhao Mohammad Saleh Peter J. Liu RALM 3DGS 785 2,289 0 18 Dec 2019
Multilingual is not enough: BERT for Finnish Antti Virtanen Jenna Kanerva Rami Ilo Jouni Luoma Juhani Luotolahti T. Salakoski Filip Ginter S. Pyysalo 226 300 0 15 Dec 2019
WaLDORf: Wasteless Language-model Distillation On Reading-comprehension J. Tian A. Kreuzer Pai-Hung Chen Hans-Martin Will VLM 162 3 0 13 Dec 2019
Extending Machine Language Models toward Human-Level Language Understanding James L. McClelland Felix Hill Maja R. Rudolph Jason Baldridge Hinrich Schütze LRM 151 36 0 12 Dec 2019
FlauBERT: Unsupervised Language Model Pre-training for FrenchInternational Conference on Language Resources and Evaluation (LREC), 2019 Hang Le Loïc Vial Jibril Frej Vincent Segonne Maximin Coavoux Benjamin Lecouteux A. Allauzen Benoît Crabbé Laurent Besacier D. Schwab AI4CE 330 430 0 11 Dec 2019
Zero-shot Text Classification With Generative Language Models Raul Puri Bryan Catanzaro VLM 150 116 0 10 Dec 2019
Large-scale Pretraining for Visual Dialog: A Simple State-of-the-Art BaselineEuropean Conference on Computer Vision (ECCV), 2019 Vishvak Murahari Dhruv Batra Devi Parikh Abhishek Das VLM 324 120 0 05 Dec 2019
12-in-1: Multi-Task Vision and Language Representation LearningComputer Vision and Pattern Recognition (CVPR), 2019 Jiasen Lu Vedanuj Goswami Marcus Rohrbach Devi Parikh Stefan Lee VLM ObjD 307 499 0 05 Dec 2019
BLiMP: The Benchmark of Linguistic Minimal Pairs for EnglishTransactions of the Association for Computational Linguistics (TACL), 2019 Alex Warstadt Alicia Parrish Haokun Liu Anhad Mohananey Wei Peng Sheng-Fu Wang Samuel R. Bowman 448 611 0 02 Dec 2019
What's Hidden in a Randomly Weighted Neural Network?Computer Vision and Pattern Recognition (CVPR), 2019 Vivek Ramanujan Mitchell Wortsman Aniruddha Kembhavi Ali Farhadi Mohammad Rastegari 229 390 0 29 Nov 2019
Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQAComputer Vision and Pattern Recognition (CVPR), 2019 Ronghang Hu Amanpreet Singh Trevor Darrell Marcus Rohrbach 317 224 0 14 Nov 2019
KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language RepresentationTransactions of the Association for Computational Linguistics (TACL), 2019 Xiaozhi Wang Tianyu Gao Zhaocheng Zhu Zhengyan Zhang Zhiyuan Liu Juan-Zi Li Jian Tang 371 765 0 13 Nov 2019
CamemBERT: a Tasty French Language ModelAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Louis Martin Benjamin Muller Pedro Ortiz Suarez Yoann Dupont Laurent Romary Eric Villemonte de la Clergerie Djamé Seddah Benoît Sagot 511 1,048 0 10 Nov 2019
INSET: Sentence Infilling with INter-SEntential Transformer Yichen Huang Yizhe Zhang Oussama Elachqar Yu Cheng 227 1 0 10 Nov 2019
Learning to Few-Shot Learn Across Diverse Natural Language Classification TasksInternational Conference on Computational Linguistics (COLING), 2019 Trapit Bansal Rishikesh Jha Andrew McCallum SSL 264 126 0 10 Nov 2019
The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational AgentsAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Kurt Shuster Da Ju Stephen Roller Emily Dinan Y-Lan Boureau Jason Weston 244 84 0 09 Nov 2019
Sentence Meta-Embeddings for Unsupervised Semantic Textual SimilarityAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Nina Poerner Ulli Waltinger Hinrich Schütze AI4TS 453 21 0 09 Nov 2019
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized OptimizationAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Haoming Jiang Pengcheng He Weizhu Chen Xiaodong Liu Jianfeng Gao T. Zhao 580 588 0 08 Nov 2019
Contrastive Multi-document Question GenerationConference of the European Chapter of the Association for Computational Linguistics (EACL), 2019 W. Cho Yizhe Zhang Sudha Rao Asli Celikyilmaz Chenyan Xiong Jianfeng Gao Mengdi Wang Bill Dolan SyDa 348 31 0 08 Nov 2019
BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performanceBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP (BlackBoxNLP), 2019 R. Thomas McCoy Junghyun Min Tal Linzen 364 156 0 07 Nov 2019
Unsupervised Cross-lingual Representation Learning at ScaleAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Alexis Conneau Kartikay Khandelwal Naman Goyal Vishrav Chaudhary Guillaume Wenzek Francisco Guzmán Edouard Grave Myle Ott Luke Zettlemoyer Veselin Stoyanov 482 7,588 0 05 Nov 2019
DialoGPT: Large-Scale Generative Pre-training for Conversational Response GenerationAnnual Meeting of the Association for Computational Linguistics (ACL), 2019 Yizhe Zhang Siqi Sun Michel Galley Yen-Chun Chen Chris Brockett Xiang Gao Jianfeng Gao Jingjing Liu W. Dolan VLM 604 1,650 0 01 Nov 2019
CCNet: Extracting High Quality Monolingual Datasets from Web Crawl DataInternational Conference on Language Resources and Evaluation (LREC), 2019 Guillaume Wenzek Marie-Anne Lachaux Alexis Conneau Vishrav Chaudhary Francisco Guzmán Armand Joulin Edouard Grave 447 745 0 01 Nov 2019
Multi-Stage Document Ranking with BERT Rodrigo Nogueira Wei Yang Dong Wang Jimmy J. Lin 297 455 0 31 Oct 2019