Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019

Xiaodong Liu

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

45 / 845 papers shown

Title
Deep Reinforced Self-Attention Masks for Abstractive Summarization (DR.SAS) Ankit R. Chadha Mohamed Masoud AI4TS 9 0 0 30 Dec 2019
Leveraging Lead Bias for Zero-shot Abstractive News Summarization Chenguang Zhu Ziyi Yang R. Gmyr Michael Zeng Xuedong Huang 8 19 0 25 Dec 2019
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization Jingqing Zhang Yao-Min Zhao Mohammad Saleh Peter J. Liu RALM 3DGS 18 2,001 0 18 Dec 2019
Relevance-Promoting Language Model for Short-Text Conversation Xin Li Piji Li Wei Bi Xiaojiang Liu Wai Lam 11 11 0 26 Nov 2019
Controlling the Amount of Verbatim Copying in Abstractive Summarization Kaiqiang Song Bingqing Wang Z. Feng Liu Ren Fei Liu 6 51 0 23 Nov 2019
Paraphrasing with Large Language Models Sam Witteveen Martin Andrews 14 75 0 21 Nov 2019
Working Memory Graphs Ricky Loynd Roland Fernandez Asli Celikyilmaz Adith Swaminathan Matthew J. Hausknecht 9 40 0 17 Nov 2019
Unsupervised Pre-training for Natural Language Generation: A Literature Review Yuanxin Liu Zheng Lin SSL AI4CE 14 3 0 13 Nov 2019
Listen and Fill in the Missing Letters: Non-Autoregressive Transformer for Speech Recognition Nanxin Chen Shinji Watanabe Jesús Villalba Najim Dehak 7 16 0 10 Nov 2019
CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning Bill Yuchen Lin Wangchunshu Zhou Minghan Shen Pei Zhou Chandra Bhagavatula Yu Xing Xiang Ren LRM 15 16 0 09 Nov 2019
Zero-Shot Paraphrase Generation with Multilingual Language Models Yinpeng Guo Yi-Lun Liao Xin Jiang Qing Zhang Yibo Zhang Qun Liu SyDa LRM 8 23 0 09 Nov 2019
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization Haoming Jiang Pengcheng He Weizhu Chen Xiaodong Liu Jianfeng Gao T. Zhao 11 553 0 08 Nov 2019
Ask to Learn: A Study on Curiosity-driven Question Generation Thomas Scialom Jacopo Staiano 17 24 0 08 Nov 2019
Transforming Wikipedia into Augmented Data for Query-Focused Summarization Haichao Zhu Li Dong Furu Wei Bing Qin Ting Liu RALM 20 22 0 08 Nov 2019
Grounded Conversation Generation as Guided Traverses in Commonsense Knowledge Graphs Houyu Zhang Zhenghao Liu Chenyan Xiong Zhiyuan Liu 14 145 0 07 Nov 2019
SentiLARE: Sentiment-Aware Language Representation Learning with Linguistic Knowledge Pei Ke Haozhe Ji Siyang Liu Xiaoyan Zhu Minlie Huang 6 7 0 06 Nov 2019
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension M. Lewis Yinhan Liu Naman Goyal Marjan Ghazvininejad Abdel-rahman Mohamed Omer Levy Veselin Stoyanov Luke Zettlemoyer AIMat VLM 12 10,536 0 29 Oct 2019
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer Colin Raffel Noam M. Shazeer Adam Roberts Katherine Lee Sharan Narang Michael Matena Yanqi Zhou Wei Li Peter J. Liu AIMat 24 19,320 0 23 Oct 2019
PLATO: Pre-trained Dialogue Generation Model with Discrete Latent Variable Siqi Bao H. He Fan Wang Hua-Hong Wu Haifeng Wang 8 267 0 17 Oct 2019
Exploiting BERT for End-to-End Aspect-based Sentiment Analysis Xin Li Lidong Bing Wenxuan Zhang W. Lam 15 276 0 02 Oct 2019
Better Document-Level Machine Translation with Bayes' Rule Lei Yu Laurent Sartran Wojciech Stokowiec Wang Ling Lingpeng Kong Phil Blunsom Chris Dyer 11 7 0 01 Oct 2019
A Closer Look at Data Bias in Neural Extractive Summarization Models Ming Zhong Danqing Wang Pengfei Liu Xipeng Qiu Xuanjing Huang 23 42 0 30 Sep 2019
Unified Vision-Language Pre-Training for Image Captioning and VQA Luowei Zhou Hamid Palangi Lei Zhang Houdong Hu Jason J. Corso Jianfeng Gao MLLM VLM 250 922 0 24 Sep 2019
Cross-Lingual Natural Language Generation via Pre-Training Zewen Chi Li Dong Furu Wei Wenhui Wang Xian-Ling Mao Heyan Huang 11 136 0 23 Sep 2019
I-MAD: Interpretable Malware Detector Using Galaxy Transformer Miles Q. Li Benjamin C. M. Fung P. Charland Steven H. H. Ding 19 31 0 15 Sep 2019
Tree Transformer: Integrating Tree Structures into Self-Attention Yau-Shian Wang Hung-yi Lee Yun-Nung (Vivian) Chen 9 145 0 14 Sep 2019
Addressing Semantic Drift in Question Generation for Semi-Supervised Question Answering Shiyue Zhang Mohit Bansal 19 140 0 13 Sep 2019
Pretrained Language Models for Sequential Sentence Classification Arman Cohan Iz Beltagy Daniel King Bhavana Dalvi Daniel S. Weld 10 128 0 09 Sep 2019
Conditional Text Generation for Harmonious Human-Machine Interaction Bin Guo Hao Wang Yasan Ding Wei Wu Shaoyang Hao Yueqi Sun Zhiwen Yu 13 4 0 08 Sep 2019
Text Summarization with Pretrained Encoders Yang Liu Mirella Lapata MILM 254 1,417 0 22 Aug 2019
Denoising based Sequence-to-Sequence Pre-training for Text Generation Liang Wang Wei-Ye Zhao Ruoyu Jia Sujian Li Jingming Liu VLM AI4CE 23 37 0 22 Aug 2019
Encoder-Agnostic Adaptation for Conditional Language Generation Zachary M. Ziegler Luke Melas-Kyriazi Sebastian Gehrmann Alexander M. Rush AI4CE 11 57 0 19 Aug 2019
Visualizing and Understanding the Effectiveness of BERT Y. Hao Li Dong Furu Wei Ke Xu 11 181 0 15 Aug 2019
Reinforcement Learning Based Graph-to-Sequence Model for Natural Question Generation Yu Chen Lingfei Wu Mohammed J. Zaki GNN 14 152 0 14 Aug 2019
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks S. Rothe Shashi Narayan Aliaksei Severyn SILM 52 433 0 29 Jul 2019
RoBERTa: A Robustly Optimized BERT Pretraining Approach Yinhan Liu Myle Ott Naman Goyal Jingfei Du Mandar Joshi Danqi Chen Omer Levy M. Lewis Luke Zettlemoyer Veselin Stoyanov AIMat 8 23,739 0 26 Jul 2019
SpanBERT: Improving Pre-training by Representing and Predicting Spans Mandar Joshi Danqi Chen Yinhan Liu Daniel S. Weld Luke Zettlemoyer Omer Levy 20 1,934 0 24 Jul 2019
What is this Article about? Extreme Summarization with Topic-aware Convolutional Neural Networks Shashi Narayan Shay B. Cohen Mirella Lapata AILaw 19 18 0 19 Jul 2019
Can Unconditional Language Models Recover Arbitrary Sentences? Nishant Subramani Samuel R. Bowman Kyunghyun Cho 11 25 0 10 Jul 2019
Learning to Ask Unanswerable Questions for Machine Reading Comprehension Haichao Zhu Li Dong Furu Wei Wenhui Wang Bing Qin Ting Liu RALM 14 30 0 14 Jun 2019
Multi-Task Deep Neural Networks for Natural Language Understanding Xiaodong Liu Pengcheng He Weizhu Chen Jianfeng Gao AI4CE 14 1,258 0 31 Jan 2019
Neural Abstractive Text Summarization with Sequence-to-Sequence Models Tian Shi Yaser Keneshloo Naren Ramakrishnan Chandan K. Reddy 25 222 0 05 Dec 2018
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,927 0 20 Apr 2018
OpenNMT: Open-Source Toolkit for Neural Machine Translation Guillaume Klein Yoon Kim Yuntian Deng Jean Senellart Alexander M. Rush 254 1,895 0 10 Jan 2017
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation Yonghui Wu M. Schuster Z. Chen Quoc V. Le Mohammad Norouzi ... Alex Rudnick Oriol Vinyals G. Corrado Macduff Hughes J. Dean AIMat 716 6,724 0 26 Sep 2016