Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019

Xiaodong Liu

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 845 papers shown

Title
Zero-Resource Knowledge-Grounded Dialogue Generation Linxiao Li Can Xu Wei Yu Wu Yufan Zhao Xueliang Zhao Chongyang Tao 22 70 0 29 Aug 2020
GRIT: Generative Role-filler Transformers for Document-level Event Entity Extraction Xinya Du Alexander M. Rush Claire Cardie 15 12 0 21 Aug 2020
DeVLBert: Learning Deconfounded Visio-Linguistic Representations Shengyu Zhang Tan Jiang Tan Wang Kun Kuang Zhou Zhao Jianke Zhu Jin Yu Hongxia Yang Fei Wu OOD 9 85 0 16 Aug 2020
Variance-reduced Language Pretraining via a Mask Proposal Network Liang Chen SSL 6 8 0 12 Aug 2020
SARG: A Novel Semi Autoregressive Generator for Multi-turn Incomplete Utterance Restoration Mengzuo Huang Feng Li Wuhe Zou Weidong Zhang RALM 8 25 0 04 Aug 2020
On Learning Universal Representations Across Languages Xiangpeng Wei Rongxiang Weng Yue Hu Luxi Xing Heng Yu Weihua Luo SSL VLM 20 85 0 31 Jul 2020
Neural Language Generation: Formulation, Methods, and Evaluation Cristina Garbacea Qiaozhu Mei 32 30 0 31 Jul 2020
Big Bird: Transformers for Longer Sequences Manzil Zaheer Guru Guruganesh Kumar Avinava Dubey Joshua Ainslie Chris Alberti ... Philip Pham Anirudh Ravula Qifan Wang Li Yang Amr Ahmed VLM 249 2,009 0 28 Jul 2020
SummEval: Re-evaluating Summarization Evaluation Alexander R. Fabbri Wojciech Kry'sciñski Bryan McCann Caiming Xiong R. Socher Dragomir R. Radev HILM 21 683 0 24 Jul 2020
Spatially Aware Multimodal Transformers for TextVQA Yash Kant Dhruv Batra Peter Anderson A. Schwing Devi Parikh Jiasen Lu Harsh Agrawal 6 85 0 23 Jul 2020
DART: Open-Domain Structured Data Record to Text Generation Linyong Nan Dragomir R. Radev Rui Zhang Amrit Rau Abhinand Sivaprasad ... Y. Tan Xi Victoria Lin Caiming Xiong R. Socher Nazneen Rajani 10 199 0 06 Jul 2020
PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learning Siqi Bao H. He Fan Wang Hua-Hong Wu Haifeng Wang Wenquan Wu Zhen Guo Zhibin Liu Xinchao Xu 16 137 0 30 Jun 2020
Train and You'll Miss It: Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings Mayee F. Chen Daniel Y. Fu Frederic Sala Sen Wu Ravi Teja Mullapudi Fait Poms Kayvon Fatahalian Christopher Ré 6 10 0 26 Jun 2020
Pre-training via Paraphrasing M. Lewis Marjan Ghazvininejad Gargi Ghosh Armen Aghajanyan Sida I. Wang Luke Zettlemoyer AIMat 6 158 0 26 Jun 2020
Evaluation of Text Generation: A Survey Asli Celikyilmaz Elizabeth Clark Jianfeng Gao ELM LM&MA 14 374 0 26 Jun 2020
SEAL: Segment-wise Extractive-Abstractive Long-form Text Summarization Yao-Min Zhao Mohammad Saleh Peter J. Liu RALM 15 25 0 18 Jun 2020
CO-Search: COVID-19 Information Retrieval with Semantic Search, Question Answering, and Abstractive Summarization A. Esteva Anuprit Kale Romain Paulus Kazuma Hashimoto Wenpeng Yin Dragomir R. Radev R. Socher 8 64 0 17 Jun 2020
Cross-lingual Retrieval for Iterative Self-Supervised Training C. Tran Y. Tang Xian Li Jiatao Gu RALM 17 72 0 16 Jun 2020
MC-BERT: Efficient Language Pre-Training via a Meta Controller Zhenhui Xu Linyuan Gong Guolin Ke Di He Shuxin Zheng Liwei Wang Jiang Bian Tie-Yan Liu BDL 8 18 0 10 Jun 2020
Mathematical Reasoning via Self-supervised Skip-tree Training M. Rabe Dennis Lee Kshitij Bansal Christian Szegedy ReLM LRM 6 2 0 08 Jun 2020
ColdGANs: Taming Language GANs with Cautious Sampling Strategies Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano GAN SyDa 12 18 0 08 Jun 2020
DeBERTa: Decoding-enhanced BERT with Disentangled Attention Pengcheng He Xiaodong Liu Jianfeng Gao Weizhu Chen AAML 20 2,607 0 05 Jun 2020
Scaling Distributed Training with Adaptive Summation Saeed Maleki Madan Musuvathi Todd Mytkowicz Olli Saarikivi Tianju Xu Vadim Eksarevskiy Jaliya Ekanayake Emad Barsoum 6 9 0 04 Jun 2020
DocBank: A Benchmark Dataset for Document Layout Analysis Minghao Li Yiheng Xu Lei Cui Shaohan Huang Furu Wei Zhoujun Li Ming Zhou 12 200 0 01 Jun 2020
A Survey on Transfer Learning in Natural Language Processing Zaid Alyafeai Maged S. Alshaibani Irfan Ahmad 18 71 0 31 May 2020
Generating Diverse and Consistent QA pairs from Contexts with Information-Maximizing Hierarchical Conditional VAEs Dong Bok Lee Seanie Lee Woo Tae Jeong Donghwan Kim Sung Ju Hwang 16 71 0 28 May 2020
CausaLM: Causal Model Explanation Through Counterfactual Language Models Amir Feder Nadav Oved Uri Shalit Roi Reichart CML LRM 22 156 0 27 May 2020
Explicit Memory Tracker with Coarse-to-Fine Reasoning for Conversational Machine Reading Yifan Gao Chien-Sheng Wu Shafiq R. Joty Caiming Xiong R. Socher Irwin King M. Lyu S. Hoi RALM 10 20 0 26 May 2020
Stronger Baselines for Grammatical Error Correction Using Pretrained Encoder-Decoder Model Satoru Katsumata Mamoru Komachi 9 53 0 24 May 2020
A Question Type Driven and Copy Loss Enhanced Frameworkfor Answer-Agnostic Neural Question Generation Xiuyu Wu Nan Jiang Yunfang Wu 21 9 0 24 May 2020
Comparative Study of Machine Learning Models and BERT on SQuAD Devshree Patel Param Raval Ratnam Parikh Yesha Shastri 6 7 0 22 May 2020
Applying the Transformer to Character-level Transduction Shijie Wu Ryan Cotterell Mans Hulden AI4CE 6 101 0 20 May 2020
Leveraging Graph to Improve Abstractive Multi-Document Summarization Wei Li Xinyan Xiao Jiachen Liu Hua-Hong Wu Haifeng Wang Junping Du 11 133 0 20 May 2020
A Further Study of Unsupervised Pre-training for Transformer Based Speech Recognition Dongwei Jiang Wubo Li Ruixiong Zhang Miao Cao Ne Luo Yang Han Wei Zou Xiangang Li SSL 14 29 0 20 May 2020
Machine Reading Comprehension: The Role of Contextualized Language Models and Beyond Zhuosheng Zhang Hai Zhao Rui Wang 16 61 0 13 May 2020
SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching Baolin Peng Chunyuan Li Jinchao Li Shahin Shayandeh Lars Liden Jianfeng Gao 9 125 0 11 May 2020
Commonsense Evidence Generation and Injection in Reading Comprehension Ye Liu Tao Yang Zeyu You Wei Fan Philip S. Yu 14 14 0 11 May 2020
Harvesting and Refining Question-Answer Pairs for Unsupervised QA Zhongli Li Wenhui Wang Li Dong Furu Wei Ke Xu 13 40 0 06 May 2020
CAiRE-COVID: A Question Answering and Query-focused Multi-Document Summarization System for COVID-19 Scholarly Information Management Dan Su Yan Xu Tiezheng Yu Farhad Bin Siddique Elham J. Barezi Pascale Fung RALM 11 31 0 04 May 2020
Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Reward Luyang Huang Lingfei Wu Lu Wang RALM 17 162 0 03 May 2020
Simplifying Paragraph-level Question Generation via Transformer Language Models Luis Enrico Lopez Diane Kathryn Cruz Jan Christian Blaise Cruz C. Cheng 6 24 0 03 May 2020
Improving Truthfulness of Headline Generation Kazuki Matsumaru Sho Takase Naoaki Okazaki HILM 6 49 0 02 May 2020
A Simple Language Model for Task-Oriented Dialogue Ehsan Hosseini-Asl Bryan McCann Chien-Sheng Wu Semih Yavuz R. Socher 12 518 0 02 May 2020
On Faithfulness and Factuality in Abstractive Summarization Joshua Maynez Shashi Narayan Bernd Bohnet Ryan T. McDonald HILM 15 997 0 02 May 2020
POINTER: Constrained Progressive Text Generation via Insertion-based Generative Pre-training Yizhe Zhang Guoyin Wang Chunyuan Li Zhe Gan Chris Brockett Bill Dolan 21 30 0 01 May 2020
Discourse-Aware Unsupervised Summarization of Long Scientific Documents Yue Dong Andrei Mircea Jackie C.K. Cheung 11 8 0 01 May 2020
HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training Linjie Li Yen-Chun Chen Yu Cheng Zhe Gan Licheng Yu Jingjing Liu MLLM VLM OffRL AI4TS 27 489 0 01 May 2020
KPQA: A Metric for Generative Question Answering Using Keyphrase Weights Hwanhee Lee Seunghyun Yoon Franck Dernoncourt Doo Soon Kim Trung Bui Joongbo Shin Kyomin Jung 11 0 0 01 May 2020
Recipes for Adapting Pre-trained Monolingual and Multilingual Models to Machine Translation Asa Cooper Stickland Xian Li Marjan Ghazvininejad 12 44 0 30 Apr 2020
MLSUM: The Multilingual Summarization Corpus Thomas Scialom Paul-Alexis Dray Sylvain Lamprier Benjamin Piwowarski Jacopo Staiano 6 171 0 30 Apr 2020