Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019

Xiaodong Liu

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 846 papers shown

Title
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages Baptiste Roziere Marie-Anne Lachaux Marc Szafraniec Guillaume Lample AI4CE 44 135 0 15 Feb 2021
CATE: Computation-aware Neural Architecture Encoding with Transformers Shen Yan Kaiqiang Song Z. Feng Mi Zhang 17 24 0 14 Feb 2021
Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR Ruchao Fan Amber Afshan Abeer Alwan 16 14 0 12 Feb 2021
Speech-language Pre-training for End-to-end Spoken Language Understanding Yao Qian Ximo Bian Yu Shi Naoyuki Kanda Leo Shen Zhen Xiao Michael Zeng AuLLM 13 45 0 11 Feb 2021
Proof Artifact Co-training for Theorem Proving with Language Models Jesse Michael Han Jason M. Rute Yuhuai Wu Edward W. Ayers Stanislas Polu AIMat 16 120 0 11 Feb 2021
Text Compression-aided Transformer Encoding Z. Li Zhuosheng Zhang Hai Zhao Rui Wang Kehai Chen Masao Utiyama Eiichiro Sumita AI4CE 19 44 0 11 Feb 2021
Self-Teaching Machines to Read and Comprehend with Large-Scale Multi-Subject Question-Answering Data Dian Yu Kai Sun Dong Yu Claire Cardie 26 7 0 01 Feb 2021
Generative Spoken Language Modeling from Raw Audio Kushal Lakhotia Evgeny Kharitonov Wei-Ning Hsu Yossi Adi Adam Polyak ... Tu Nguyen Jade Copet Alexei Baevski A. Mohamed Emmanuel Dupoux AuLLM 174 336 0 01 Feb 2021
An Empirical Study on the Generalization Power of Neural Representations Learned via Visual Guessing Games Alessandro Suglia Yonatan Bisk Ioannis Konstas Antonio Vergari E. Bastianelli Andrea Vanzo Oliver Lemon 16 8 0 31 Jan 2021
DOC2PPT: Automatic Presentation Slides Generation from Scientific Documents Tsu-jui Fu W. Wang Daniel J. McDuff Yale Song 6 49 0 28 Jan 2021
Scheduled Sampling in Vision-Language Pretraining with Decoupled Encoder-Decoder Network Yehao Li Yingwei Pan Ting Yao Jingwen Chen Tao Mei VLM 13 52 0 27 Jan 2021
Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access Track in DSTC9 Seokhwan Kim Mihail Eric Behnam Hedayatnia Karthik Gopalakrishnan Yang Liu Chao-Wei Huang Dilek Z. Hakkani-Tür 14 15 0 22 Jan 2021
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning Yuhuai Wu M. Rabe Wenda Li Jimmy Ba Roger C. Grosse Christian Szegedy AIMat LRM 61 51 0 15 Jan 2021
End-to-End Video Question-Answer Generation with Generator-Pretester Network Hung-Ting Su Chen-Hsi Chang Po-Wei Shen Yu-Siang Wang Ya-Liang Chang Yu-Cheng Chang Pu-Jen Cheng Winston H. Hsu 27 31 0 05 Jan 2021
Outline to Story: Fine-grained Controllable Story Generation from Cascaded Events Le Fang Tao Zeng Chao-Ning Liu Liefeng Bo Wen Dong Changyou Chen 22 12 0 04 Jan 2021
Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting Wangchunshu Zhou Tao Ge Canwen Xu Ke Xu Furu Wei LRM 14 15 0 02 Jan 2021
Intent Classification and Slot Filling for Privacy Policies Wasi Uddin Ahmad Jianfeng Chi Tu Le Thomas B. Norton Yuan Tian Kai-Wei Chang 11 23 0 01 Jan 2021
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers Wenhui Wang Hangbo Bao Shaohan Huang Li Dong Furu Wei MQ 11 254 0 31 Dec 2020
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders Shuming Ma Jian Yang Haoyang Huang Zewen Chi Li Dong ... Akiko Eriguchi Saksham Singhal Xia Song Arul Menezes Furu Wei LRM 21 33 0 31 Dec 2020
UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning Wei Li Can Gao Guocheng Niu Xinyan Xiao Hao Liu Jiachen Liu Hua-Hong Wu Haifeng Wang 20 374 0 31 Dec 2020
Dialogue Graph Modeling for Conversational Machine Reading Siru Ouyang Zhuosheng Zhang Hai Zhao 19 42 0 29 Dec 2020
A Hierarchical Transformer with Speaker Modeling for Emotion Recognition in Conversation JiangNan Li Zheng Lin Peng Fu Q. Si Weiping Wang 11 18 0 29 Dec 2020
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems Baolin Peng Chunyuan Li Zhu Zhang Chenguang Zhu Jinchao Li Jianfeng Gao 11 49 0 29 Dec 2020
Global Context Networks Yue Cao Jiarui Xu Stephen Lin Fangyun Wei Han Hu ISeg 28 95 0 24 Dec 2020
A Survey on Visual Transformer Kai Han Yunhe Wang Hanting Chen Xinghao Chen Jianyuan Guo ... Chunjing Xu Yixing Xu Zhaohui Yang Yiman Zhang Dacheng Tao ViT 16 2,096 0 23 Dec 2020
Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems Chao-Hong Tan Xiaoyu Yang Zióu Zheng Tianda Li Yufei Feng Jia-Chen Gu Quan Liu Dan Liu Zhenhua Ling Xiao-Dan Zhu RALM 8 9 0 22 Dec 2020
Lexically-constrained Text Generation through Commonsense Knowledge Extraction and Injection Yikang Li P. Goel Varsha Kuppur Rajendra H. Singh Jonathan M Francis Kaixin Ma Eric Nyberg A. Oltramari 8 7 0 19 Dec 2020
Breaking Writer's Block: Low-cost Fine-tuning of Natural Language Generation Models Alexandre Duval Thomas Lamson Gael de Leseleuc de Kerouara Matthias Gallé 6 0 0 19 Dec 2020
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training Peng Shi Patrick K. L. Ng Zhiguo Wang Henghui Zhu Alexander Hanbo Li Jun Wang Cicero Nogueira dos Santos Bing Xiang 13 117 0 18 Dec 2020
Contrastive Learning with Adversarial Perturbations for Conditional Text Generation Seanie Lee Dong Bok Lee Sung Ju Hwang 11 105 0 14 Dec 2020
EQG-RACE: Examination-Type Question Generation Xin Jia Wenjie Zhou Xu Sun Yunfang Wu AI4Ed 9 39 0 11 Dec 2020
Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generation Ruibo Liu Guangxuan Xu Chenyan Jia Weicheng Ma Lili Wang Soroush Vosoughi 23 107 0 05 Dec 2020
Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning Daniel Grießhaber J. Maucher Ngoc Thang Vu 15 46 0 04 Dec 2020
End-to-End QA on COVID-19: Domain Adaptation with Synthetic Training R. Reddy Bhavani Iyer Md Arafat Sultan Rong Zhang Avirup Sil Vittorio Castelli Radu Florian Salim Roukos OOD 13 19 0 02 Dec 2020
An Enhanced Knowledge Injection Model for Commonsense Generation Zhihao Fan Yeyun Gong Zhongyu Wei Siyuan Wang Ya-Chieh Huang Jian Jiao Xuanjing Huang Nan Duan Ruofei Zhang 13 27 0 01 Dec 2020
Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT Ruifeng Yuan Zili Wang Wenjie Li 10 22 0 19 Nov 2020
UP-DETR: Unsupervised Pre-training for Object Detection with Transformers Zhigang Dai Bolun Cai Yugeng Lin Junying Chen ViT 22 22 0 18 Nov 2020
Generating Fact Checking Briefs Angela Fan Aleksandra Piktus Fabio Petroni Guillaume Wenzek Marzieh Saeidi Andreas Vlachos Antoine Bordes Sebastian Riedel HILM 9 57 0 10 Nov 2020
Multilingual AMR-to-Text Generation Angela Fan Claire Gardent 4 32 0 10 Nov 2020
Multimodal Pretraining for Dense Video Captioning Gabriel Huang Bo Pang Zhenhai Zhu Clara E. Rivera Radu Soricut 6 82 0 10 Nov 2020
Multi-document Summarization via Deep Learning Techniques: A Survey Congbo Ma W. Zhang Mingyu Guo Hu Wang Quan Z. Sheng 11 124 0 10 Nov 2020
CHIME: Cross-passage Hierarchical Memory Network for Generative Review Question Answering Junru Lu Gabriele Pergola Lin Gui Binyang Li Yulan He 12 8 0 01 Nov 2020
A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Models Usman Naseem Imran Razzak S. Khan M. Prasad 12 157 0 28 Oct 2020
Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping Minjia Zhang Yuxiong He AI4CE 6 100 0 26 Oct 2020
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints Ximing Lu Peter West Rowan Zellers Ronan Le Bras Chandra Bhagavatula Yejin Choi NAI 6 142 0 24 Oct 2020
Multilingual Speech Translation with Efficient Finetuning of Pretrained Models Xian Li Changhan Wang Yun Tang C. Tran Yuqing Tang J. Pino Alexei Baevski Alexis Conneau Michael Auli 17 6 0 24 Oct 2020
Pre-training Text-to-Text Transformers for Concept-centric Common Sense Wangchunshu Zhou Dong-Ho Lee Ravi Kiran Selvam Seyeon Lee Bill Yuchen Lin Xiang Ren LRM VLM 4 71 0 24 Oct 2020
Open-Domain Dialogue Generation Based on Pre-trained Language Models Yan Zeng J. Nie 11 3 0 24 Oct 2020
Improved Synthetic Training for Reading Comprehension Yanda Chen Md Arafat Sultan T. J. W. R. Center SyDa 6 5 0 24 Oct 2020
Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering Arij Riabi Thomas Scialom Rachel Keraron Benoît Sagot Djamé Seddah Jacopo Staiano 140 52 0 23 Oct 2020