Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019

Xiaodong Liu

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 847 papers shown

Title
PIGLeT: Language Grounding Through Neuro-Symbolic Interaction in a 3D World Rowan Zellers Ari Holtzman Matthew E. Peters Roozbeh Mottaghi Aniruddha Kembhavi Ali Farhadi Yejin Choi 11 68 0 01 Jun 2021
M6-T: Exploring Sparse Expert Models and Beyond An Yang Junyang Lin Rui Men Chang Zhou Le Jiang ... Dingyang Zhang Wei Lin Lin Qu Jingren Zhou Hongxia Yang MoE 29 24 0 31 May 2021
Zero-shot Fact Verification by Claim Generation Liangming Pan Wenhu Chen Wenhan Xiong Min-Yen Kan W. Wang 26 56 0 31 May 2021
M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformers Zhu Zhang Jianxin Ma Chang Zhou Rui Men Zhikang Li Ming Ding Jie Tang Jingren Zhou Hongxia Yang 25 46 0 29 May 2021
Controllable Abstractive Dialogue Summarization with Sketch Supervision C. Wu Linqing Liu Wenhao Liu Pontus Stenetorp Caiming Xiong 9 52 0 28 May 2021
Cross-Lingual Abstractive Summarization with Limited Parallel Resources Yu Bai Yang Gao Heyan Huang 8 51 0 28 May 2021
Maria: A Visual Experience Powered Conversational Agent Zujie Liang Huang Hu Can Xu Chongyang Tao Xiubo Geng Yining Chen Fan Liang Daxin Jiang 15 29 0 27 May 2021
Generative Text Modeling through Short Run Inference Bo Pang Erik Nijkamp Tian Han Ying Nian Wu SyDa BDL DRL 12 5 0 27 May 2021
Improve Query Focused Abstractive Summarization by Incorporating Answer Relevance Dan Su Tiezheng Yu Pascale Fung 13 28 0 27 May 2021
TreeBERT: A Tree-Based Pre-Trained Model for Programming Language Xue Jiang Zhuoran Zheng Chen Lyu Liang Li Lei Lyu 11 88 0 26 May 2021
Read, Listen, and See: Leveraging Multimodal Information Helps Chinese Spell Checking Heng-Da Xu Zhongli Li Qingyu Zhou Chao Li Zizhen Wang Yunbo Cao Heyan Huang Xian-Ling Mao 30 94 0 26 May 2021
BASS: Boosting Abstractive Summarization with Unified Semantic Graph Wenhao Wu Wei Li Xinyan Xiao Jiachen Liu Ziqiang Cao Sujian Li Hua-Hong Wu Haifeng Wang 20 45 0 25 May 2021
Focus Attention: Promoting Faithfulness and Diversity in Summarization Rahul Aralikatte Shashi Narayan Joshua Maynez S. Rothe Ryan T. McDonald 17 45 0 25 May 2021
Personalized Transformer for Explainable Recommendation Lei Li Yongfeng Zhang Li Chen 20 137 0 25 May 2021
Retrieval Enhanced Model for Commonsense Generation Han Wang Yang Liu Chenguang Zhu Linjun Shou Ming Gong Yichong Xu Michael Zeng RALM LRM 23 32 0 24 May 2021
Pretrained Language Models for Text Generation: A Survey Junyi Li Tianyi Tang Wayne Xin Zhao Ji-Rong Wen LM&MA VLM SyDa 30 182 0 21 May 2021
Should We Trust This Summary? Bayesian Abstractive Summarization to The Rescue Alexios Gidiotis Grigorios Tsoumakas UQCV UD BDL 11 9 0 21 May 2021
Long Text Generation by Modeling Sentence-Level and Discourse-Level Coherence Jian-Yu Guan Xiaoxi Mao Changjie Fan Zitao Liu Wenbiao Ding Minlie Huang AuLLM 15 77 0 19 May 2021
Towards an Online Empathetic Chatbot with Emotion Causes Yanran Li K. Li Hongke Ning Xiaoqiang Xia Yalong Guo Chen Wei Jianwei Cui Bin Wang 8 50 0 11 May 2021
Improving Factual Consistency of Abstractive Summarization via Question Answering Feng Nan Cicero Nogueira dos Santos Henghui Zhu Patrick K. L. Ng Kathleen McKeown Ramesh Nallapati Dejiao Zhang Zhiguo Wang Andrew O. Arnold Bing Xiang HILM 6 82 0 10 May 2021
Pseudo Siamese Network for Few-shot Intent Generation Congying Xia Caiming Xiong Philip Yu ViT 53 21 0 03 May 2021
Automated News Summarization Using Transformers Anushka Gupta Diksha Chugh Anjum R. Katarya 14 62 0 23 Apr 2021
Emotion-Regularized Conditional Variational Autoencoder for Emotional Response Generation Yu-Ping Ruan Zhenhua Ling DRL 11 16 0 18 Apr 2021
Extract, Denoise and Enforce: Evaluating and Improving Concept Preservation for Text-to-Text Generation Yuning Mao Wenchang Ma Deren Lei Jiawei Han Xiang Ren 13 4 0 18 Apr 2021
Knowledge Neurons in Pretrained Transformers Damai Dai Li Dong Y. Hao Zhifang Sui Baobao Chang Furu Wei KELM MU 6 414 0 18 Apr 2021
MT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs Zewen Chi Li Dong Shuming Ma Shaohan Huang Xian-Ling Mao Heyan Huang Furu Wei LRM 45 71 0 18 Apr 2021
A Survey of Recent Abstract Summarization Techniques Diyah Puspitaningrum 8 6 0 15 Apr 2021
Planning with Learned Entity Prompts for Abstractive Summarization Shashi Narayan Yao-Min Zhao Joshua Maynez Gonçalo Simões Vitaly Nikolaev Ryan T. McDonald LRM 6 116 0 15 Apr 2021
RefSum: Refactoring Neural Summarization Yixin Liu Zi-Yi Dou Pengfei Liu 8 40 0 15 Apr 2021
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce Song Xu Haoran Li Peng Yuan Yujia Wang Youzheng Wu Xiaodong He Ying Liu Bowen Zhou KELM 14 24 0 14 Apr 2021
Conversational Semantic Role Labeling Kun Xu Han Wu Linfeng Song Haisong Zhang Linqi Song Dong Yu 14 19 0 11 Apr 2021
Attention Head Masking for Inference Time Content Selection in Abstractive Summarization Shuyang Cao Lu Wang CVBM 19 11 0 06 Apr 2021
Rethinking Perturbations in Encoder-Decoders for Fast Training Sho Takase Shun Kiyono 8 45 0 05 Apr 2021
A New Approach to Overgenerating and Scoring Abstractive Summaries Kaiqiang Song Bingqing Wang Z. Feng Fei Liu 14 17 0 05 Apr 2021
Inference Time Style Control for Summarization Shuyang Cao Lu Wang AI4TS 14 15 0 05 Apr 2021
A Pseudo-Metric between Probability Distributions based on Depth-Trimmed Regions Guillaume Staerman Pavlo Mozharovskyi Pierre Colombo Stéphan Clémenccon Florence dÁlché-Buc OOD 59 17 0 23 Mar 2021
AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarization Tiezheng Yu Zihan Liu Pascale Fung CLL 38 81 0 21 Mar 2021
Play the Shannon Game With Language Models: A Human-Free Approach to Summary Evaluation Nicholas Egan Oleg V. Vasilyev John Bohannon HILM 13 18 0 19 Mar 2021
GPT Understands, Too Xiao Liu Yanan Zheng Zhengxiao Du Ming Ding Yujie Qian Zhilin Yang Jie Tang VLM 34 1,143 0 18 Mar 2021
GLM: General Language Model Pretraining with Autoregressive Blank Infilling Zhengxiao Du Yujie Qian Xiao Liu Ming Ding J. Qiu Zhilin Yang Jie Tang BDL AI4CE 8 1,477 0 18 Mar 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 30 18 0 18 Mar 2021
Quinductor: a multilingual data-driven method for generating reading-comprehension questions using Universal Dependencies Dmytro Kalpakchi Johan Boye 8 6 0 18 Mar 2021
How Many Data Points is a Prompt Worth? Teven Le Scao Alexander M. Rush VLM 32 295 0 15 Mar 2021
Constrained Text Generation with Global Guidance -- Case Study on CommonGen Yixian Liu Liwen Zhang Wenjuan Han Yue Zhang Kewei Tu 23 9 0 12 Mar 2021
MediaSum: A Large-scale Media Interview Dataset for Dialogue Summarization Chenguang Zhu Yang Liu Jie Mei Michael Zeng 17 133 0 11 Mar 2021
CrossMap Transformer: A Crossmodal Masked Path Transformer Using Double Back-Translation for Vision-and-Language Navigation A. Magassouba K. Sugiura Hisashi Kawai 46 10 0 01 Mar 2021
M6: A Chinese Multimodal Pretrainer Junyang Lin Rui Men An Yang Chan Zhou Ming Ding ... Yong Li Wei Lin Jingren Zhou J. Tang Hongxia Yang VLM MoE 26 132 0 01 Mar 2021
Generating Human Readable Transcript for Automatic Speech Recognition with Pre-trained Language Model Junwei Liao Yu Shi Ming Gong Linjun Shou Sefik Emre Eskimez Liyang Lu Hong Qu Michael Zeng 9 9 0 22 Feb 2021
VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioning Jun Chen Han Guo Kai Yi Boyang Albert Li Mohamed Elhoseiny VLM 24 218 0 20 Feb 2021
Quiz-Style Question Generation for News Stories Á. Lelkes Vinh Q. Tran Cong Yu 35 33 0 18 Feb 2021