Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019

Xiaodong Liu

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 846 papers shown

Title
Using Graph Algorithms to Pretrain Graph Completion Transformers Jonathan Pilault Mikhail Galkin Bahare Fatemi Perouz Taslakian David Vasquez C. Pal 19 0 0 14 Oct 2022
Instance Regularization for Discriminative Language Model Pre-training Zhuosheng Zhang Hai Zhao M. Zhou 6 1 0 11 Oct 2022
Leveraging Key Information Modeling to Improve Less-Data Constrained News Headline Generation via Duality Fine-Tuning Zhuoxuan Jiang Lingfeng Qiao Di Yin Shanshan Feng Bo Ren SyDa 28 2 0 10 Oct 2022
Generative Language Models for Paragraph-Level Question Generation Asahi Ushio Fernando Alva-Manchego Jose Camacho-Collados ELM 11 45 0 08 Oct 2022
SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training Zi-Hua Zhang Long Zhou Junyi Ao Shujie Liu Lirong Dai Jinyu Li Furu Wei 61 57 0 07 Oct 2022
XDoc: Unified Pre-training for Cross-Format Document Understanding Jingye Chen Tengchao Lv Lei Cui Changrong Zhang Furu Wei 48 13 0 06 Oct 2022
Automatic Scene-based Topic Channel Construction System for E-Commerce Peng Lin Yanyan Zou Lingfei Wu Mian Ma Zhuoye Ding Bo Long 12 0 0 06 Oct 2022
GLM-130B: An Open Bilingual Pre-trained Model Aohan Zeng Xiao Liu Zhengxiao Du Zihan Wang Hanyu Lai ... Jidong Zhai Wenguang Chen Peng-Zhen Zhang Yuxiao Dong Jie Tang BDL LRM 245 1,071 0 05 Oct 2022
ContraCLM: Contrastive Learning For Causal Language Model Nihal Jain Dejiao Zhang Wasi Uddin Ahmad Zijian Wang Feng Nan ... Ramesh Nallapati Baishakhi Ray Parminder Bhatia Xiaofei Ma Bing Xiang 15 16 0 03 Oct 2022
SpeechLM: Enhanced Speech Pre-Training with Unpaired Textual Data Zi-Hua Zhang Sanyuan Chen Long Zhou Yu Wu Shuo Ren ... Zhuoyuan Yao Xun Gong Lirong Dai Jinyu Li Furu Wei 25 54 0 30 Sep 2022
TVLT: Textless Vision-Language Transformer Zineng Tang Jaemin Cho Yixin Nie Mohit Bansal VLM 49 28 0 28 Sep 2022
RepsNet: Combining Vision with Language for Automated Medical Reports A. Tanwani Joelle Barral Daniel Freedman MedIm 33 20 0 27 Sep 2022
Multiple-Choice Question Generation: Towards an Automated Assessment Framework Vatsal Raina Mark J. F. Gales AI4Ed ELM 26 32 0 23 Sep 2022
ET5: A Novel End-to-end Framework for Conversational Machine Reading Comprehension Xiao Zhang Heyan Huang Zewen Chi Xian-Ling Mao LRM 33 2 0 23 Sep 2022
Generating Persuasive Responses to Customer Reviews with Multi-Source Prior Knowledge in E-commerce Bo Chen Jiayi Liu M. Maimaiti Xing Gao Ji Zhang 23 3 0 20 Sep 2022
Context-Aware Query Rewriting for Improving Users' Search Experience on E-commerce Websites Simiao Zuo Qingyu Yin Haoming Jiang Shaohui Xi Bing Yin Chao Zhang Tuo Zhao 25 5 0 15 Sep 2022
vec2text with Round-Trip Translations Geoffrey Cideron Sertan Girgin Anton Raichuk Olivier Pietquin Olivier Bachem Léonard Hussenot 35 3 0 14 Sep 2022
SPACE-3: Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation Wanwei He Yinpei Dai Min Yang Jian Sun Fei Huang Luo Si Yongbin Li 15 60 0 14 Sep 2022
CoHS-CQG: Context and History Selection for Conversational Question Generation Do Xuan Long Bowei Zou Liangming Pan Nancy F. Chen Shafiq R. Joty A. Aw SLR 29 10 0 14 Sep 2022
Evaluation of Question Answering Systems: Complexity of judging a natural language Amer Farea Zhen Yang Kien Duong Nadeesha Perera F. Emmert-Streib ELM 21 3 0 10 Sep 2022
Enhancing Pre-trained Models with Text Structure Knowledge for Question Generation Zichen Wu Xin Jia Fanyi Qu Yunfang Wu 21 4 0 09 Sep 2022
Mind the Gap! Injecting Commonsense Knowledge for Abstractive Dialogue Summarization Seungone Kim Se June Joo Hyungjoo Chae Chaehyeong Kim Seung-won Hwang Jinyoung Yeo 13 20 0 02 Sep 2022
Unified Knowledge Prompt Pre-training for Customer Service Dialogues Keqing He Jingang Wang Chaobo Sun Wei Yu Wu 15 4 0 31 Aug 2022
Towards Boosting the Open-Domain Chatbot with Human Feedback Hua Lu Siqi Bao H. He Fan Wang Hua-Hong Wu Haifeng Wang ALM 13 18 0 30 Aug 2022
MATra: A Multilingual Attentive Transliteration System for Indian Scripts Yash Raj Bhavesh Laddagiri 10 4 0 23 Aug 2022
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks Wenhui Wang Hangbo Bao Li Dong Johan Bjorck Zhiliang Peng ... Kriti Aggarwal O. Mohammed Saksham Singhal Subhojit Som Furu Wei MLLM VLM ViT 16 628 0 22 Aug 2022
PANDA: Prompt Transfer Meets Knowledge Distillation for Efficient Model Adaptation Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao VLM CLL 24 41 0 22 Aug 2022
Adapting Task-Oriented Dialogue Models for Email Conversations Soham Deshmukh Charles Lee 22 1 0 19 Aug 2022
Efficient Task-Oriented Dialogue Systems with Response Selection as an Auxiliary Task Radostin Cholakov T. Kolev 4 8 0 15 Aug 2022
BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers Zhiliang Peng Li Dong Hangbo Bao QiXiang Ye Furu Wei 16 303 0 12 Aug 2022
A Comprehensive Survey of Natural Language Generation Advances from the Perspective of Digital Deception Keenan I. Jones Enes ALTUNCU V. N. Franqueira Yi-Chia Wang Shujun Li DeLMO 26 3 0 11 Aug 2022
DeepGen: Diverse Search Ad Generation and Real-Time Customization Konstantin Golobokov Junyi Chai Victor Ye Dong Mandy Gu Bingyu Chi Jie Cao Yulan Yan Yi Liu 15 7 0 06 Aug 2022
Low-Resource Dense Retrieval for Open-Domain Question Answering: A Comprehensive Survey Xiaoyu Shen Svitlana Vakulenko Marco Del Tredici Gianni Barlacchi Bill Byrne Adria de Gispert RALM VLM 21 20 0 05 Aug 2022
Fusing Sentence Embeddings Into LSTM-based Autoregressive Language Models Vilém Zouhar Marius Mosbach Dietrich Klakow 12 1 0 04 Aug 2022
AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model Saleh Soltan Shankar Ananthakrishnan Jack G. M. FitzGerald Rahul Gupta Wael Hamza ... Mukund Sridhar Fabian Triefenbach Apurv Verma Gökhan Tür Premkumar Natarajan 34 82 0 02 Aug 2022
Neural Knowledge Bank for Pretrained Transformers Damai Dai Wen-Jie Jiang Qingxiu Dong Yajuan Lyu Qiaoqiao She Zhifang Sui KELM 13 21 0 31 Jul 2022
MAR: Masked Autoencoders for Efficient Action Recognition Zhiwu Qing Shiwei Zhang Ziyuan Huang Xiang Wang Yuehuang Wang Yiliang Lv Changxin Gao Nong Sang 19 42 0 24 Jul 2022
PanGu-Coder: Program Synthesis with Function-Level Language Modeling Fenia Christopoulou Gerasimos Lampouras Milan Gritta Guchun Zhang Yinpeng Guo ... Guangtai Liang Jia Wei Xin Jiang Qianxiang Wang Qun Liu ELM SyDa ALM 27 74 0 22 Jul 2022
Automatic Context Pattern Generation for Entity Set Expansion Yinghui Li Shulin Huang Xinwei Zhang Qingyu Zhou Y. Li Ruiyang Liu Yunbo Cao Haitao Zheng Ying Shen 20 18 0 17 Jul 2022
GMN: Generative Multi-modal Network for Practical Document Information Extraction H. Cao Jiefeng Ma Antai Guo Yiqing Hu Hao Liu Deqiang Jiang Yinsong Liu Bo Ren 10 8 0 11 Jul 2022
GUIM -- General User and Item Embedding with Mixture of Representation in E-commerce Chao Yang Ru He Fangquan Lin Suoyuan Song Jingqiao Zhang Cheng Yang 6 0 0 02 Jul 2022
Can Language Models Make Fun? A Case Study in Chinese Comical Crosstalk Benyou Wang Xiang Wu Xiaokang Liu Jianquan Li Prayag Tiwari Qianqian Xie 31 6 0 02 Jul 2022
Joint Generator-Ranker Learning for Natural Language Generation Weizhou Shen Yeyun Gong Yelong Shen Song Wang Xiaojun Quan Nan Duan Weizhu Chen 20 5 0 28 Jun 2022
Materials Transformers Language Models for Generative Materials Design: a benchmark study Nihang Fu Lai Wei Yuqi Song Qinyang Li Rui Xin Sadman Sadeed Omee Rongzhi Dong Edirisuriya M Dilanga Siriwardane Jianjun Hu 6 3 0 27 Jun 2022
MVP: Multi-task Supervised Pre-training for Natural Language Generation Tianyi Tang Junyi Li Wayne Xin Zhao Ji-Rong Wen 35 24 0 24 Jun 2022
Unified BERT for Few-shot Natural Language Understanding Junyu Lu Ping Yang Ruyi Gan Jing Yang Jiaxing Zhang 11 2 0 24 Jun 2022
Automatic Controllable Product Copywriting for E-Commerce Xiaojie Guo Qingkai Zeng Meng-Long Jiang Yun Xiao Bo Long Lingfei Wu 13 10 0 21 Jun 2022
A Numerical Reasoning Question Answering System with Fine-grained Retriever and the Ensemble of Multiple Generators for FinQA Bin Wang Jiangzhou Ju Yunlin Mao Xinyu Dai Shujian Huang Jiajun Chen AIMat 25 3 0 17 Jun 2022
Write and Paint: Generative Vision-Language Models are Unified Modal Learners Shizhe Diao Wangchunshu Zhou Xinsong Zhang Jiawei Wang MLLM AI4CE 14 15 0 15 Jun 2022
Language Models are General-Purpose Interfaces Y. Hao Haoyu Song Li Dong Shaohan Huang Zewen Chi Wenhui Wang Shuming Ma Furu Wei MLLM 19 95 0 13 Jun 2022