Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019

Xiaodong Liu

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 847 papers shown

Title
General Facial Representation Learning in a Visual-Linguistic Manner Yinglin Zheng Hao Yang Ting Zhang Jianmin Bao Dongdong Chen Yangyu Huang Lu Yuan Dong Chen Ming Zeng Fang Wen CVBM 135 163 0 06 Dec 2021
InfoLM: A New Metric to Evaluate Summarization & Data2Text Generation Pierre Colombo Chloe Clave Pablo Piantanida 32 41 0 02 Dec 2021
LOGEN: Few-shot Logical Knowledge-Conditioned Text Generation with Self-training Shumin Deng Jiacheng Yang Hongbin Ye Chuanqi Tan Mosha Chen Songfang Huang Fei Huang Huajun Chen Ningyu Zhang 25 7 0 02 Dec 2021
Improving Controllability of Educational Question Generation by Keyword Provision Ying-Hong Chan Ho-Lam Chung Yao-Chung Fan 19 3 0 02 Dec 2021
GALAXY: A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection Wanwei He Yinpei Dai Yinhe Zheng Yuchuan Wu Zhen Cao ... Min Yang Feiling Huang Luo Si Jian Sun Yongbin Li VLM 21 155 0 29 Nov 2021
Action based Network for Conversation Question Reformulation Zheyu Ye Jiang Liu Qian Yu Jianxun Ju 12 0 0 29 Nov 2021
PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformers Xiaoyi Dong Jianmin Bao Ting Zhang Dongdong Chen Weiming Zhang Lu Yuan Dong Chen Fang Wen Nenghai Yu Baining Guo ViT 33 238 0 24 Nov 2021
A Contextual Latent Space Model: Subsequence Modulation in Melodic Sequence Taketo Akama BDL 22 3 0 23 Nov 2021
Towards Efficiently Evaluating the Robustness of Deep Neural Networks in IoT Systems: A GAN-based Method Tao Bai Jun Zhao Jinlin Zhu Shoudong Han Jiefeng Chen Bo-wen Li Alex C. Kot AAML 16 4 0 19 Nov 2021
UFO: A UniFied TransfOrmer for Vision-Language Representation Learning Jianfeng Wang Xiaowei Hu Zhe Gan Zhengyuan Yang Xiyang Dai Zicheng Liu Yumao Lu Lijuan Wang ViT 27 57 0 19 Nov 2021
Calculating Question Similarity is Enough: A New Method for KBQA Tasks Hanyu Zhao Shaoqing Yuan Jiahong Leng X. Pan Guoqiang Wang Ledell Wu Jie Tang 12 0 0 15 Nov 2021
Question Answering for Complex Electronic Health Records Database using Unified Encoder-Decoder Architecture Seongsu Bae Daeyoung Kim Jiho Kim E. Choi 6 6 0 14 Nov 2021
A Survey on Green Deep Learning Jingjing Xu Wangchunshu Zhou Zhiyi Fu Hao Zhou Lei Li VLM 71 83 0 08 Nov 2021
Dialogue Inspectional Summarization with Factual Inconsistency Awareness Leilei Gan Yating Zhang Kun Kuang Lin Yuan Shuo Li Changlong Sun Xiaozhong Liu Fei Wu HILM 17 4 0 05 Nov 2021
VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts Hangbo Bao Wenhui Wang Li Dong Qiang Liu Owais Khan Mohammed Kriti Aggarwal Subhojit Som Furu Wei VLM MLLM MoE 20 529 0 03 Nov 2021
Switch Point biased Self-Training: Re-purposing Pretrained Models for Code-Switching P. Chopra Sai Krishna Rallabandi A. Black Khyathi Raghavi Chandu 10 6 0 01 Nov 2021
Amendable Generation for Dialogue State Tracking Xin Tian Liankai Huang Yingzhan Lin Siqi Bao H. He Yunyi Yang Hua-Hong Wu Fan Wang Shuqi Sun 20 35 0 29 Oct 2021
s2s-ft: Fine-Tuning Pretrained Transformer Encoders for Sequence-to-Sequence Learning Hangbo Bao Li Dong Wenhui Wang Nan Yang Furu Wei 11 11 0 26 Oct 2021
Improving Non-autoregressive Generation with Mixup Training Ting Jiang Shaohan Huang Zihan Zhang Deqing Wang Fuzhen Zhuang Furu Wei Haizhen Huang Liangjie Zhang Qi Zhang 8 8 0 21 Oct 2021
Interpreting Deep Learning Models in Natural Language Processing: A Review Xiaofei Sun Diyi Yang Xiaoya Li Tianwei Zhang Yuxian Meng Han Qiu Guoyin Wang Eduard H. Hovy Jiwei Li 17 44 0 20 Oct 2021
How Well Do You Know Your Audience? Toward Socially-aware Question Generation Ian Stewart Rada Mihalcea 17 2 0 16 Oct 2021
EncT5: A Framework for Fine-tuning T5 as Non-autoregressive Models Frederick Liu T. Huang Shihang Lyu Siamak Shakeri Hongkun Yu Jing Li 31 8 0 16 Oct 2021
MixQG: Neural Question Generation with Mixed Answer Types Lidiya Murakhovs'ka C. Wu Philippe Laban Tong Niu Wenhao Liu Caiming Xiong 8 47 0 15 Oct 2021
Modeling Endorsement for Multi-Document Abstractive Summarization Logan Lebanoff Bingqing Wang Z. Feng Fei Liu 90 4 0 15 Oct 2021
SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing Junyi Ao Rui Wang Long Zhou Chengyi Wang Shuo Ren ... Yu Zhang Zhihua Wei Yao Qian Jinyu Li Furu Wei 110 192 0 14 Oct 2021
CLIP-Adapter: Better Vision-Language Models with Feature Adapters Peng Gao Shijie Geng Renrui Zhang Teli Ma Rongyao Fang Yongfeng Zhang Hongsheng Li Yu Qiao VLM CLIP 60 982 0 09 Oct 2021
I Do Not Understand What I Cannot Define: Automatic Question Generation With Pedagogically-Driven Content Selection Tim Steuer Anna Filighera Tobias Meuser Christoph Rensing 8 10 0 08 Oct 2021
M6-10T: A Sharing-Delinking Paradigm for Efficient Multi-Trillion Parameter Pretraining Junyang Lin An Yang Jinze Bai Chang Zhou Le Jiang ... Jie M. Zhang Yong Li Wei Lin Jingren Zhou Hongxia Yang MoE 84 43 0 08 Oct 2021
Discovering Drug-Target Interaction Knowledge from Biomedical Literature Yutai Hou Yingce Xia Lijun Wu Shufang Xie Yang Fan Jinhua Zhu Wanxiang Che Tao Qin Tie-Yan Liu 11 14 0 27 Sep 2021
Recall and Learn: A Memory-augmented Solver for Math Word Problems Shifeng Huang Jiawei Wang Jiao Xu Da Cao Ming Yang AIMat 16 31 0 27 Sep 2021
The JDDC 2.0 Corpus: A Large-Scale Multimodal Multi-Turn Chinese Dialogue Dataset for E-commerce Customer Service Nan Zhao Haoran Li Youzheng Wu Xiaodong He Bowen Zhou 27 8 0 27 Sep 2021
BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq Models Yi Liu Guoan Zhang Puning Yu Jianlin Su Shengfeng Pan BDL SyDa 18 5 0 26 Sep 2021
Parallel Refinements for Lexically Constrained Text Generation with BART Xingwei He 18 39 0 26 Sep 2021
Small-Bench NLP: Benchmark for small single GPU trained models in Natural Language Processing K. Kanakarajan Bhuvana Kundumani Malaikannan Sankarasubbu ALM MoE 11 5 0 22 Sep 2021
Enriching and Controlling Global Semantics for Text Summarization Thong Nguyen A. Luu Truc Lu Tho Quan 21 34 0 22 Sep 2021
TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models Minghao Li Tengchao Lv Jingye Chen Lei Cui Yijuan Lu D. Florêncio Cha Zhang Zhoujun Li Furu Wei ViT 93 340 0 21 Sep 2021
BARTpho: Pre-trained Sequence-to-Sequence Models for Vietnamese Nguyen Luong Tran Duong Minh Le Dat Quoc Nguyen 19 51 0 20 Sep 2021
PLATO-XL: Exploring the Large-scale Pre-training of Dialogue Generation Siqi Bao H. He Fan Wang Hua-Hong Wu Haifeng Wang ... Xinxian Huang Xin Tian Xinchao Xu Yingzhan Lin Zhengyu Niu VLM ALM 24 60 0 20 Sep 2021
Investigating Crowdsourcing Protocols for Evaluating the Factual Consistency of Summaries Xiangru Tang Alexander R. Fabbri Haoran Li Ziming Mao Griffin Adams Borui Wang Asli Celikyilmaz Yashar Mehdad Dragomir R. Radev HILM 13 19 0 19 Sep 2021
Improving Unsupervised Question Answering via Summarization-Informed Question Generation Chenyang Lyu Lifeng Shang Yvette Graham Jennifer Foster Xin Jiang Qun Liu 21 44 0 16 Sep 2021
Allocating Large Vocabulary Capacity for Cross-lingual Language Model Pre-training Bo Zheng Li Dong Shaohan Huang Saksham Singhal Wanxiang Che Ting Liu Xia Song Furu Wei VLM 13 22 0 15 Sep 2021
KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning Haonan Li Yeyun Gong Jian Jiao Ruofei Zhang Timothy Baldwin Nan Duan OffRL 47 6 0 14 Sep 2021
Exploring Prompt-based Few-shot Learning for Grounded Dialog Generation Chujie Zheng Minlie Huang 51 44 0 14 Sep 2021
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation Yunfan Shao Zhichao Geng Yitao Liu Junqi Dai Hang Yan Fei Yang Li Zhe Hujun Bao Xipeng Qiu MedIm 59 146 0 13 Sep 2021
Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization Junpeng Liu Yanyan Zou Hainan Zhang Hongshen Chen Zhuoye Ding Caixia Yuan Xiaojie Wang 4 64 0 10 Sep 2021
EfficientCLIP: Efficient Cross-Modal Pre-training by Ensemble Confident Learning and Language Modeling Jue Wang Haofan Wang Jincan Deng Weijia Wu Debing Zhang VLM CLIP 57 18 0 10 Sep 2021
CINS: Comprehensive Instruction for Few-shot Learning in Task-oriented Dialog Systems Fei Mi Yitong Li Yasheng Wang Xin Jiang Qun Liu 19 42 0 10 Sep 2021
A Three-Stage Learning Framework for Low-Resource Knowledge-Grounded Dialogue Generation Shilei Liu Xiaofeng Zhao Bochao Li Feiliang Ren Longhui Zhang Shujuan Yin 13 32 0 09 Sep 2021
NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Prediction Yi Sun Yu Zheng Chao Hao Hangping Qiu VLM 25 36 0 08 Sep 2021
Sequence Level Contrastive Learning for Text Summarization Shusheng Xu Xingxing Zhang Yi Wu Furu Wei 8 95 0 08 Sep 2021