Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019

Xiaodong Liu

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 846 papers shown

Title
TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World Hongpeng Lin Ludan Ruan Wenke Xia Peiyu Liu Jing Wen ... Di Hu Ruihua Song Wayne Xin Zhao Qin Jin Zhiwu Lu VGen 22 9 0 14 Jan 2023
Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling Keyu Tian Yi-Xin Jiang Qishuai Diao Chen Lin Liwei Wang Zehuan Yuan 20 98 0 09 Jan 2023
Universal Information Extraction as Unified Semantic Matching Jie Lou Yaojie Lu Dai Dai Wei Jia Hongyu Lin Xianpei Han Le Sun Hua-Hong Wu 25 69 0 09 Jan 2023
A comprehensive review of automatic text summarization techniques: method, data, evaluation and coding D. Cajueiro A. G. Nery Igor Tavares Maísa Kely de Melo Silvia A. dos Reis Weigang Li V. R. R. Celestino 17 15 0 04 Jan 2023
Inflected Forms Are Redundant in Question Generation Models Xingwu Sun Hongyin Tang Chengzhong Xu 23 1 0 01 Jan 2023
Discovering Customer-Service Dialog System with Semi-Supervised Learning and Coarse-to-Fine Intent Detection Zhitong Yang Xing Ma Anqi Liu Zheyu Zhang 13 1 0 23 Dec 2022
Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study Di Wu Wasi Uddin Ahmad Kai-Wei Chang 16 17 0 20 Dec 2022
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator Jian Yang Shuming Ma Li Dong Shaohan Huang Haoyang Huang Yuwei Yin Dongdong Zhang Liqun Yang Furu Wei Zhoujun Li SyDa AI4CE 27 25 0 20 Dec 2022
Pay Attention to Your Tone: Introducing a New Dataset for Polite Language Rewrite Xun Wang Tao Ge Allen Mao Yuki Li Furu Wei Si-Qing Chen 40 4 0 20 Dec 2022
Large Language Models Are Reasoning Teachers Namgyu Ho Laura Schmid Se-Young Yun ReLM ELM LRM 6 314 0 20 Dec 2022
DIONYSUS: A Pre-trained Model for Low-Resource Dialogue Summarization Yu Li Baolin Peng Pengcheng He Michel Galley Zhou Yu Jianfeng Gao 8 7 0 20 Dec 2022
DuNST: Dual Noisy Self Training for Semi-Supervised Controllable Text Generation Yuxi Feng Xiaoyuan Yi Xiting Wang L. Lakshmanan Xing Xie DiffM 22 5 0 16 Dec 2022
Convolution-enhanced Evolving Attention Networks Yujing Wang Yaming Yang Zhuowan Li Jiangang Bai Mingliang Zhang Xiangtai Li J. Yu Ce Zhang Gao Huang Yu Tong ViT 16 5 0 16 Dec 2022
Saved You A Click: Automatically Answering Clickbait Titles Andrey Kurenkov TA Mentor Yian Zhang O. Johnson 14 5 0 15 Dec 2022
Revisiting the Gold Standard: Grounding Summarization Evaluation with Robust Human Evaluation Yixin Liu Alexander R. Fabbri Pengfei Liu Yilun Zhao Linyong Nan ... Simeng Han Shafiq R. Joty Chien-Sheng Wu Caiming Xiong Dragomir R. Radev ALM 10 132 0 15 Dec 2022
APOLLO: An Optimized Training Approach for Long-form Numerical Reasoning Jiashuo Sun Hang Zhang Chen Lin Nan Duan Yeyun Gong Jian Guo AIMat RALM 21 6 0 14 Dec 2022
TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities Zhe Zhao Yudong Li Cheng-An Hou Jing-xin Zhao Rong Tian ... Xingwu Sun Zhanhui Kang Xiaoyong Du Linlin Shen Kimmo Yan VLM 29 23 0 13 Dec 2022
T5Score: Discriminative Fine-tuning of Generative Evaluation Metrics Yiwei Qin Weizhe Yuan Graham Neubig Pengfei Liu 13 23 0 12 Dec 2022
Towards Diverse, Relevant and Coherent Open-Domain Dialogue Generation via Hybrid Latent Variables Bin Sun Yitong Li Fei Mi Weichao Wang Yiwei Li Kan Li BDL 25 5 0 02 Dec 2022
Language Model Pre-training on True Negatives Zhuosheng Zhang Hai Zhao Masao Utiyama Eiichiro Sumita 22 2 0 01 Dec 2022
On the Effectiveness of Parameter-Efficient Fine-Tuning Z. Fu Haoran Yang Anthony Man-Cho So Wai Lam Lidong Bing Nigel Collier 12 154 0 28 Nov 2022
Automatically generating question-answer pairs for assessing basic reading comprehension in Swedish Dmytro Kalpakchi Johan Boye 13 1 0 28 Nov 2022
Alignment-Enriched Tuning for Patch-Level Pre-trained Document Image Models Lei Wang Jian He Xingdong Xu Ning Liu Hui-juan Liu 27 2 0 27 Nov 2022
TSGP: Two-Stage Generative Prompting for Unsupervised Commonsense Question Answering Yueqing Sun Yu Zhang Le Qi Qi Shi ReLM RALM LRM 11 5 0 24 Nov 2022
Unified Multimodal Model with Unlikelihood Training for Visual Dialog Zihao Wang Junli Wang Changjun Jiang MLLM 21 10 0 23 Nov 2022
X $^2$ -VLM: All-In-One Pre-trained Model For Vision-Language Tasks Yan Zeng Xinsong Zhang Hang Li Jiawei Wang Jipeng Zhang Hkust Wangchunshu Zhou VLM MLLM 21 14 0 22 Nov 2022
Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention Zineng Tang Jaemin Cho Jie Lei Mohit Bansal VLM 16 9 0 21 Nov 2022
In-sample Curriculum Learning by Sequence Completion for Natural Language Generation Qi Jia Yizhu Liu Haifeng Tang Kenny Q. Zhu ELM SyDa LRM 11 4 0 21 Nov 2022
Combining State-of-the-Art Models with Maximal Marginal Relevance for Few-Shot and Zero-Shot Multi-Document Summarization David Adams Gandharv Suri Yllias Chali VLM 14 3 0 19 Nov 2022
CAE v2: Context Autoencoder with CLIP Target Xinyu Zhang Jiahui Chen Junkun Yuan Qiang Chen Jian Wang ... Jimin Pi Kun Yao Junyu Han Errui Ding Jingdong Wang VLM CLIP 34 24 0 17 Nov 2022
PromptCap: Prompt-Guided Task-Aware Image Captioning Yushi Hu Hang Hua Zhengyuan Yang Weijia Shi Noah A. Smith Jiebo Luo 28 101 0 15 Nov 2022
Improving Factual Consistency in Summarization with Compression-Based Post-Editing Alexander R. Fabbri Prafulla Kumar Choubey Jesse Vig Chien-Sheng Wu Caiming Xiong HILM KELM 42 17 0 11 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 17 121 0 11 Nov 2022
PLATO-K: Internal and External Knowledge Enhanced Dialogue Generation Siqi Bao H. He Jun Xu Hua Lu Fan Wang Hua-Hong Wu Han Zhou Wenquan Wu Zheng-Yu Niu Haifeng Wang 19 4 0 02 Nov 2022
FRSUM: Towards Faithful Abstractive Summarization via Enhancing Factual Robustness Wenhao Wu Wei Li Jiachen Liu Xinyan Xiao Ziqiang Cao Sujian Li Hua-Hong Wu HILM 19 10 0 01 Nov 2022
DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention Fenglin Liu Xian Wu Shen Ge Xuancheng Ren Wei Fan Xu Sun Yuexian Zou VLM 73 12 0 28 Oct 2022
Assessing Phrase Break of ESL speech with Pre-trained Language Models Zhiyi Wang Shaoguang Mao Wenshan Wu Yan Xia 23 0 0 28 Oct 2022
What Language Model to Train if You Have One Million GPU Hours? Teven Le Scao Thomas Wang Daniel Hesslow Lucile Saulnier Stas Bekman ... Lintang Sutawika Jaesung Tae Zheng-Xin Yong Julien Launay Iz Beltagy MoE AI4CE 225 103 0 27 Oct 2022
$N$ -gram Is Back: Residual Learning of Neural Text Generation with $n$ -gram Language Model Huayang Li Deng Cai J. Xu Taro Watanabe VLM 16 1 0 26 Oct 2022
Universal Evasion Attacks on Summarization Scoring Wenchuan Mu Kwan Hui Lim AAML 19 1 0 25 Oct 2022
Towards Better Few-Shot and Finetuning Performance with Forgetful Causal Language Models Hao Liu Xinyang Geng Lisa Lee Igor Mordatch Sergey Levine Sharan Narang Pieter Abbeel KELM CLL 25 2 0 24 Oct 2022
Discriminative Language Model as Semantic Consistency Scorer for Prompt-based Few-Shot Text Classification Zhipeng Xie Yahe Li 19 0 0 23 Oct 2022
Structure-Unified M-Tree Coding Solver for MathWord Problem Bin Wang Jiangzhou Ju Yang-Wen Fan Xinyu Dai Shujian Huang Jiajun Chen AIMat 37 7 0 22 Oct 2022
ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples Yilun Zhao Linyong Nan Zhenting Qi Rui Zhang Dragomir R. Radev ReLM LMTD LRM 44 36 0 22 Oct 2022
P $^3$ LM: Probabilistically Permuted Prophet Language Modeling for Generative Pre-Training Junwei Bao Yifan Wang Jiangyong Ying Yeyun Gong Jing Zhao Youzheng Wu Xiaodong He 30 1 0 22 Oct 2022
Metric-guided Distillation: Distilling Knowledge from the Metric to Ranker and Retriever for Generative Commonsense Reasoning Xingwei He Yeyun Gong Alex Jin Weizhen Qi Hang Zhang Jian Jiao Bartuer Zhou Biao Cheng Sm Yiu Nan Duan 28 11 0 21 Oct 2022
A Unified View of Masked Image Modeling Zhiliang Peng Li Dong Hangbo Bao QiXiang Ye Furu Wei VLM 52 35 0 19 Oct 2022
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning Hongqiu Wu Ruixue Ding Haizhen Zhao Boli Chen Pengjun Xie Fei Huang Min Zhang MoMe 12 8 0 19 Oct 2022
Soft-Labeled Contrastive Pre-training for Function-level Code Representation Xiaonan Li Daya Guo Yeyun Gong Yun Lin Yelong Shen Xipeng Qiu Daxin Jiang Weizhu Chen Nan Duan 16 17 0 18 Oct 2022
Mars: Modeling Context & State Representations with Contrastive Learning for End-to-End Task-Oriented Dialog Haipeng Sun Junwei Bao Youzheng Wu Xiaodong He 16 10 0 17 Oct 2022