Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019

Xiaodong Liu

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 846 papers shown

Title
BiasAsker: Measuring the Bias in Conversational AI System Yuxuan Wan Wenxuan Wang Pinjia He Jiazhen Gu Haonan Bai Michael Lyu 14 67 0 21 May 2023
The Web Can Be Your Oyster for Improving Large Language Models Junyi Li Tianyi Tang Wayne Xin Zhao Jingyuan Wang Jian-Yun Nie Ji-Rong Wen RALM KELM 12 5 0 18 May 2023
Counterfactual Debiasing for Generating Factually Consistent Text Summaries Chenhe Dong Yuexiang Xie Yaliang Li Ying Shen CML HILM 15 0 0 18 May 2023
ChatGPT Perpetuates Gender Bias in Machine Translation and Ignores Non-Gendered Pronouns: Findings across Bengali and Five other Low-Resource Languages Sourojit Ghosh Aylin Caliskan 20 69 0 17 May 2023
UniEX: An Effective and Efficient Framework for Unified Information Extraction via a Span-extractive Perspective Ping Yang Junyu Lu Ruyi Gan Junjie Wang Yuxiang Zhang Jiaxing Zhang Pingjian Zhang 11 11 0 17 May 2023
Large Language Models Leverage External Knowledge to Extend Clinical Insight Beyond Language Boundaries Jiageng Wu X. Wu Zhaopeng Qiu Minghui Li Yingying Zhang Yefeng Zheng Changzheng Yuan Jie Yang LM&MA ELM AI4MH 19 16 0 17 May 2023
NLG Evaluation Metrics Beyond Correlation Analysis: An Empirical Metric Preference Checklist Iftitahu Ni'mah Meng Fang Vlado Menkovski Mykola Pechenizkiy 25 12 0 15 May 2023
Make Prompt-based Black-Box Tuning Colorful: Boosting Model Generalization from Three Orthogonal Perspectives Qiushi Sun Chengcheng Han Nuo Chen Renyu Zhu Jing Gong Xiang Li Ming Gao VLM 22 8 0 14 May 2023
CodeT5+: Open Code Large Language Models for Code Understanding and Generation Yue Wang Hung Le Akhilesh Deepak Gotmare Nghi D. Q. Bui Junnan Li Steven C. H. Hoi ALM 19 460 0 13 May 2023
PROM: A Phrase-level Copying Mechanism with Pre-training for Abstractive Summarization Xinbei Ma Yeyun Gong Pengcheng He Hai Zhao Nan Duan 28 2 0 11 May 2023
CADGE: Context-Aware Dialogue Generation Enhanced with Graph-Structured Knowledge Aggregation Hongbo Zhang Chen Tang Tyler Loakman Chenghua Lin Stefan Goetze 42 9 0 10 May 2023
Code Execution with Pre-trained Language Models Chenxiao Liu Shuai Lu Weizhu Chen Daxin Jiang Alexey Svyatkovskiy Shengyu Fu Neel Sundaresan Nan Duan ELM 20 21 0 08 May 2023
Non-Autoregressive Math Word Problem Solver with Unified Tree Structure Yi Bin Meng Han Wenhao Shi Lei Wang Yang Yang See-Kiong Ng Heng Tao Shen AIMat 19 7 0 08 May 2023
From Statistical Methods to Deep Learning, Automatic Keyphrase Prediction: A Survey Binbin Xie Jianwei Song Liangying Shao Suhang Wu Xiangpeng Wei Baosong Yang Huan Lin Jun Xie Jinsong Su 35 23 0 04 May 2023
Task-Optimized Adapters for an End-to-End Task-Oriented Dialogue System Namo Bang Jeehyun Lee M. Koo 165 36 0 04 May 2023
ChatGPT vs State-of-the-Art Models: A Benchmarking Study in Keyphrase Generation Task Roberto Martínez-Cruz Alvaro J. López-López J. Portela 29 18 0 27 Apr 2023
PUNR: Pre-training with User Behavior Modeling for News Recommendation Guangyuan Ma Hongtao Liu Xing Wu Wanhui Qian Zhepeng Lv Q. Yang Songlin Hu SSL 11 2 0 25 Apr 2023
TCR: Short Video Title Generation and Cover Selection with Attention Refinement Yu Jiuding Yang Weidong Guo Hui Liu Yu-Syuan Xu Di Niu 25 3 0 25 Apr 2023
Towards Better Instruction Following Language Models for Chinese: Investigating the Impact of Training Data and Evaluation Yunjie Ji Yan Gong Yong Deng Yiping Peng Qiang Niu Baochang Ma Xiangang Li ALM ELM 22 22 0 16 Apr 2023
SikuGPT: A Generative Pre-trained Model for Intelligent Information Processing of Ancient Texts from the Perspective of Digital Humanities Chang Liu Dongbo Wang Zhixiao Zhao Die Hu Mengcheng Wu ... Si Shen Bin Li Jiangfeng Liu Hai Zhang Lianzheng Zhao 12 9 0 16 Apr 2023
Context-aware Coherent Speaking Style Prediction with Hierarchical Transformers for Audiobook Speech Synthesis Shunwei Lei Yixuan Zhou Liyang Chen Zhiyong Wu Shiyin Kang H. Meng 19 6 0 13 Apr 2023
WebBrain: Learning to Generate Factually Correct Articles for Queries by Grounding on Large Web Corpus Hongjing Qian Yutao Zhu Zhicheng Dou Haoqi Gu Xinyu Zhang Zheng Liu Ruofei Lai Zhao Cao J. Nie Ji-Rong Wen 28 25 0 10 Apr 2023
Filling out the missing gaps: Time Series Imputation with Semi-Supervised Learning Karan Aggarwal Jaideep Srivastava AI4TS 11 0 0 09 Apr 2023
Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder Z. Fu W. Lam Qian Yu Anthony Man-Cho So Shengding Hu Zhiyuan Liu Nigel Collier AuLLM 23 41 0 08 Apr 2023
PK-Chat: Pointer Network Guided Knowledge Driven Generative Dialogue Model Cheng Deng Bo Tong Luoyi Fu Jiaxin Ding Dexing Cao Xinbing Wang Chenghu Zhou 14 3 0 02 Apr 2023
Self-Supervised Multimodal Learning: A Survey Yongshuo Zong Oisin Mac Aodha Timothy M. Hospedales SSL 19 43 0 31 Mar 2023
Zero-Shot Generalizable End-to-End Task-Oriented Dialog System using Context Summarization and Domain Schema A. Mosharrof M. H. Maqbool A. B. Siddique VLM 19 4 0 28 Mar 2023
Unmasked Teacher: Towards Training-Efficient Video Foundation Models Kunchang Li Yali Wang Yizhuo Li Yi Wang Yinan He Limin Wang Yu Qiao VGen 30 154 0 28 Mar 2023
One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarization Deze Wang Boxing Chen Shanshan Li Wei Luo Shaoliang Peng Wei Dong Xiang-ke Liao 21 37 0 28 Mar 2023
KPEval: Towards Fine-Grained Semantic-Based Keyphrase Evaluation Di Wu Da Yin Kai-Wei Chang 29 1 0 27 Mar 2023
Continuous Intermediate Token Learning with Implicit Motion Manifold for Keyframe Based Motion Interpolation Clinton Mo Kun Hu Chengjiang Long Zhiyong Wang 13 11 0 27 Mar 2023
Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use Cases Yunjie Ji Yong Deng Yan Gong Yiping Peng Qiang Niu L. Zhang Baochang Ma Xiangang Li ALM 19 93 0 26 Mar 2023
Automatic Generation of Multiple-Choice Questions Cheng Zhang 14 6 0 25 Mar 2023
Neuro-Symbolic Execution of Generic Source Code Yaojie Hu Jin Tian NAI 17 0 0 23 Mar 2023
CoBIT: A Contrastive Bi-directional Image-Text Generation Model Haoxuan You Mandy Guo Zhecan Wang Kai-Wei Chang Jason Baldridge Jiahui Yu DiffM 37 12 0 23 Mar 2023
Learning for Amalgamation: A Multi-Source Transfer Learning Framework For Sentiment Classification Cuong V. Nguyen Khiem H. Le Anh Tran Quang-Cuong Pham Binh T. Nguyen 6 14 0 16 Mar 2023
Exploring ChatGPT's Ability to Rank Content: A Preliminary Study on Consistency with Human Preferences Yunjie Ji Yan Gong Yiping Peng Chao Ni Peiyan Sun Dongyu Pan Baochang Ma Xiangang Li ELM ALM AI4MH 17 37 0 14 Mar 2023
AMOM: Adaptive Masking over Masking for Conditional Masked Language Model Yisheng Xiao Ruiyang Xu Lijun Wu Juntao Li Tao Qin Yan-Tie Liu M. Zhang 11 9 0 13 Mar 2023
Generating Query Focused Summaries without Fine-tuning the Transformer-based Pre-trained Models D. Abdullah Shamanth Nayak Gandharv Suri Yllias Chali 22 2 0 10 Mar 2023
Rethinking Visual Prompt Learning as Masked Visual Token Modeling Ning Liao Bowen Shi Xiaopeng Zhang Min Cao Junchi Yan Qi Tian VLM 21 7 0 09 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT Yihan Cao Siyu Li Yixin Liu Zhiling Yan Yutong Dai Philip S. Yu Lichao Sun 24 501 0 07 Mar 2023
GLM-Dialog: Noise-tolerant Pre-training for Knowledge-grounded Dialogue Generation Jing Zhang Xiaokang Zhang Daniel Zhang-Li Jifan Yu Zijun Yao ... Xiaohan Zhang Nianyi Lin Sunrui Lu Juan Li Jie Tang 14 19 0 28 Feb 2023
Topic-Selective Graph Network for Topic-Focused Summarization Shi Zesheng Yucheng Zhou 25 2 0 25 Feb 2023
Vision-Language Generative Model for View-Specific Chest X-ray Generation HyunGyung Lee Dayun Lee Wonjae Kim Jin-Hwa Kim Tackeun Kim Jihang Kim Leonard Sunwoo E. Choi LM&MA MedIm 19 7 0 23 Feb 2023
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey Xiao Wang Guangyao Chen Guangwu Qian Pengcheng Gao Xiaoyong Wei Yaowei Wang Yonghong Tian Wen Gao AI4CE VLM 24 199 0 20 Feb 2023
GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks Zemin Liu Xingtong Yu Yuan Fang Xinming Zhang LLMAG AI4CE 19 134 0 16 Feb 2023
Leveraging Summary Guidance on Medical Report Summarization Yunqi Zhu Xuebing Yang Yuanyuan Wu Wensheng Zhang 13 9 0 08 Feb 2023
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video Haiyang Xu Qinghao Ye Mingshi Yan Yaya Shi Jiabo Ye ... Guohai Xu Ji Zhang Songfang Huang Feiran Huang Jingren Zhou MLLM VLM MoE 23 158 0 01 Feb 2023
Benchmarking Large Language Models for News Summarization Tianyi Zhang Faisal Ladhak Esin Durmus Percy Liang Kathleen McKeown Tatsunori B. Hashimoto ELM 11 474 0 31 Jan 2023
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models Junnan Li Dongxu Li Silvio Savarese Steven C. H. Hoi VLM MLLM 259 4,223 0 30 Jan 2023