Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019

Xiaodong Liu

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 845 papers shown

Title
SPECTRUM: Speaker-Enhanced Pre-Training for Long Dialogue Summarization Sangwoo Cho Kaiqiang Song Chao Zhao Xiaoyang Wang Dong Yu 15 0 0 31 Jan 2024
TA&AT: Enhancing Task-Oriented Dialog with Turn-Level Auxiliary Tasks and Action-Tree Based Scheduled Sampling Longxiang Liu Xiuxing Li Yang Feng 11 0 0 28 Jan 2024
GeoDecoder: Empowering Multimodal Map Understanding Feng Qi Mian Dai Zixian Zheng Chao Wang 20 1 0 26 Jan 2024
TURNA: A Turkish Encoder-Decoder Language Model for Enhanced Understanding and Generation Gokcce Uludougan Zeynep Yirmibecsouglu Balal Furkan Akkurt Melikcsah Turker Onur Gungor S. Uskudarli 15 12 0 25 Jan 2024
SpacTor-T5: Pre-training T5 Models with Span Corruption and Replaced Token Detection Ke Ye Heinrich Jiang Afshin Rostamizadeh Ayan Chakrabarti Giulia DeSalvo Jean-François Kagy Lazaros Karydas Gui Citovsky Sanjiv Kumar 17 0 0 24 Jan 2024
Enhancing In-context Learning via Linear Probe Calibration Momin Abbas Yi Zhou Parikshit Ram Nathalie Baracaldo Horst Samulowitz Theodoros Salonidis Tianyi Chen 66 9 0 22 Jan 2024
Cheap Learning: Maximising Performance of Language Models for Social Data Science Using Minimal Data Leonardo Castro-Gonzalez Yi-Ling Chung Hannak Rose Kirk John Francis Angus R. Williams Pica Johansson Jonathan Bright 37 1 0 22 Jan 2024
Developing ChatGPT for Biology and Medicine: A Complete Review of Biomedical Question Answering Qing Li Lei Li Yu Li LM&MA AI4MH 28 6 0 15 Jan 2024
xTrimoPGLM: Unified 100B-Scale Pre-trained Transformer for Deciphering the Language of Protein Bo Chen Xingyi Cheng Pan Li Yangli-ao Geng Jing Gong ... Chiming Liu Aohan Zeng Yuxiao Dong Jie Tang Leo T. Song 29 98 0 11 Jan 2024
Understanding LLMs: A Comprehensive Overview from Training to Inference Yi-Hsueh Liu Haoyang He Tianle Han Xu-Yao Zhang Mengyuan Liu ... Xintao Hu Tuo Zhang Ning Qiang Tianming Liu Bao Ge SyDa 14 64 0 04 Jan 2024
Unifying Structured Data as Graph for Data-to-Text Pre-Training Shujie Li Liang Li Ruiying Geng Min Yang Binhua Li ... Wanwei He Shao Yuan Can Ma Fei Huang Yongbin Li LMTD 17 13 0 02 Jan 2024
New Job, New Gender? Measuring the Social Bias in Image Generation Models Wenxuan Wang Haonan Bai Jen-tse Huang Yuxuan Wan Youliang Yuan Haoyi Qiu Nanyun Peng Michael R. Lyu 34 20 0 01 Jan 2024
The Earth is Flat? Unveiling Factual Errors in Large Language Models Wenxuan Wang Juluan Shi Zhaopeng Tu Youliang Yuan Jen-tse Huang Wenxiang Jiao Michael R. Lyu KELM HILM SyDa 42 1 0 01 Jan 2024
Semantic-Aware Autoregressive Image Modeling for Visual Representation Learning Kaiyou Song Shan Zhang Tong Wang VLM 11 2 0 16 Dec 2023
Medical Vision Language Pretraining: A survey Prashant Shrestha Sanskar Amgain Bidur Khanal Cristian A. Linte Binod Bhattarai VLM 27 14 0 11 Dec 2023
Lyrics: Boosting Fine-grained Language-Vision Alignment and Comprehension via Semantic-aware Visual Objects Junyu Lu Ruyi Gan Di Zhang Xiaojun Wu Ziwei Wu Renliang Sun Jiaxing Zhang Pingjian Zhang Yan Song MLLM VLM 10 15 0 08 Dec 2023
HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learning Xingtong Yu Yuan Fang Zemin Liu Xinming Zhang 14 35 0 04 Dec 2023
Bootstrapping Interactive Image-Text Alignment for Remote Sensing Image Captioning Cong Yang Zuchao Li Lefei Zhang 24 22 0 02 Dec 2023
Harnessing the Power of Prompt-based Techniques for Generating School-Level Questions using Large Language Models Subhankar Maity Aniket Deroy Sudeshna Sarkar AI4Ed 6 14 0 02 Dec 2023
RoKEPG: RoBERTa and Knowledge Enhancement for Prescription Generation of Traditional Chinese Medicine Hua Pu Jiacong Mi Shan Lu Jieyue He 9 3 0 29 Nov 2023
MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphs Xingtong Yu Chang Zhou Yuan Fang Xinming Zhang 20 29 0 28 Nov 2023
Generalized Graph Prompt: Toward a Unification of Pre-Training and Downstream Tasks on Graphs Xingtong Yu Zhenghao Liu Yuan Fang Zemin Liu Sihong Chen Xinming Zhang 33 24 0 26 Nov 2023
CSMeD: Bridging the Dataset Gap in Automated Citation Screening for Systematic Literature Reviews Wojciech Kusa Óscar E. Mendoza Matthias Samwald Petr Knoth Allan Hanbury 25 4 0 21 Nov 2023
ML-LMCL: Mutual Learning and Large-Margin Contrastive Learning for Improving ASR Robustness in Spoken Language Understanding Xuxin Cheng Bowen Cao Qichen Ye Zhihong Zhu Hongxiang Li Yuexian Zou 19 25 0 19 Nov 2023
RecExplainer: Aligning Large Language Models for Explaining Recommendation Models Yuxuan Lei Jianxun Lian Jing Yao Xu Huang Defu Lian Xing Xie LRM 18 5 0 18 Nov 2023
End-to-end Task-oriented Dialogue: A Survey of Tasks, Methods, and Future Directions Libo Qin Wenbo Pan Qiguang Chen Lizi Liao Zhou Yu Yue Zhang Wanxiang Che Min Li 21 10 0 15 Nov 2023
Controllable Topic-Focused Abstractive Summarization Seyed Ali Bahrainian Martin Jaggi Carsten Eickhoff 19 0 0 12 Nov 2023
Simple and Effective Input Reformulations for Translation Brian Yu Hansen Lillemark Kurt Keutzer 23 0 0 12 Nov 2023
Improving Vision-and-Language Reasoning via Spatial Relations Modeling Cheng Yang Rui Xu Ye Guo Peixiang Huang Yiru Chen Wenkui Ding Zhongyuan Wang Hong Zhou LRM 8 5 0 09 Nov 2023
A Critical Perceptual Pre-trained Model for Complex Trajectory Recovery Dedong Li Ziyue Li Zhishuai Li Lei Bai Qingyuan Gong Lijun Sun Wolf Ketter Rui Zhao 30 5 0 05 Nov 2023
Boosting Summarization with Normalizing Flows and Aggressive Training Yu Yang Xiaotong Shen AI4CE TPM 17 0 0 01 Nov 2023
MiLe Loss: a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models Zhenpeng Su Xing Wu Xue Bai Zijia Lin Hui Chen Guiguang Ding Wei Zhou Songlin Hu 24 5 0 30 Oct 2023
TLM: Token-Level Masking for Transformers Yangjun Wu Kebin Fang Dongxian Zhang Han Wang Hao Zhang Gang Chen 23 1 0 28 Oct 2023
Diversity Enhanced Narrative Question Generation for Storybooks Hokeun Yoon Jinyeong Bak 14 6 0 25 Oct 2023
Knowledge Editing for Large Language Models: A Survey Song Wang Yaochen Zhu Haochen Liu Zaiyi Zheng Chen Chen Jundong Li KELM 66 127 0 24 Oct 2023
Diversify Question Generation with Retrieval-Augmented Style Transfer Qi Gou Zehua Xia Bowen Yu Haiyang Yu Fei Huang Yongbin Li Nguyen Cam-Tu RALM 11 12 0 23 Oct 2023
Pre-Training on Large-Scale Generated Docking Conformations with HelixDock to Unlock the Potential of Protein-ligand Structure Prediction Models Lihang Liu Shanzhuo Zhang Donglong He Xianbin Ye Jingbo Zhou ... Fan Wang Jingzhou He Liang Zheng Yonghui Li Xiaomin Fang AI4CE 11 8 0 21 Oct 2023
Beyond Segmentation: Road Network Generation with Multi-Modal LLMs Sumedh Rasal Sanjay K. Boddhu 22 5 0 15 Oct 2023
PolyTask: Learning Unified Policies through Behavior Distillation Siddhant Haldar Lerrel Pinto 13 7 0 12 Oct 2023
Training Generative Question-Answering on Synthetic Data Obtained from an Instruct-tuned Model Kosuke Takahashi Takahiro Omi Kosuke Arima Tatsuya Ishigaki 23 0 0 12 Oct 2023
GeoLLM: Extracting Geospatial Knowledge from Large Language Models Rohin Manvi Samar Khanna Gengchen Mai Marshall Burke David B. Lobell Stefano Ermon 10 41 0 10 Oct 2023
Pushing the Limits of Pre-training for Time Series Forecasting in the CloudOps Domain Gerald Woo Chenghao Liu Akshat Kumar Doyen Sahoo AI4TS AI4CE 22 12 0 08 Oct 2023
Automatic Multi-Path Web Story Creation from a Structural Article Daniel K. Nkemelu Peggy Chi Daniel Castro Chin Krishna Srinivasan Irfan Essa 24 3 0 03 Oct 2023
De Novo Drug Design with Joint Transformers Adam Izdebski Ewelina Węglarz-Tomczak Ewa Szczurek Jakub M. Tomczak ViT 13 3 0 03 Oct 2023
Survey of Social Bias in Vision-Language Models Nayeon Lee Yejin Bang Holy Lovenia Samuel Cahyawijaya Wenliang Dai Pascale Fung VLM 36 16 0 24 Sep 2023
Towards Answering Health-related Questions from Medical Videos: Datasets and Approaches Deepak Gupta Kush Attal Dina Demner-Fushman LM&MA 14 1 0 21 Sep 2023
Localize, Retrieve and Fuse: A Generalized Framework for Free-Form Question Answering over Tables Wenting Zhao Ye Liu Yao Wan Yibo Wang Zhongfen Deng Philip S. Yu RALM LMTD 14 7 0 20 Sep 2023
MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation Xinda Wu Zhijie Huang Kejun Zhang Jiaxing Yu Xu Tan Tieyao Zhang Zihao W. Wang Lingyun Sun 16 5 0 19 Sep 2023
VDialogUE: A Unified Evaluation Benchmark for Visually-grounded Dialogue Yunshui Li Binyuan Hui Zhaochao Yin Wanwei He Run Luo Yuxing Long Min Yang Fei Huang Yongbin Li 17 1 0 14 Sep 2023
RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Model Fengxiang Bie Yibo Yang Zhongzhu Zhou Adam Ghanem Minjia Zhang ... Pareesa Ameneh Golnari David A. Clifton Yuxiong He Dacheng Tao S. Song EGVM 20 15 0 02 Sep 2023