ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1905.03197
  4. Cited By
Unified Language Model Pre-training for Natural Language Understanding
  and Generation

Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019
Li Dong
Nan Yang
Wenhui Wang
Furu Wei
Xiaodong Liu
Yu-Chiang Frank Wang
Jianfeng Gao
M. Zhou
H. Hon
    ELM
    AI4CE
ArXivPDFHTML

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 846 papers shown
Title
Unsupervised Multi-hop Question Answering by Question Generation
Unsupervised Multi-hop Question Answering by Question Generation
Liangming Pan
Wenhu Chen
Wenhan Xiong
Min-Yen Kan
William Yang Wang
18
57
0
23 Oct 2020
Generating Long Financial Report using Conditional Variational
  Autoencoders with Knowledge Distillation
Generating Long Financial Report using Conditional Variational Autoencoders with Knowledge Distillation
Yunpeng Ren
Ziao Wang
Yiyuan Wang
Xiaofeng Zhang
8
9
0
23 Oct 2020
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling
  for Natural Language Understanding
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding
Dongling Xiao
Yukun Li
Han Zhang
Yu Sun
Hao Tian
Hua-Hong Wu
Haifeng Wang
11
38
0
23 Oct 2020
Stronger Transformers for Neural Multi-Hop Question Generation
Stronger Transformers for Neural Multi-Hop Question Generation
Devendra Singh Sachan
Lingfei Wu
Mrinmaya Sachan
William L. Hamilton
6
8
0
22 Oct 2020
A Simple and Efficient Multi-Task Learning Approach for Conditioned
  Dialogue Generation
A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation
Yan Zeng
J. Nie
9
5
0
21 Oct 2020
ReSCo-CC: Unsupervised Identification of Key Disinformation Sentences
ReSCo-CC: Unsupervised Identification of Key Disinformation Sentences
Soumya Suvra Ghosal
P. Deepak
Anna Jurek-Loughrey
9
2
0
21 Oct 2020
Dimsum @LaySumm 20: BART-based Approach for Scientific Document
  Summarization
Dimsum @LaySumm 20: BART-based Approach for Scientific Document Summarization
Tiezheng Yu
Dan Su
Wenliang Dai
Pascale Fung
22
5
0
19 Oct 2020
Multi-hop Question Generation with Graph Convolutional Network
Multi-hop Question Generation with Graph Convolutional Network
Dan Su
Yan Xu
Wenliang Dai
Ziwei Ji
Tiezheng Yu
Pascale Fung
18
39
0
19 Oct 2020
Mixed-Lingual Pre-training for Cross-lingual Summarization
Mixed-Lingual Pre-training for Cross-lingual Summarization
Ruochen Xu
Chenguang Zhu
Yu Shi
Michael Zeng
Xuedong Huang
11
25
0
18 Oct 2020
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models
Knowledge-Grounded Dialogue Generation with Pre-trained Language Models
Xueliang Zhao
Wei Yu Wu
Can Xu
Chongyang Tao
Dongyan Zhao
Rui Yan
175
191
0
17 Oct 2020
Unsupervised Extractive Summarization by Pre-training Hierarchical
  Transformers
Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers
Shusheng Xu
Xingxing Zhang
Yi Wu
Furu Wei
Ming Zhou
57
43
0
16 Oct 2020
Positioning yourself in the maze of Neural Text Generation: A
  Task-Agnostic Survey
Positioning yourself in the maze of Neural Text Generation: A Task-Agnostic Survey
Khyathi Raghavi Chandu
A. Black
18
0
0
14 Oct 2020
Re-evaluating Evaluation in Text Summarization
Re-evaluating Evaluation in Text Summarization
Manik Bhandari
Pranav Narayan Gour
A. Ashfaq
Pengfei Liu
Graham Neubig
6
175
0
14 Oct 2020
Sensitivity of BLANC to human-scored qualities of text summaries
Sensitivity of BLANC to human-scored qualities of text summaries
Oleg V. Vasilyev
Vedant Dharnidharka
Nicholas Egan
Charlene Chambliss
John Bohannon
15
7
0
13 Oct 2020
Mathematical Word Problem Generation from Commonsense Knowledge Graph
  and Equations
Mathematical Word Problem Generation from Commonsense Knowledge Graph and Equations
Tianqiao Liu
Qian Fang
Wenbiao Ding
Hang Li
Zhongqin Wu
Zitao Liu
6
27
0
13 Oct 2020
Incorporating BERT into Parallel Sequence Decoding with Adapters
Incorporating BERT into Parallel Sequence Decoding with Adapters
Junliang Guo
Zhirui Zhang
Linli Xu
Hao-Ran Wei
Boxing Chen
Enhong Chen
32
69
0
13 Oct 2020
Improving Self-supervised Pre-training via a Fully-Explored Masked
  Language Model
Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model
Ming Zheng
Dinghan Shen
Yelong Shen
Weizhu Chen
Lin Xiao
SSL
8
4
0
12 Oct 2020
Evaluating Factuality in Generation with Dependency-level Entailment
Evaluating Factuality in Generation with Dependency-level Entailment
Tanya Goyal
Greg Durrett
8
146
0
12 Oct 2020
A BERT-based Distractor Generation Scheme with Multi-tasking and
  Negative Answer Training Strategies
A BERT-based Distractor Generation Scheme with Multi-tasking and Negative Answer Training Strategies
Ho-Lam Chung
Ying-Hong Chan
Yao-Chung Fan
31
41
0
12 Oct 2020
Artificial Intelligence (AI) in Action: Addressing the COVID-19 Pandemic
  with Natural Language Processing (NLP)
Artificial Intelligence (AI) in Action: Addressing the COVID-19 Pandemic with Natural Language Processing (NLP)
Qingyu Chen
Robert Leaman
Alexis Allot
Ling Luo
Chih-Hsuan Wei
Shankai Yan
Zhiyong Lu
12
37
0
09 Oct 2020
A Survey of Knowledge-Enhanced Text Generation
A Survey of Knowledge-Enhanced Text Generation
Wenhao Yu
Chenguang Zhu
Zaitang Li
Zhiting Hu
Qingyun Wang
Heng Ji
Meng-Long Jiang
8
277
0
09 Oct 2020
Learning to Fuse Sentences with Transformers for Summarization
Learning to Fuse Sentences with Transformers for Summarization
Logan Lebanoff
Franck Dernoncourt
Doo Soon Kim
Lidan Wang
W. Chang
Fei Liu
11
22
0
08 Oct 2020
Don't Parse, Insert: Multilingual Semantic Parsing with Insertion Based
  Decoding
Don't Parse, Insert: Multilingual Semantic Parsing with Insertion Based Decoding
Qile Zhu
Haidar Khan
Saleh Soltan
Stephen Rawls
Wael Hamza
8
24
0
08 Oct 2020
Cross-Thought for Sentence Encoder Pre-training
Cross-Thought for Sentence Encoder Pre-training
Shuohang Wang
Yuwei Fang
S. Sun
Zhe Gan
Yu Cheng
Jing Jiang
Jingjing Liu
LRM
24
19
0
07 Oct 2020
TeaForN: Teacher-Forcing with N-grams
TeaForN: Teacher-Forcing with N-grams
Sebastian Goodman
Nan Ding
Radu Soricut
6
19
0
07 Oct 2020
Toward Stance-based Personas for Opinionated Dialogues
Toward Stance-based Personas for Opinionated Dialogues
Thomas Scialom
Serra Sinem Tekiroğlu
Jacopo Staiano
Marco Guerini
8
9
0
07 Oct 2020
Program Enhanced Fact Verification with Verbalization and Graph
  Attention Network
Program Enhanced Fact Verification with Verbalization and Graph Attention Network
Xiaoyu Yang
Feng Nie
Yufei Feng
Quan Liu
Zhigang Chen
Xiao-Dan Zhu
8
52
0
06 Oct 2020
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for
  Language Model Adaptation
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation
Minki Kang
Moonsu Han
Sung Ju Hwang
OOD
6
17
0
06 Oct 2020
PAIR: Planning and Iterative Refinement in Pre-trained Transformers for
  Long Text Generation
PAIR: Planning and Iterative Refinement in Pre-trained Transformers for Long Text Generation
Xinyu Hua
Lu Wang
11
55
0
05 Oct 2020
SPLAT: Speech-Language Joint Pre-Training for Spoken Language
  Understanding
SPLAT: Speech-Language Joint Pre-Training for Spoken Language Understanding
Yu-An Chung
Chenguang Zhu
Michael Zeng
VLM
6
8
0
05 Oct 2020
Discern: Discourse-Aware Entailment Reasoning Network for Conversational
  Machine Reading
Discern: Discourse-Aware Entailment Reasoning Network for Conversational Machine Reading
Yifan Gao
Chien-Sheng Wu
Jingjing Li
Shafiq R. Joty
S. Hoi
Caiming Xiong
Irwin King
M. Lyu
FedML
10
51
0
05 Oct 2020
Tell Me How to Ask Again: Question Data Augmentation with Controllable
  Rewriting in Continuous Space
Tell Me How to Ask Again: Question Data Augmentation with Controllable Rewriting in Continuous Space
Dayiheng Liu
Yeyun Gong
Jie Fu
Yu Yan
Jiusheng Chen
Jiancheng Lv
Nan Duan
M. Zhou
6
37
0
04 Oct 2020
Semantic Role Labeling Guided Multi-turn Dialogue ReWriter
Semantic Role Labeling Guided Multi-turn Dialogue ReWriter
Kun Xu
Haochen Tan
Linfeng Song
Han Wu
Haisong Zhang
Linqi Song
Dong Yu
KELM
OffRL
6
27
0
03 Oct 2020
Sequence-to-Sequence Learning for Indonesian Automatic Question
  Generator
Sequence-to-Sequence Learning for Indonesian Automatic Question Generator
Ferdiant Joshua Muis
Ayu Purwarianti
10
16
0
29 Sep 2020
Graph-based Multi-hop Reasoning for Long Text Generation
Graph-based Multi-hop Reasoning for Long Text Generation
Liang Zhao
Jingjing Xu
Junyang Lin
Yichang Zhang
Hongxia Yang
Xu Sun
LRM
6
9
0
28 Sep 2020
Hierarchical Deep Multi-modal Network for Medical Visual Question
  Answering
Hierarchical Deep Multi-modal Network for Medical Visual Question Answering
D. Gupta
S. Suman
Asif Ekbal
11
60
0
27 Sep 2020
KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense
  Reasoning
KG-BART: Knowledge Graph-Augmented BART for Generative Commonsense Reasoning
Ye Liu
Yao Wan
Lifang He
Hao Peng
Philip S. Yu
17
188
0
26 Sep 2020
MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems
MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systems
Zhaojiang Lin
Andrea Madotto
Genta Indra Winata
Pascale Fung
27
172
0
25 Sep 2020
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal
  Transformers
X-LXMERT: Paint, Caption and Answer Questions with Multi-Modal Transformers
Jaemin Cho
Jiasen Lu
Dustin Schwenk
Hannaneh Hajishirzi
Aniruddha Kembhavi
VLM
MLLM
12
102
0
23 Sep 2020
Composed Variational Natural Language Generation for Few-shot Intents
Composed Variational Natural Language Generation for Few-shot Intents
Congying Xia
Caiming Xiong
Philip Yu
R. Socher
VLM
DRL
11
31
0
21 Sep 2020
End-to-End Neural Event Coreference Resolution
End-to-End Neural Event Coreference Resolution
Yaojie Lu
Hongyu Lin
Jialong Tang
Xianpei Han
Le Sun
14
34
0
17 Sep 2020
Multi-modal Summarization for Video-containing Documents
Multi-modal Summarization for Video-containing Documents
Xiyan Fu
Jun Wang
Zhenglu Yang
18
23
0
17 Sep 2020
Augmented Natural Language for Generative Sequence Labeling
Augmented Natural Language for Generative Sequence Labeling
Ben Athiwaratkun
Cicero Nogueira dos Santos
Jason Krone
Bing Xiang
VLM
6
59
0
15 Sep 2020
Autoregressive Knowledge Distillation through Imitation Learning
Autoregressive Knowledge Distillation through Imitation Learning
Alexander Lin
Jeremy Wohlwend
Howard Chen
Tao Lei
31
37
0
15 Sep 2020
Global-aware Beam Search for Neural Abstractive Summarization
Global-aware Beam Search for Neural Abstractive Summarization
Ye Ma
Zixun Lan
Lu Zong
Kaizhu Huang
13
12
0
15 Sep 2020
Contrastive Triple Extraction with Generative Transformer
Contrastive Triple Extraction with Generative Transformer
Hongbin Ye
Ningyu Zhang
Shumin Deng
Mosha Chen
Chuanqi Tan
Fei Huang
Huajun Chen
17
127
0
14 Sep 2020
Improving Machine Reading Comprehension with Contextualized Commonsense
  Knowledge
Improving Machine Reading Comprehension with Contextualized Commonsense Knowledge
Kai Sun
Dian Yu
Jianshu Chen
Dong Yu
Claire Cardie
22
12
0
12 Sep 2020
Accelerating Real-Time Question Answering via Question Generation
Accelerating Real-Time Question Answering via Question Generation
Yuwei Fang
Shuohang Wang
Zhe Gan
S. Sun
Jingjing Liu
Chenguang Zhu
OnRL
10
16
0
10 Sep 2020
Robust Conversational AI with Grounded Text Generation
Robust Conversational AI with Grounded Text Generation
Jianfeng Gao
Baolin Peng
Chunyuan Li
Jinchao Li
Shahin Shayandeh
Lars Liden
H. Shum
7
21
0
07 Sep 2020
Learning to summarize from human feedback
Learning to summarize from human feedback
Nisan Stiennon
Long Ouyang
Jeff Wu
Daniel M. Ziegler
Ryan J. Lowe
Chelsea Voss
Alec Radford
Dario Amodei
Paul Christiano
ALM
9
1,955
0
02 Sep 2020
Previous
123...1314151617
Next