ResearchTrend.AI
  • Papers
  • Communities
  • Events
  • Blog
  • Pricing
Papers
Communities
Social Events
Terms and Conditions
Pricing
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2025 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 1905.03197
  4. Cited By
Unified Language Model Pre-training for Natural Language Understanding
  and Generation

Unified Language Model Pre-training for Natural Language Understanding and Generation

8 May 2019
Li Dong
Nan Yang
Wenhui Wang
Furu Wei
Xiaodong Liu
Yu-Chiang Frank Wang
Jianfeng Gao
M. Zhou
H. Hon
    ELM
    AI4CE
ArXivPDFHTML

Papers citing "Unified Language Model Pre-training for Natural Language Understanding and Generation"

50 / 846 papers shown
Title
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages
Baptiste Roziere
Marie-Anne Lachaux
Marc Szafraniec
Guillaume Lample
AI4CE
44
135
0
15 Feb 2021
CATE: Computation-aware Neural Architecture Encoding with Transformers
CATE: Computation-aware Neural Architecture Encoding with Transformers
Shen Yan
Kaiqiang Song
Z. Feng
Mi Zhang
20
24
0
14 Feb 2021
Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised
  Pre-training and Its Application to Children's ASR
Bi-APC: Bidirectional Autoregressive Predictive Coding for Unsupervised Pre-training and Its Application to Children's ASR
Ruchao Fan
Amber Afshan
Abeer Alwan
18
14
0
12 Feb 2021
Speech-language Pre-training for End-to-end Spoken Language
  Understanding
Speech-language Pre-training for End-to-end Spoken Language Understanding
Yao Qian
Ximo Bian
Yu Shi
Naoyuki Kanda
Leo Shen
Zhen Xiao
Michael Zeng
AuLLM
15
45
0
11 Feb 2021
Proof Artifact Co-training for Theorem Proving with Language Models
Proof Artifact Co-training for Theorem Proving with Language Models
Jesse Michael Han
Jason M. Rute
Yuhuai Wu
Edward W. Ayers
Stanislas Polu
AIMat
16
120
0
11 Feb 2021
Text Compression-aided Transformer Encoding
Text Compression-aided Transformer Encoding
Z. Li
Zhuosheng Zhang
Hai Zhao
Rui Wang
Kehai Chen
Masao Utiyama
Eiichiro Sumita
AI4CE
19
44
0
11 Feb 2021
Self-Teaching Machines to Read and Comprehend with Large-Scale
  Multi-Subject Question-Answering Data
Self-Teaching Machines to Read and Comprehend with Large-Scale Multi-Subject Question-Answering Data
Dian Yu
Kai Sun
Dong Yu
Claire Cardie
26
7
0
01 Feb 2021
Generative Spoken Language Modeling from Raw Audio
Generative Spoken Language Modeling from Raw Audio
Kushal Lakhotia
Evgeny Kharitonov
Wei-Ning Hsu
Yossi Adi
Adam Polyak
...
Tu Nguyen
Jade Copet
Alexei Baevski
A. Mohamed
Emmanuel Dupoux
AuLLM
174
336
0
01 Feb 2021
An Empirical Study on the Generalization Power of Neural Representations
  Learned via Visual Guessing Games
An Empirical Study on the Generalization Power of Neural Representations Learned via Visual Guessing Games
Alessandro Suglia
Yonatan Bisk
Ioannis Konstas
Antonio Vergari
E. Bastianelli
Andrea Vanzo
Oliver Lemon
18
8
0
31 Jan 2021
DOC2PPT: Automatic Presentation Slides Generation from Scientific
  Documents
DOC2PPT: Automatic Presentation Slides Generation from Scientific Documents
Tsu-jui Fu
W. Wang
Daniel J. McDuff
Yale Song
8
49
0
28 Jan 2021
Scheduled Sampling in Vision-Language Pretraining with Decoupled
  Encoder-Decoder Network
Scheduled Sampling in Vision-Language Pretraining with Decoupled Encoder-Decoder Network
Yehao Li
Yingwei Pan
Ting Yao
Jingwen Chen
Tao Mei
VLM
13
52
0
27 Jan 2021
Beyond Domain APIs: Task-oriented Conversational Modeling with
  Unstructured Knowledge Access Track in DSTC9
Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access Track in DSTC9
Seokhwan Kim
Mihail Eric
Behnam Hedayatnia
Karthik Gopalakrishnan
Yang Liu
Chao-Wei Huang
Dilek Z. Hakkani-Tür
16
15
0
22 Jan 2021
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning
LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning
Yuhuai Wu
M. Rabe
Wenda Li
Jimmy Ba
Roger C. Grosse
Christian Szegedy
AIMat
LRM
61
51
0
15 Jan 2021
End-to-End Video Question-Answer Generation with Generator-Pretester
  Network
End-to-End Video Question-Answer Generation with Generator-Pretester Network
Hung-Ting Su
Chen-Hsi Chang
Po-Wei Shen
Yu-Siang Wang
Ya-Liang Chang
Yu-Cheng Chang
Pu-Jen Cheng
Winston H. Hsu
27
31
0
05 Jan 2021
Outline to Story: Fine-grained Controllable Story Generation from
  Cascaded Events
Outline to Story: Fine-grained Controllable Story Generation from Cascaded Events
Le Fang
Tao Zeng
Chao-Ning Liu
Liefeng Bo
Wen Dong
Changyou Chen
24
12
0
04 Jan 2021
Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting
Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting
Wangchunshu Zhou
Tao Ge
Canwen Xu
Ke Xu
Furu Wei
LRM
14
15
0
02 Jan 2021
Intent Classification and Slot Filling for Privacy Policies
Intent Classification and Slot Filling for Privacy Policies
Wasi Uddin Ahmad
Jianfeng Chi
Tu Le
Thomas B. Norton
Yuan Tian
Kai-Wei Chang
11
23
0
01 Jan 2021
MiniLMv2: Multi-Head Self-Attention Relation Distillation for
  Compressing Pretrained Transformers
MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers
Wenhui Wang
Hangbo Bao
Shaohan Huang
Li Dong
Furu Wei
MQ
13
254
0
31 Dec 2020
XLM-T: Scaling up Multilingual Machine Translation with Pretrained
  Cross-lingual Transformer Encoders
XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders
Shuming Ma
Jian Yang
Haoyang Huang
Zewen Chi
Li Dong
...
Akiko Eriguchi
Saksham Singhal
Xia Song
Arul Menezes
Furu Wei
LRM
23
33
0
31 Dec 2020
UNIMO: Towards Unified-Modal Understanding and Generation via
  Cross-Modal Contrastive Learning
UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learning
Wei Li
Can Gao
Guocheng Niu
Xinyan Xiao
Hao Liu
Jiachen Liu
Hua-Hong Wu
Haifeng Wang
20
374
0
31 Dec 2020
Dialogue Graph Modeling for Conversational Machine Reading
Dialogue Graph Modeling for Conversational Machine Reading
Siru Ouyang
Zhuosheng Zhang
Hai Zhao
21
42
0
29 Dec 2020
A Hierarchical Transformer with Speaker Modeling for Emotion Recognition
  in Conversation
A Hierarchical Transformer with Speaker Modeling for Emotion Recognition in Conversation
JiangNan Li
Zheng Lin
Peng Fu
Q. Si
Weiping Wang
13
18
0
29 Dec 2020
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust
  Task-oriented Dialog Systems
RADDLE: An Evaluation Benchmark and Analysis Platform for Robust Task-oriented Dialog Systems
Baolin Peng
Chunyuan Li
Zhu Zhang
Chenguang Zhu
Jinchao Li
Jianfeng Gao
13
49
0
29 Dec 2020
Global Context Networks
Global Context Networks
Yue Cao
Jiarui Xu
Stephen Lin
Fangyun Wei
Han Hu
ISeg
28
95
0
24 Dec 2020
A Survey on Visual Transformer
A Survey on Visual Transformer
Kai Han
Yunhe Wang
Hanting Chen
Xinghao Chen
Jianyuan Guo
...
Chunjing Xu
Yixing Xu
Zhaohui Yang
Yiman Zhang
Dacheng Tao
ViT
16
2,096
0
23 Dec 2020
Learning to Retrieve Entity-Aware Knowledge and Generate Responses with
  Copy Mechanism for Task-Oriented Dialogue Systems
Learning to Retrieve Entity-Aware Knowledge and Generate Responses with Copy Mechanism for Task-Oriented Dialogue Systems
Chao-Hong Tan
Xiaoyu Yang
Zióu Zheng
Tianda Li
Yufei Feng
Jia-Chen Gu
Quan Liu
Dan Liu
Zhenhua Ling
Xiao-Dan Zhu
RALM
10
9
0
22 Dec 2020
Lexically-constrained Text Generation through Commonsense Knowledge
  Extraction and Injection
Lexically-constrained Text Generation through Commonsense Knowledge Extraction and Injection
Yikang Li
P. Goel
Varsha Kuppur Rajendra
H. Singh
Jonathan M Francis
Kaixin Ma
Eric Nyberg
A. Oltramari
10
7
0
19 Dec 2020
Breaking Writer's Block: Low-cost Fine-tuning of Natural Language
  Generation Models
Breaking Writer's Block: Low-cost Fine-tuning of Natural Language Generation Models
Alexandre Duval
Thomas Lamson
Gael de Leseleuc de Kerouara
Matthias Gallé
6
0
0
19 Dec 2020
Learning Contextual Representations for Semantic Parsing with
  Generation-Augmented Pre-Training
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training
Peng Shi
Patrick K. L. Ng
Zhiguo Wang
Henghui Zhu
Alexander Hanbo Li
Jun Wang
Cicero Nogueira dos Santos
Bing Xiang
15
117
0
18 Dec 2020
Contrastive Learning with Adversarial Perturbations for Conditional Text
  Generation
Contrastive Learning with Adversarial Perturbations for Conditional Text Generation
Seanie Lee
Dong Bok Lee
Sung Ju Hwang
13
105
0
14 Dec 2020
EQG-RACE: Examination-Type Question Generation
EQG-RACE: Examination-Type Question Generation
Xin Jia
Wenjie Zhou
Xu Sun
Yunfang Wu
AI4Ed
11
39
0
11 Dec 2020
Data Boost: Text Data Augmentation Through Reinforcement Learning Guided
  Conditional Generation
Data Boost: Text Data Augmentation Through Reinforcement Learning Guided Conditional Generation
Ruibo Liu
Guangxuan Xu
Chenyan Jia
Weicheng Ma
Lili Wang
Soroush Vosoughi
23
107
0
05 Dec 2020
Fine-tuning BERT for Low-Resource Natural Language Understanding via
  Active Learning
Fine-tuning BERT for Low-Resource Natural Language Understanding via Active Learning
Daniel Grießhaber
J. Maucher
Ngoc Thang Vu
17
46
0
04 Dec 2020
End-to-End QA on COVID-19: Domain Adaptation with Synthetic Training
End-to-End QA on COVID-19: Domain Adaptation with Synthetic Training
R. Reddy
Bhavani Iyer
Md Arafat Sultan
Rong Zhang
Avirup Sil
Vittorio Castelli
Radu Florian
Salim Roukos
OOD
15
19
0
02 Dec 2020
An Enhanced Knowledge Injection Model for Commonsense Generation
An Enhanced Knowledge Injection Model for Commonsense Generation
Zhihao Fan
Yeyun Gong
Zhongyu Wei
Siyuan Wang
Ya-Chieh Huang
Jian Jiao
Xuanjing Huang
Nan Duan
Ruofei Zhang
13
27
0
01 Dec 2020
Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT
Fact-level Extractive Summarization with Hierarchical Graph Mask on BERT
Ruifeng Yuan
Zili Wang
Wenjie Li
12
22
0
19 Nov 2020
UP-DETR: Unsupervised Pre-training for Object Detection with
  Transformers
UP-DETR: Unsupervised Pre-training for Object Detection with Transformers
Zhigang Dai
Bolun Cai
Yugeng Lin
Junying Chen
ViT
22
22
0
18 Nov 2020
Generating Fact Checking Briefs
Generating Fact Checking Briefs
Angela Fan
Aleksandra Piktus
Fabio Petroni
Guillaume Wenzek
Marzieh Saeidi
Andreas Vlachos
Antoine Bordes
Sebastian Riedel
HILM
11
57
0
10 Nov 2020
Multilingual AMR-to-Text Generation
Multilingual AMR-to-Text Generation
Angela Fan
Claire Gardent
4
32
0
10 Nov 2020
Multimodal Pretraining for Dense Video Captioning
Multimodal Pretraining for Dense Video Captioning
Gabriel Huang
Bo Pang
Zhenhai Zhu
Clara E. Rivera
Radu Soricut
8
82
0
10 Nov 2020
Multi-document Summarization via Deep Learning Techniques: A Survey
Multi-document Summarization via Deep Learning Techniques: A Survey
Congbo Ma
W. Zhang
Mingyu Guo
Hu Wang
Quan Z. Sheng
13
124
0
10 Nov 2020
CHIME: Cross-passage Hierarchical Memory Network for Generative Review
  Question Answering
CHIME: Cross-passage Hierarchical Memory Network for Generative Review Question Answering
Junru Lu
Gabriele Pergola
Lin Gui
Binyang Li
Yulan He
14
8
0
01 Nov 2020
A Comprehensive Survey on Word Representation Models: From Classical to
  State-Of-The-Art Word Representation Language Models
A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Models
Usman Naseem
Imran Razzak
S. Khan
M. Prasad
12
157
0
28 Oct 2020
Accelerating Training of Transformer-Based Language Models with
  Progressive Layer Dropping
Accelerating Training of Transformer-Based Language Models with Progressive Layer Dropping
Minjia Zhang
Yuxiong He
AI4CE
8
100
0
26 Oct 2020
NeuroLogic Decoding: (Un)supervised Neural Text Generation with
  Predicate Logic Constraints
NeuroLogic Decoding: (Un)supervised Neural Text Generation with Predicate Logic Constraints
Ximing Lu
Peter West
Rowan Zellers
Ronan Le Bras
Chandra Bhagavatula
Yejin Choi
NAI
8
142
0
24 Oct 2020
Multilingual Speech Translation with Efficient Finetuning of Pretrained
  Models
Multilingual Speech Translation with Efficient Finetuning of Pretrained Models
Xian Li
Changhan Wang
Yun Tang
C. Tran
Yuqing Tang
J. Pino
Alexei Baevski
Alexis Conneau
Michael Auli
19
6
0
24 Oct 2020
Pre-training Text-to-Text Transformers for Concept-centric Common Sense
Pre-training Text-to-Text Transformers for Concept-centric Common Sense
Wangchunshu Zhou
Dong-Ho Lee
Ravi Kiran Selvam
Seyeon Lee
Bill Yuchen Lin
Xiang Ren
LRM
VLM
6
71
0
24 Oct 2020
Open-Domain Dialogue Generation Based on Pre-trained Language Models
Open-Domain Dialogue Generation Based on Pre-trained Language Models
Yan Zeng
J. Nie
13
3
0
24 Oct 2020
Improved Synthetic Training for Reading Comprehension
Improved Synthetic Training for Reading Comprehension
Yanda Chen
Md Arafat Sultan
T. J. W. R. Center
SyDa
8
5
0
24 Oct 2020
Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question
  Answering
Synthetic Data Augmentation for Zero-Shot Cross-Lingual Question Answering
Arij Riabi
Thomas Scialom
Rachel Keraron
Benoît Sagot
Djamé Seddah
Jacopo Staiano
140
52
0
23 Oct 2020
Previous
123...121314151617
Next