ERNIE: Enhanced Representation through Knowledge Integration

19 April 2019

Papers citing "ERNIE: Enhanced Representation through Knowledge Integration"

50 / 359 papers shown

Title
K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretraining Rui Yan Lanchang Sun Fang Wang Xiaoming Zhang KELM AI4CE 19 1 0 25 Mar 2021
Interpretable Deep Learning: Interpretation, Interpretability, Trustworthiness, and Beyond Xuhong Li Haoyi Xiong Xingjian Li Xuanyu Wu Xiao Zhang Ji Liu Jiang Bian Dejing Dou AAML FaML XAI HAI 13 315 0 19 Mar 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 30 18 0 18 Mar 2021
Natural Language Understanding for Argumentative Dialogue Systems in the Opinion Building Domain W. A. Abro Annalena Aicher Niklas Rach Stefan Ultes Wolfgang Minker Guilin Qi 23 32 0 03 Mar 2021
DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections Yury Zemlyanskiy Sudeep Gandhe Ruining He Bhargav Kanagal Anirudh Ravula Juraj Gottweis Fei Sha Ilya Eckstein SSL 24 11 0 26 Feb 2021
LET: Linguistic Knowledge Enhanced Graph Transformer for Chinese Short Text Matching Boer Lyu Lu Chen Su Zhu Kai Yu 43 49 0 25 Feb 2021
DOBF: A Deobfuscation Pre-Training Objective for Programming Languages Baptiste Roziere Marie-Anne Lachaux Marc Szafraniec Guillaume Lample AI4CE 44 136 0 15 Feb 2021
Fused Acoustic and Text Encoding for Multimodal Bilingual Pretraining and Speech Translation Renjie Zheng Junkun Chen Mingbo Ma Liang Huang 28 69 0 10 Feb 2021
CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models Yusheng Su Xu Han Yankai Lin Zhengyan Zhang Zhiyuan Liu Peng Li Jie Zhou Maosong Sun 11 10 0 07 Feb 2021
Training Multilingual Pre-trained Language Model with Byte-level Subwords Junqiu Wei Qun Liu Yinpeng Guo Xin Jiang 17 19 0 23 Jan 2021
Censorship of Online Encyclopedias: Implications for NLP Models Eddie Yang Margaret E. Roberts 16 16 0 22 Jan 2021
Training Data Leakage Analysis in Language Models Huseyin A. Inan Osman Ramadan Lukas Wutschitz Daniel Jones Victor Rühle James Withers Robert Sim MIACV PILM 29 9 0 14 Jan 2021
Heterogeneous Network Embedding for Deep Semantic Relevance Match in E-commerce Search Ziyang Liu Zhaomeng Cheng Yunjiang Jiang Yue Shang Wei Xiong Sulong Xu Bo Long Di Jin 20 3 0 13 Jan 2021
AT-BERT: Adversarial Training BERT for Acronym Identification Winning Solution for SDU@AAAI-21 Danqing Zhu Wangli Lin Yang Zhang Qiwei Zhong Guanxiong Zeng Weilin Wu Jiayu Tang 21 17 0 11 Jan 2021
Learning Better Sentence Representation with Syntax Information Chen Yang 15 1 0 09 Jan 2021
Exploring Text-transformers in AAAI 2021 Shared Task: COVID-19 Fake News Detection in English Xiangyang Li Yu Xia Xiang Long Zheng Li Sujian Li 215 37 0 07 Jan 2021
ERNIE-Doc: A Retrospective Long-Document Modeling Transformer Siyu Ding Junyuan Shang Shuohuan Wang Yu Sun Hao Tian Hua-Hong Wu Haifeng Wang 60 0 0 31 Dec 2020
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations Changlong Yu Hongming Zhang Yangqiu Song Wilfred Ng 54 21 0 31 Dec 2020
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning Yujia Qin Yankai Lin Ryuichi Takanobu Zhiyuan Liu Peng Li Heng Ji Minlie Huang Maosong Sun Jie Zhou 38 125 0 30 Dec 2020
CMV-BERT: Contrastive multi-vocab pretraining of BERT Wei-wei Zhu Daniel Cheung SSL VLM 6 0 0 29 Dec 2020
Proactive Interaction Framework for Intelligent Social Receptionist Robots Yang Xue Fan Wang Hao Tian Min Zhao Jiangyong Li Haiqing Pan Yueqiang Dong 11 9 0 09 Dec 2020
CPM: A Large-scale Generative Chinese Pre-trained Language Model Zhengyan Zhang Xu Han Hao Zhou Pei Ke Yuxian Gu ... Wentao Han Jie Tang Juan-Zi Li Xiaoyan Zhu Maosong Sun 10 113 0 01 Dec 2020
Modifying Memories in Transformer Models Chen Zhu A. S. Rawat Manzil Zaheer Srinadh Bhojanapalli Daliang Li Felix X. Yu Sanjiv Kumar KELM 6 189 0 01 Dec 2020
Topology of Word Embeddings: Singularities Reflect Polysemy A. Jakubowski Milica Gasic Marcus Zibrowius 21 14 0 18 Nov 2020
KddRES: A Multi-level Knowledge-driven Dialogue Dataset for Restaurant Towards Customized Dialogue System Hongru Wang Min Li Zimo Zhou Gabriel Pui Cheong Fung Kam-Fai Wong 8 5 0 17 Nov 2020
MVP-BERT: Redesigning Vocabularies for Chinese BERT and Multi-Vocab Pretraining Wei-wei Zhu VLM 8 6 0 17 Nov 2020
Natural Language Inference in Context -- Investigating Contextual Reasoning over Long Texts Hanmeng Liu Leyang Cui Jian Liu Yue Zhang ReLM LRM 14 42 0 10 Nov 2020
MixKD: Towards Efficient Distillation of Large-scale Language Models Kevin J Liang Weituo Hao Dinghan Shen Yufan Zhou Weizhu Chen Changyou Chen Lawrence Carin 6 72 0 01 Nov 2020
A Comprehensive Survey on Word Representation Models: From Classical to State-Of-The-Art Word Representation Language Models Usman Naseem Imran Razzak S. Khan M. Prasad 12 156 0 28 Oct 2020
Fine-tuning ERNIE for chest abnormal imaging signs extraction Zhaoning Li Jiangtao Ren MedIm 6 6 0 25 Oct 2020
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding Dongling Xiao Yukun Li Han Zhang Yu Sun Hao Tian Hua-Hong Wu Haifeng Wang 19 38 0 23 Oct 2020
A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation Yan Zeng J. Nie 16 5 0 21 Oct 2020
Does Chinese BERT Encode Word Structure? Yile Wang Leyang Cui Yue Zhang 20 6 0 15 Oct 2020
Improving Self-supervised Pre-training via a Fully-Explored Masked Language Model Ming Zheng Dinghan Shen Yelong Shen Weizhu Chen Lin Xiao SSL 16 4 0 12 Oct 2020
Galileo at SemEval-2020 Task 12: Multi-lingual Learning for Offensive Language Identification using Pre-trained Language Models Shuohuan Wang Jiaxiang Liu Ouyang Xuan Yu Sun 26 36 0 07 Oct 2020
Neural Mask Generator: Learning to Generate Adaptive Word Maskings for Language Model Adaptation Minki Kang Moonsu Han Sung Ju Hwang OOD 17 17 0 06 Oct 2020
PMI-Masking: Principled masking of correlated spans Yoav Levine Barak Lenz Opher Lieber Omri Abend Kevin Leyton-Brown Moshe Tennenholtz Y. Shoham 9 72 0 05 Oct 2020
On Losses for Modern Language Models Stephane Aroca-Ouellette Frank Rudzicz 6 33 0 04 Oct 2020
Which *BERT? A Survey Organizing Contextualized Encoders Patrick Xia Shijie Wu Benjamin Van Durme 26 50 0 02 Oct 2020
JAKET: Joint Pre-training of Knowledge Graph and Language Understanding Donghan Yu Chenguang Zhu Yiming Yang Michael Zeng KELM 11 142 0 02 Oct 2020
CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models Yusheng Su Xu Han Zhengyan Zhang Peng Li Zhiyuan Liu Yankai Lin Jie Zhou Maosong Sun ODL 18 24 0 29 Sep 2020
A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and Generation Dinghan Shen Ming Zheng Yelong Shen Yanru Qu Weizhu Chen AAML 13 130 0 29 Sep 2020
Dialogue-adaptive Language Model Pre-training From Quality Estimation Junlong Li Zhuosheng Zhang Hai Zhao OffRL 19 12 0 10 Sep 2020
ERNIE at SemEval-2020 Task 10: Learning Word Emphasis Selection by Pre-trained Language Model Zhengjie Huang Shikun Feng Weiyue Su Xuyi Chen Shuohuan Wang Jiaxiang Liu Ouyang Xuan Yu Sun 12 8 0 08 Sep 2020
E-BERT: A Phrase and Product Knowledge Enhanced Language Model for E-commerce Denghui Zhang Zixuan Yuan Yanchi Liu Fuzhen Zhuang Haifeng Chen Hui Xiong 9 43 0 07 Sep 2020
Accenture at CheckThat! 2020: If you say so: Post-hoc fact-checking of claims using transformer-based models Evan Williams Paul Rodrigues Valerie Novak 21 42 0 05 Sep 2020
AMBERT: A Pre-trained Language Model with Multi-Grained Tokenization Xinsong Zhang Pengshuai Li Hang Li 6 51 0 27 Aug 2020
Conceptualized Representation Learning for Chinese Biomedical Text Mining Ningyu Zhang Qianghuai Jia Kangping Yin Liang Dong Feng Gao Nengwei Hua OOD 21 65 0 25 Aug 2020
A Survey on Text Classification: From Shallow to Deep Learning Qian Li Hao Peng Jianxin Li Congyin Xia Renyu Yang Lichao Sun Philip S. Yu Lifang He VLM 12 326 0 02 Aug 2020
A Survey on Self-supervised Pre-training for Sequential Transfer Learning in Neural Networks H. H. Mao BDL SSL 6 50 0 01 Jul 2020