ERNIE: Enhanced Representation through Knowledge Integration

19 April 2019

Papers citing "ERNIE: Enhanced Representation through Knowledge Integration"

50 / 359 papers shown

Title
Analysing the Effect of Masking Length Distribution of MLM: An Evaluation Framework and Case Study on Chinese MRC Datasets Changchang Zeng Shaobo Li 16 6 0 29 Sep 2021
BiRdQA: A Bilingual Dataset for Question Answering on Tricky Riddles Yunxiang Zhang Xiaojun Wan 34 12 0 23 Sep 2021
K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering Fu Sun Feng-Lin Li Ruize Wang Qianglong Chen Xingyi Cheng Ji Zhang VLM KELM 22 4 0 22 Sep 2021
KFCNet: Knowledge Filtering and Contrastive Learning Network for Generative Commonsense Reasoning Haonan Li Yeyun Gong Jian Jiao Ruofei Zhang Timothy Baldwin Nan Duan OffRL 47 6 0 14 Sep 2021
Packed Levitated Marker for Entity and Relation Extraction Deming Ye Yankai Lin Peng Li Maosong Sun 131 106 0 13 Sep 2021
CPT: A Pre-Trained Unbalanced Transformer for Both Chinese Language Understanding and Generation Yunfan Shao Zhichao Geng Yitao Liu Junqi Dai Hang Yan Fei Yang Li Zhe Hujun Bao Xipeng Qiu MedIm 59 146 0 13 Sep 2021
Knowledge Enhanced Fine-Tuning for Better Handling Unseen Entities in Dialogue Generation Leyang Cui Yu-Huan Wu Shujie Liu Yue Zhang 75 22 0 12 Sep 2021
Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT Zaiqiao Meng Fangyu Liu T. H. Clark Ehsan Shareghi Nigel Collier MoE 39 37 0 10 Sep 2021
Data Efficient Masked Language Modeling for Vision and Language Yonatan Bitton Gabriel Stanovsky Michael Elhadad Roy Schwartz VLM 8 20 0 05 Sep 2021
Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation Hongyin Zhu Hao Peng Zhiheng Lyu Lei Hou Juan-Zi Li Jinghui Xiao 24 21 0 02 Sep 2021
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq R. Joty S. Hoi 210 1,489 0 02 Sep 2021
Does Knowledge Help General NLU? An Empirical Study Ruochen Xu Yuwei Fang Chenguang Zhu Michael Zeng ELM 18 9 0 01 Sep 2021
When Retriever-Reader Meets Scenario-Based Multiple-Choice Questions Zixian Huang Ao Wu Yulin Shen Gong Cheng Yuzhong Qu RALM 31 4 0 31 Aug 2021
DuTrust: A Sentiment Analysis Dataset for Trustworthiness Evaluation Lijie Wang Hao Liu Shu-ping Peng Hongxuan Tang Xinyan Xiao Ying Chen Hua-Hong Wu Haifeng Wang 17 5 0 30 Aug 2021
Span Fine-tuning for Pre-trained Language Models Rongzhou Bao Zhuosheng Zhang Hai Zhao 12 1 0 29 Aug 2021
GEDIT: Geographic-Enhanced and Dependency-Guided Tagging for Joint POI and Accessibility Extraction at Baidu Maps Yibo Sun Jizhou Huang Chunyuan Yuan M. Fan Haifeng Wang Ming Liu Bing Qin 19 13 0 20 Aug 2021
TSI: an Ad Text Strength Indicator using Text-to-CTR and Semantic-Ad-Similarity Shaunak Mishra Changwei Hu Manisha Verma Kevin Yen Yifan Hu M. Sviridenko 9 7 0 18 Aug 2021
ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration Yuhao Cui Zhou Yu Chunqi Wang Zhongzhou Zhao Ji Zhang Meng Wang Jun-chen Yu VLM 19 52 0 16 Aug 2021
Interpretable Visual Understanding with Cognitive Attention Network Xuejiao Tang Wenbin Zhang Yi Yu Kea Turner Tyler Derr Mengyu Wang Eirini Ntoutsi 44 12 0 06 Aug 2021
LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matching Kun Zhang Guangyi Lv Le Wu Enhong Chen Qi Liu Meng Wang 17 6 0 06 Aug 2021
Curriculum learning for language modeling Daniel Fernando Campos 6 31 0 04 Aug 2021
LICHEE: Improving Language Model Pre-training with Multi-grained Tokenization Weidong Guo Mingjun Zhao Lusheng Zhang Di Niu Jinwen Luo Zhenhua Liu Zhenyang Li J. Tang 13 8 0 02 Aug 2021
Improving Social Meaning Detection with Pragmatic Masking and Surrogate Fine-Tuning Chiyu Zhang Muhammad Abdul-Mageed ObjD AI4CE 8 6 0 01 Aug 2021
Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing Pengfei Liu Weizhe Yuan Jinlan Fu Zhengbao Jiang Hiroaki Hayashi Graham Neubig VLM SyDa 23 3,828 0 28 Jul 2021
FewCLUE: A Chinese Few-shot Learning Evaluation Benchmark Liang Xu Xiaojing Lu Chenyang Yuan Xuanwei Zhang Huilin Xu ... Guoao Wei X. Pan Xin Tian Libo Qin Hai Hu ELM 24 56 0 15 Jul 2021
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Yu Sun Shuohuan Wang Shikun Feng Siyu Ding Chao Pang ... Ouyang Xuan Dianhai Yu Hao Tian Hua-Hong Wu Haifeng Wang 39 451 0 05 Jul 2021
Cognitive Visual Commonsense Reasoning Using Dynamic Working Memory Xuejiao Tang Xin Huang Wenbin Zhang T. Child Qiong Hu Zhen Liu Ji Zhang LRM 13 18 0 04 Jul 2021
ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information Zijun Sun Xiaoya Li Xiaofei Sun Yuxian Meng Xiang Ao Qing He Fei Wu Jiwei Li SSeg 29 183 0 30 Jun 2021
Bilateral Personalized Dialogue Generation with Contrastive Learning Bin Li Hanjun Deng 13 6 0 15 Jun 2021
SAS: Self-Augmentation Strategy for Language Model Pre-training Yifei Xu Jingqiao Zhang Ru He Liangzhu Ge Chao Yang Cheng Yang Ying Wu 26 1 0 14 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 24 811 0 14 Jun 2021
Generate, Annotate, and Learn: NLP with Synthetic Text Xuanli He Islam Nassar J. Kiros Gholamreza Haffari Mohammad Norouzi 24 51 0 11 Jun 2021
CAT: Cross Attention in Vision Transformer Hezheng Lin Xingyi Cheng Xiangyu Wu Fan Yang Dong Shen Zhongyuan Wang Qing Song Wei Yuan ViT 27 149 0 10 Jun 2021
Linguistically Informed Masking for Representation Learning in the Patent Domain Sophia Althammer Mark Buckley Sebastian Hofstatter Allan Hanbury 29 11 0 10 Jun 2021
BERTnesia: Investigating the capture and forgetting of knowledge in BERT Jonas Wallat Jaspreet Singh Avishek Anand CLL KELM 22 58 0 05 Jun 2021
ERNIE-Tiny : A Progressive Distillation Framework for Pretrained Transformer Compression Weiyue Su Xuyi Chen Shi Feng Jiaxiang Liu Weixin Liu Yu Sun Hao Tian Hua-Hong Wu Haifeng Wang 21 13 0 04 Jun 2021
Sub-Character Tokenization for Chinese Pretrained Language Models Chenglei Si Zhengyan Zhang Yingfa Chen Fanchao Qi Xiaozhi Wang Zhiyuan Liu Yasheng Wang Qun Liu Maosong Sun 14 9 0 01 Jun 2021
HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalization Jiaao Chen Dinghan Shen Weizhu Chen Diyi Yang BDL 11 47 0 31 May 2021
Structural Pre-training for Dialogue Comprehension Zhuosheng Zhang Hai Zhao 21 31 0 23 May 2021
Lexicon Enhanced Chinese Sequence Labeling Using BERT Adapter Wei Liu Xiyan Fu Yueqian Zhang Wenming Xiao 4 155 0 15 May 2021
ReadTwice: Reading Very Large Documents with Memories Yury Zemlyanskiy Joshua Ainslie Michiel de Jong Philip Pham Ilya Eckstein Fei Sha AIMat RALM 9 17 0 10 May 2021
ZEN 2.0: Continue Training and Adaption for N-gram Enhanced Text Encoders Yan Song Tong Zhang Yonggang Wang Kai-Fu Lee 46 43 0 04 May 2021
PanGu- $α$ : Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation Wei Zeng Xiaozhe Ren Teng Su Hui Wang Yi-Lun Liao ... Gaojun Fan Yaowei Wang Xuefeng Jin Qun Liu Yonghong Tian ALM MoE AI4CE 27 212 0 26 Apr 2021
Identify, Align, and Integrate: Matching Knowledge Graphs to Commonsense Reasoning Tasks Lisa Bauer Mohit Bansal 16 19 0 20 Apr 2021
Editing Factual Knowledge in Language Models Nicola De Cao Wilker Aziz Ivan Titov KELM 45 472 0 16 Apr 2021
Lattice-BERT: Leveraging Multi-Granularity Representations in Chinese Pre-trained Language Models Yuxuan Lai Yijia Liu Yansong Feng Songfang Huang Dongyan Zhao VLM AI4CE 32 37 0 15 Apr 2021
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce Song Xu Haoran Li Peng Yuan Yujia Wang Youzheng Wu Xiaodong He Ying Liu Bowen Zhou KELM 19 24 0 14 Apr 2021
Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge Canwen Xu Wangchunshu Zhou Tao Ge Ke Xu Julian McAuley Furu Wei 15 16 0 06 Apr 2021
On the Adversarial Robustness of Vision Transformers Rulin Shao Zhouxing Shi Jinfeng Yi Pin-Yu Chen Cho-Jui Hsieh ViT 25 137 0 29 Mar 2021
Machine Learning Meets Natural Language Processing -- The story so far N. Galanis P. Vafiadis K.-G. Mirzaev G. Papakostas 30 6 0 27 Mar 2021