ERNIE: Enhanced Representation through Knowledge Integration

19 April 2019

Papers citing "ERNIE: Enhanced Representation through Knowledge Integration"

50 / 359 papers shown

Title
DAPrompt: Deterministic Assumption Prompt Learning for Event Causality Identification Wei Xiang Chuanhong Zhan Bang Wang 13 1 0 19 Jul 2023
RaTE: a Reproducible automatic Taxonomy Evaluation by Filling the Gap Tianjian Gao Phillipe Langlais 11 5 0 19 Jul 2023
Do not Mask Randomly: Effective Domain-adaptive Pre-training by Masking In-domain Keywords Shahriar Golchin Mihai Surdeanu N. Tavabi A. Kiapour 13 4 0 14 Jul 2023
Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs Zhikai Chen Haitao Mao Hang Li Wei Jin Haifang Wen ... Shuaiqiang Wang Dawei Yin Wenqi Fan Hui Liu Jiliang Tang AI4CE 38 265 0 07 Jul 2023
QUERT: Continual Pre-training of Language Model for Query Understanding in Travel Domain Search Jian Xie Yidan Liang Jingping Liu Yanghua Xiao Baohua Wu Shenghua Ni VLM LRM 24 8 0 11 Jun 2023
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memories Shizhe Diao Tianyang Xu Ruijia Xu Jiawei Wang Tong Zhang MoE AI4CE 11 36 0 08 Jun 2023
UniBoost: Unsupervised Unimodal Pre-training for Boosting Zero-shot Vision-Language Tasks Yanan Sun Zi-Qi Zhong Qi Fan Chi-Keung Tang Yu-Wing Tai VLM 28 4 0 07 Jun 2023
Extracting Cloud-based Model with Prior Knowledge S. Zhao Kangjie Chen Meng Hao Jian Zhang Guowen Xu Hongwei Li Tianwei Zhang AAML MIACV SILM MLAU SLR 23 5 0 07 Jun 2023
Shuo Wen Jie Zi: Rethinking Dictionaries and Glyphs for Chinese Language Pre-training Yuxuan Wang Jianghui Wang Dongyan Zhao Zilong Zheng 21 4 0 30 May 2023
Self-Evolution Learning for Discriminative Language Model Pretraining Qihuang Zhong Liang Ding Juhua Liu Bo Du Dacheng Tao 29 12 0 24 May 2023
Decouple knowledge from parameters for plug-and-play language modeling Xin Cheng Yankai Lin Xiuying Chen Dongyan Zhao Rui Yan KELM 22 2 0 19 May 2023
Constructing Word-Context-Coupled Space Aligned with Associative Knowledge Relations for Interpretable Language Modeling Fanyu Wang Zhenping Xie 11 0 0 19 May 2023
IUST_NLP at SemEval-2023 Task 10: Explainable Detecting Sexism with Transformers and Task-adaptive Pretraining Hadi Mahmoudi 8 0 0 11 May 2023
ChatGPT-Like Large-Scale Foundation Models for Prognostics and Health Management: A Survey and Roadmaps Yanfang Li Huan Wang Muxia Sun LM&MA AI4TS AI4CE 19 45 0 10 May 2023
CSED: A Chinese Semantic Error Diagnosis Corpus Bo Sun Baoxin Wang Yixuan Wang Wanxiang Che Dayong Wu Shijin Wang Ting Liu 35 4 0 09 May 2023
FreeLM: Fine-Tuning-Free Language Model Xiang Li Xin Jiang Xuying Meng Aixin Sun Yequan Wang 39 3 0 02 May 2023
Understand the Dynamic World: An End-to-End Knowledge Informed Framework for Open Domain Entity State Tracking Mingchen Li Lifu Huang 43 9 0 26 Apr 2023
A Cheaper and Better Diffusion Language Model with Soft-Masked Noise Jiaao Chen Aston Zhang Mu Li Alexander J. Smola Diyi Yang DiffM 24 17 0 10 Apr 2023
WebBrain: Learning to Generate Factually Correct Articles for Queries by Grounding on Large Web Corpus Hongjing Qian Yutao Zhu Zhicheng Dou Haoqi Gu Xinyu Zhang Zheng Liu Ruofei Lai Zhao Cao J. Nie Ji-Rong Wen 38 25 0 10 Apr 2023
On Efficient Training of Large-Scale Deep Learning Models: A Literature Review Li Shen Yan Sun Zhiyuan Yu Liang Ding Xinmei Tian Dacheng Tao VLM 24 39 0 07 Apr 2023
Unsupervised Improvement of Factual Knowledge in Language Models Nafis Sadeq Byungkyu Kang Prarit Lamba Julian McAuley KELM 19 6 0 04 Apr 2023
PK-Chat: Pointer Network Guided Knowledge Driven Generative Dialogue Model Cheng Deng Bo Tong Luoyi Fu Jiaxin Ding Dexing Cao Xinbing Wang Chenghu Zhou 14 3 0 02 Apr 2023
Is BERT Blind? Exploring the Effect of Vision-and-Language Pretraining on Visual Language Understanding Morris Alper Michael Fiman Hadar Averbuch-Elor VLM LRM 18 16 0 21 Mar 2023
Character, Word, or Both? Revisiting the Segmentation Granularity for Chinese Pre-trained Language Models Xinnian Liang Zefan Zhou Hui Huang Shuangzhi Wu Tong Xiao Muyun Yang Zhoujun Li Chao Bian VLM 24 2 0 20 Mar 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 26 27 0 14 Mar 2023
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT Yihan Cao Siyu Li Yixin Liu Zhiling Yan Yutong Dai Philip S. Yu Lichao Sun 24 501 0 07 Mar 2023
Label Information Enhanced Fraud Detection against Low Homophily in Graphs Yuchen Wang Jinghui Zhang Zhengjie Huang Weibin Li Shi Feng ... Dianhai Yu Fang Dong Jiahui Jin Beilun Wang Junzhou Luo 20 38 0 21 Feb 2023
BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmark Dakuan Lu Hengkui Wu Jiaqing Liang Yipei Xu Qi He Yipeng Geng Mengkun Han Ying Xin Yanghua Xiao 22 53 0 18 Feb 2023
Bag of Tricks for Effective Language Model Pretraining and Downstream Adaptation: A Case Study on GLUE Qihuang Zhong Liang Ding Keqin Peng Juhua Liu Bo Du Li Shen Yibing Zhan Dacheng Tao VLM 32 13 0 18 Feb 2023
KILM: Knowledge Injection into Encoder-Decoder Language Models Yan Xu Mahdi Namazifar Devamanyu Hazarika Aishwarya Padmakumar Yang Liu Dilek Z. Hakkani-Tür KELM 22 26 0 17 Feb 2023
Enhancing E-Commerce Recommendation using Pre-Trained Language Model and Fine-Tuning Nuofan Xu Chenhui Hu 8 2 0 09 Feb 2023
CRL+: A Novel Semi-Supervised Deep Active Contrastive Representation Learning-Based Text Classification Model for Insurance Data Amir Namavar Jahromi Ebrahim Pourjafari H. Karimipour Amit Satpathy Lovell Hodge 14 3 0 08 Feb 2023
COMBO: A Complete Benchmark for Open KG Canonicalization Chengyue Jiang Yong-jia Jiang Weiqi Wu Yuting Zheng Pengjun Xie Kewei Tu 8 2 0 08 Feb 2023
Unifying Structure Reasoning and Language Model Pre-training for Complex Reasoning Siyuan Wang Zhongyu Wei Jiarong Xu Taishan Li Zhihao Fan LRM 36 4 0 21 Jan 2023
Toward Building General Foundation Models for Language, Vision, and Vision-Language Understanding Tasks Xinsong Zhang Yan Zeng Jipeng Zhang Hang Li VLM AI4CE LRM 14 17 0 12 Jan 2023
Parameter-Efficient Fine-Tuning Design Spaces Jiaao Chen Aston Zhang Xingjian Shi Mu Li Alexander J. Smola Diyi Yang 20 59 0 04 Jan 2023
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 24 3 0 27 Dec 2022
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator Jian Yang Shuming Ma Li Dong Shaohan Huang Haoyang Huang Yuwei Yin Dongdong Zhang Liqun Yang Furu Wei Zhoujun Li SyDa AI4CE 32 25 0 20 Dec 2022
Efficient Pre-training of Masked Language Model via Concept-based Curriculum Masking Mingyu Lee Jun-Hyung Park Junho Kim Kang-Min Kim SangKeun Lee 8 12 0 15 Dec 2022
A Roadmap to Domain Knowledge Integration in Machine Learning Himel Das Gupta Victor S. Sheng 6 4 0 12 Dec 2022
Uniform Masking Prevails in Vision-Language Pretraining Siddharth Verma Yuchen Lu Rui Hou Hanchao Yu Nicolas Ballas Madian Khabsa Amjad Almahairi VLM 21 0 0 10 Dec 2022
CKG: Dynamic Representation Based on Context and Knowledge Graph Xunzhu Tang Tiezhu Sun Rujie Zhu Shi Wang 9 2 0 09 Dec 2022
Toward Efficient Language Model Pretraining and Downstream Adaptation via Self-Evolution: A Case Study on SuperGLUE Qihuang Zhong Liang Ding Yibing Zhan Yu Qiao Yonggang Wen ... Yixin Chen Xinbo Gao Chun Miao Xiaoou Tang Dacheng Tao VLM ELM 45 34 0 04 Dec 2022
Language Model Pre-training on True Negatives Zhuosheng Zhang Hai Zhao Masao Utiyama Eiichiro Sumita 22 2 0 01 Dec 2022
A Pipeline for Generating, Annotating and Employing Synthetic Data for Real World Question Answering Matthew Maufe James Ravenscroft Rob Procter Maria Liakata 24 3 0 30 Nov 2022
X-PuDu at SemEval-2022 Task 6: Multilingual Learning for English and Arabic Sarcasm Detection Yangchao Han Yekun Chai Shuohuan Wang Yu Sun Hongyi Huang Guanghao Chen Yitong Xu Yang Yang 19 8 0 30 Nov 2022
Protein Language Models and Structure Prediction: Connection and Progression Bozhen Hu Jun-Xiong Xia Jiangbin Zheng Cheng Tan Yufei Huang Yongjie Xu Stan Z. Li 19 40 0 30 Nov 2022
X-PuDu at SemEval-2022 Task 7: A Replaced Token Detection Task Pre-trained Model with Pattern-aware Ensembling for Identifying Plausible Clarifications Junyuan Shang Shuohuan Wang Yu Sun Yanjun Yu Yue Zhou Li Xiang Guixiu Yang 19 2 0 27 Nov 2022
A Survey of Text Representation Methods and Their Genealogy Philipp Siebers Christian Janiesch Patrick Zschech AI4TS 12 9 0 26 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 17 121 0 11 Nov 2022