ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

30 December 2020

Yujia Qin

Yankai Lin

Ryuichi Takanobu

Zhiyuan Liu

Peng Li

Heng Ji

Minlie Huang

Maosong Sun

Jie Zhou

ArXiv PDF HTML

Papers citing "ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning"

21 / 71 papers shown

Title
Visually-Augmented Language Modeling Weizhi Wang Li Dong Hao Cheng Haoyu Song Xiaodong Liu Xifeng Yan Jianfeng Gao Furu Wei VLM 14 17 0 20 May 2022
Good Visual Guidance Makes A Better Extractor: Hierarchical Visual Prefix for Multimodal Entity and Relation Extraction Xiang Chen Ningyu Zhang Lei Li Yunzhi Yao Shumin Deng Chuanqi Tan Fei Huang Luo Si Huajun Chen 15 27 0 07 May 2022
Instilling Type Knowledge in Language Models via Multi-Task QA Shuyang Li Mukund Sridhar Chandan Prakash Jin Cao Wael Hamza Julian McAuley KELM 15 6 0 28 Apr 2022
KALA: Knowledge-Augmented Language Model Adaptation Minki Kang Jinheon Baek Sung Ju Hwang VLM KELM 20 23 0 22 Apr 2022
Contrastive Learning with Hard Negative Entities for Entity Set Expansion Yinghui Li Y. Li Yuxin He Tianyu Yu Ying Shen Haitao Zheng 8 26 0 16 Apr 2022
A Review on Language Models as Knowledge Bases Badr AlKhamissi Millicent Li Asli Celikyilmaz Mona T. Diab Marjan Ghazvininejad KELM 12 137 0 12 Apr 2022
MERIt: Meta-Path Guided Contrastive Learning for Logical Reasoning Fangkai Jiao Yangyang Guo Xuemeng Song Liqiang Nie LRM 20 30 0 01 Mar 2022
HiCLRE: A Hierarchical Contrastive Learning Framework for Distantly Supervised Relation Extraction Dongyang Li Taolin Zhang Nan Hu Chengyu Wang Xiaofeng He 17 18 0 27 Feb 2022
Automatically Generating Counterfactuals for Relation Classification Mi Zhang T. Qian Tingyu Zhang CML 12 0 0 22 Feb 2022
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 13 35 0 16 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 15 1 0 01 Oct 2021
Fine-Grained Chemical Entity Typing with Multimodal Knowledge Representation Chenkai Sun Weijian Li Jinfeng Xiao Nikolaus Nova Parulian ChengXiang Zhai Heng Ji 26 4 0 29 Aug 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 11 611 0 14 Jun 2021
Knowledge Inheritance for Pre-trained Language Models Yujia Qin Yankai Lin Jing Yi Jiajie Zhang Xu Han ... Yusheng Su Zhiyuan Liu Peng Li Maosong Sun Jie Zhou VLM 11 42 0 28 May 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 9 45 0 12 Apr 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 20 17 0 18 Mar 2021
Coarse-to-Fine Entity Representations for Document-level Relation Extraction Damai Dai Jingjing Ren Shuang Zeng Baobao Chang Zhifang Sui AI4TS 6 3 0 04 Dec 2020
A Mutual Information Maximization Perspective of Language Representation Learning Lingpeng Kong Cyprien de Masson dÁutume Wang Ling Lei Yu Zihang Dai Dani Yogatama SSL 196 163 0 18 Oct 2019
Span-based Joint Entity and Relation Extraction with Transformer Pre-training Markus Eberts A. Ulges LRM ViT 149 344 0 17 Sep 2019
Knowledge Enhanced Contextual Word Representations Matthew E. Peters Mark Neumann IV RobertL.Logan Roy Schwartz Vidur Joshi Sameer Singh Noah A. Smith 210 651 0 09 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 292 6,003 0 20 Apr 2018