ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning

30 December 2020

Yujia Qin

Yankai Lin

Ryuichi Takanobu

Zhiyuan Liu

Peng Li

Heng Ji

Minlie Huang

Maosong Sun

Jie Zhou

ArXiv PDF HTML

Papers citing "ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning"

50 / 71 papers shown

Title
KEHRL: Learning Knowledge-Enhanced Language Representations with Hierarchical Reinforcement Learning Dongyang Li Taolin Zhang Longtao Huang Chengyu Wang Xiaofeng He Hui Xue KELM OffRL 17 0 0 24 Jun 2024
Enhancing Idiomatic Representation in Multiple Languages via an Adaptive Contrastive Triplet Loss Wei He M. Idiart Carolina Scarton Aline Villavicencio 14 0 0 21 Jun 2024
Learning Multi-view Molecular Representations with Structured and Unstructured Knowledge Yizhen Luo Kai Yang Massimo Hong Xing Yi Liu Zikun Nie Hao Zhou Zaiqing Nie 25 0 0 14 Jun 2024
PyTorch-IE: Fast and Reproducible Prototyping for Information Extraction Arne Binder Leonhard Hennig Christoph Alt SyDa 27 3 0 16 May 2024
Graph Machine Learning in the Era of Large Language Models (LLMs) Wenqi Fan Shijie Wang Jiani Huang Zhikai Chen Yu Song ... Haitao Mao Hui Liu Xiaorui Liu Dawei Yin Qing Li AI4CE 16 21 0 23 Apr 2024
READ: Improving Relation Extraction from an ADversarial Perspective Dawei Li William Hogan Jingbo Shang AAML 18 0 0 02 Apr 2024
VerifiNER: Verification-augmented NER via Knowledge-grounded Reasoning with Large Language Models Seoyeon Kim Kwangwook Seo Hyungjoo Chae Jinyoung Yeo Dongha Lee 20 0 0 28 Feb 2024
InfuserKI: Enhancing Large Language Models with Knowledge Graphs via Infuser-Guided Knowledge Integration Fali Wang Runxue Bao Suhang Wang Wenchao Yu Yanchi Liu Wei Cheng Haifeng Chen KELM 8 2 0 18 Feb 2024
ConcEPT: Concept-Enhanced Pre-Training for Language Models Xintao Wang Zhouhong Gu Jiaqing Liang Dakuan Lu Yanghua Xiao Wei Wang 16 1 0 11 Jan 2024
YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction Xinglin Xiao Yijie Wang Nan Xu Yuqi Wang Hanxuan Yang Minzheng Wang Yin Luo Lei Wang Wenji Mao Daniel Zeng 18 15 0 24 Dec 2023
Synergistic Anchored Contrastive Pre-training for Few-Shot Relation Extraction Da Luo Yanglei Gan Rui Hou Run Lin Qiao Liu Yuxiang Cai Wannian Gao 9 1 0 19 Dec 2023
DistillCSE: Distilled Contrastive Learning for Sentence Embeddings Jiahao Xu Wei Shao Lihui Chen Lemao Liu FedML 8 2 0 20 Oct 2023
Multi-level Contrastive Learning for Script-based Character Understanding Dawei Li Hengyuan Zhang Yanran Li Shiping Yang 27 17 0 20 Oct 2023
Knowledge-Augmented Language Model Verification Jinheon Baek Soyeong Jeong Minki Kang Jong C. Park Sung Ju Hwang RALM 21 4 0 19 Oct 2023
IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning Zihang Xu Ziqing Yang Yiming Cui Shijin Wang LRM ReLM MLLM 20 3 0 27 Jun 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 15 42 0 20 Jun 2023
Controlled Text Generation with Hidden Representation Transformations Vaibhav Kumar H. Koorehdavoudi Masud Moshtaghi Amita Misra Ankit Chadha Emilio Ferrara 8 3 0 30 May 2023
Plug-and-Play Knowledge Injection for Pre-trained Language Models Zhengyan Zhang Zhiyuan Zeng Yankai Lin Huadong Wang Deming Ye ... Xu Han Zhiyuan Liu Peng Li Maosong Sun Jie Zhou KELM 19 10 0 28 May 2023
Pre-training Language Models for Comparative Reasoning Mengxia Yu Zhihan Zhang Wenhao Yu Meng-Long Jiang LRM 11 8 0 23 May 2023
Exploring Self-supervised Logic-enhanced Training for Large Language Models Fangkai Jiao Zhiyang Teng Bosheng Ding Zhengyuan Liu Nancy F. Chen Shafiq R. Joty ReLM LRM 9 0 0 23 May 2023
Open-world Semi-supervised Generalized Relation Discovery Aligned in a Real-world Setting William Hogan Jiacheng Li Jingbo Shang OffRL 8 0 0 22 May 2023
SimCSE++: Improving Contrastive Learning for Sentence Embeddings from Two Perspectives Jiahao Xu Wei Shao Lihu Chen Lemao Liu 12 8 0 22 May 2023
KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness Yichuan Li Jialong Han Kyumin Lee Chengyuan Ma S. Sarkar Derek Liu VLM KELM 17 0 0 02 May 2023
Bridging the Language Gap: Knowledge Injected Multilingual Question Answering Zhichao Duan Xiuxing Li Zhengyan Zhang Zhenyu Li Ning Liu Jianyong Wang 11 5 0 06 Apr 2023
Towards Integration of Discriminability and Robustness for Document-Level Relation Extraction Jiannan Guo Stanley Kok Lidong Bing 8 6 0 03 Apr 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 13 22 0 14 Mar 2023
The Contribution of Knowledge in Visiolinguistic Learning: A Survey on Tasks and Challenges Maria Lymperaiou Giorgos Stamou VLM 10 4 0 04 Mar 2023
Protein Representation Learning via Knowledge Enhanced Primary Structure Modeling Hong-Yu Zhou Yunxiang Fu Zhicheng Zhang Cheng Bian Yizhou Yu 8 5 0 30 Jan 2023
Unifying Structure Reasoning and Language Model Pre-training for Complex Reasoning Siyuan Wang Zhongyu Wei Jiarong Xu Taishan Li Zhihao Fan LRM 18 2 0 21 Jan 2023
Semantic-aware Contrastive Learning for More Accurate Semantic Parsing Shan Wu Chunlei Xin Bo Chen Xianpei Han Le Sun 4 2 0 19 Jan 2023
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 11 2 0 27 Dec 2022
Continual Contrastive Finetuning Improves Low-Resource Relation Extraction Wenxuan Zhou Sheng Zhang Tristan Naumann Muhao Chen Hoifung Poon 25 2 0 21 Dec 2022
An Effective Deployment of Contrastive Learning in Multi-label Text Classification Nankai Lin Guanqiu Qin G. Wang Aimin Yang Dong-ping Zhou 10 7 0 01 Dec 2022
A survey on knowledge-enhanced multimodal learning Maria Lymperaiou Giorgos Stamou 14 6 0 19 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 10 71 0 11 Nov 2022
Query-based Instance Discrimination Network for Relational Triple Extraction Zeqi Tan Yongliang Shen Xuming Hu Wenqi Zhang Xiaoxia Cheng Weiming Lu Y. Zhuang ISeg 12 7 0 03 Nov 2022
VarMAE: Pre-training of Variational Masked Autoencoder for Domain-adaptive Language Understanding Dou Hu Xiaolong Hou Xiyang Du Mengyuan Zhou Lian-Xin Jiang Yang Mo Xiaofeng Shi 17 7 0 01 Nov 2022
Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation Junru Lu Xingwei Tan Gabriele Pergola Lin Gui Yulan He 6 9 0 24 Oct 2022
Language Model Pre-Training with Sparse Latent Typing Liliang Ren Zixuan Zhang H. Wang Clare R. Voss Chengxiang Zhai Heng Ji 37 3 0 23 Oct 2022
Pre-training Language Models with Deterministic Factual Knowledge Shaobo Li Xiaoguang Li Lifeng Shang Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 26 7 0 20 Oct 2022
Knowledge-Enhanced Relation Extraction Dataset Yucong Lin Hongming Xiao Jianing Liu Zichao Lin K. Lu Feifei Wang Wei Wei 14 0 0 19 Oct 2022
Learning from the Dictionary: Heterogeneous Knowledge Guided Fine-tuning for Chinese Spell Checking Yinghui Li Shirong Ma Qingyu Zhou Zhongli Li Li Yangning Shulin Huang R. Liu Chao Li Yunbo Cao Haitao Zheng 12 27 0 19 Oct 2022
SPOT: Knowledge-Enhanced Language Representations for Information Extraction Jiacheng Li Yannis Katsis Tyler Baldwin Ho-Cheol Kim Andrew Bartko Julian McAuley Chun-Nan Hsu 14 7 0 20 Aug 2022
DictBERT: Dictionary Description Knowledge Enhanced Language Model Pre-training via Contrastive Learning Qianglong Chen Feng-Lin Li Guohai Xu Ming Yan Ji Zhang Yin Zhang 18 22 0 01 Aug 2022
MLRIP: Pre-training a military language representation model with informative factual knowledge and professional knowledge base Hui Li Xu Yang Xin Zhao Lin Yu Jiping Zheng Wei Sun KELM 14 0 0 28 Jul 2022
An Overview of Distant Supervision for Relation Extraction with a Focus on Denoising and Pre-training Methods William Hogan 11 4 0 17 Jul 2022
Entity-Graph Enhanced Cross-Modal Pretraining for Instance-level Product Retrieval Xiao Dong Xunlin Zhan Yunchao Wei Xiaoyong Wei Yaowei Wang Minlong Lu Xiaochun Cao Xiaodan Liang 16 4 0 17 Jun 2022
A Multi-level Supervised Contrastive Learning Framework for Low-Resource Natural Language Inference Shuang Li Xuming Hu Li Lin Aiwei Liu Lijie Wen Philip S. Yu 17 13 0 31 May 2022
Fine-grained Contrastive Learning for Relation Extraction William Hogan Jiacheng Li Jingbo Shang 15 10 0 25 May 2022
Improving Long Tailed Document-Level Relation Extraction via Easy Relation Augmentation and Contrastive Learning Yangkai Du Tengyu Ma Lingfei Wu Yiming Wu Xuhong Zhang Bo Long S. Ji 9 3 0 21 May 2022