Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model

20 December 2019

Papers citing "Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model"

50 / 134 papers shown

Title
Knowledge Prompting in Pre-trained Language Model for Natural Language Understanding J. Wang Wenkang Huang Qiuhui Shi Hongbin Wang Minghui Qiu Xiang Li Ming Gao KELM VLM 22 17 0 16 Oct 2022
SPOT: Knowledge-Enhanced Language Representations for Information Extraction Jiacheng Li Yannis Katsis Tyler Baldwin Ho-Cheol Kim Andrew Bartko Julian McAuley Chun-Nan Hsu 22 15 0 20 Aug 2022
General-to-Specific Transfer Labeling for Domain Adaptable Keyphrase Generation Rui Meng Tong Wang Xingdi Yuan Yingbo Zhou Daqing He 19 5 0 20 Aug 2022
Ered: Enhanced Text Representations with Entities and Descriptions Qinghua Zhao Shuai Ma Yu Lei 16 1 0 18 Aug 2022
Measuring Causal Effects of Data Statistics on Language Model's `Factual' Predictions Yanai Elazar Nora Kassner Shauli Ravfogel Amir Feder Abhilasha Ravichander Marius Mosbach Yonatan Belinkov Hinrich Schütze Yoav Goldberg CML SyDa MILM 23 52 0 28 Jul 2022
MLRIP: Pre-training a military language representation model with informative factual knowledge and professional knowledge base Hui Li Xu Yang Xin Zhao Lin Yu Jiping Zheng Wei Sun KELM 22 0 0 28 Jul 2022
Entity-Graph Enhanced Cross-Modal Pretraining for Instance-level Product Retrieval Xiao Dong Xunlin Zhan Yunchao Wei Xiaoyong Wei Yaowei Wang Minlong Lu Xiaochun Cao Xiaodan Liang 19 11 0 17 Jun 2022
Prompt Tuning for Discriminative Pre-trained Language Models Yuan Yao Bowen Dong Ao Zhang Zhengyan Zhang Ruobing Xie Zhiyuan Liu Leyu Lin Maosong Sun Jianyong Wang VLM 8 34 0 23 May 2022
EASE: Entity-Aware Contrastive Learning of Sentence Embedding Sosuke Nishikawa Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka Isao Echizen 20 29 0 09 May 2022
KECP: Knowledge Enhanced Contrastive Prompting for Few-shot Extractive Question Answering J. Wang Chengyu Wang Minghui Qiu Qiuhui Shi Hongbin Wang Jun Huang Ming Gao RALM 31 15 0 06 May 2022
BiTimeBERT: Extending Pre-Trained Language Representations with Bi-Temporal Information Jiexin Wang Adam Jatowt Masatoshi Yoshikawa Y. Cai 25 14 0 27 Apr 2022
Knowledge Infused Decoding Ruibo Liu Guoqing Zheng Shashank Gupta Radhika Gaonkar Chongyang Gao Soroush Vosoughi Milad Shokouhi Ahmed Hassan Awadallah KELM 25 14 0 06 Apr 2022
Forecasting Cryptocurrency Returns from Sentiment Signals: An Analysis of BERT Classifiers and Weak Supervision Duygu Ider Stefan Lessmann 20 5 0 06 Apr 2022
elBERto: Self-supervised Commonsense Learning for Question Answering Xunlin Zhan Yuan Li Xiao Dong Xiaodan Liang Zhiting Hu Lawrence Carin SSL RALM LRM 8 7 0 17 Mar 2022
Geographic Adaptation of Pretrained Language Models Valentin Hofmann Goran Glavavs Nikola Ljubevsić J. Pierrehumbert Hinrich Schütze VLM 21 16 0 16 Mar 2022
A Sentence is Worth 128 Pseudo Tokens: A Semantic-Aware Contrastive Learning Framework for Sentence Embeddings Haochen Tan Wei Shao Han Wu Ke Yang Linqi Song 15 17 0 11 Mar 2022
A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models Deming Ye Yankai Lin Peng Li Maosong Sun Zhiyuan Liu KELM 6 11 0 27 Feb 2022
OntoProtein: Protein Pretraining With Gene Ontology Embedding Ningyu Zhang Zhen Bi Xiaozhuan Liang Shuyang Cheng Haosen Hong Shumin Deng J. Lian Qiang Zhang Huajun Chen 91 90 0 23 Jan 2022
Learning Rich Representation of Keyphrases from Text Mayank Kulkarni Debanjan Mahata Ravneet Arora Rajarshi Bhowmik VLM 19 65 0 16 Dec 2021
Enhancing Multilingual Language Model with Massive Multilingual Knowledge Triples Linlin Liu Xin Li Ruidan He Lidong Bing Shafiq R. Joty Luo Si KELM 35 18 0 22 Nov 2021
Linking-Enhanced Pre-Training for Table Semantic Parsing Bowen Qin Lihan Wang Binyuan Hui Ruiying Geng Zhen Cao Min Yang Jian Sun Yongbin Li 27 1 0 18 Nov 2021
Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey Xiaokai Wei Shen Wang Dejiao Zhang Parminder Bhatia Andrew O. Arnold KELM 21 45 0 16 Oct 2021
Metadata Shaping: Natural Language Annotations for the Tail Simran Arora Sen Wu Enci Liu Christopher Ré 17 0 0 16 Oct 2021
mLUKE: The Power of Entity Representations in Multilingual Pretrained Language Models Ryokan Ri Ikuya Yamada Yoshimasa Tsuruoka 15 30 0 15 Oct 2021
Symbolic Knowledge Distillation: from General Language Models to Commonsense Models Peter West Chandrasekhar Bhagavatula Jack Hessel Jena D. Hwang Liwei Jiang Ronan Le Bras Ximing Lu Sean Welleck Yejin Choi SyDa 31 320 0 14 Oct 2021
Dict-BERT: Enhancing Language Model Pre-training with Dictionary W. Yu Chenguang Zhu Yuwei Fang Donghan Yu Shuohang Wang Yichong Xu Michael Zeng Meng-Long Jiang 45 64 0 13 Oct 2021
A Survey of Knowledge Enhanced Pre-trained Models Jian Yang Xinyu Hu Gang Xiao Yulong Shen KELM 30 5 0 01 Oct 2021
XLM-K: Improving Cross-Lingual Language Model Pre-training with Multilingual Knowledge X. Jiang Yaobo Liang Weizhu Chen Nan Duan 14 22 0 26 Sep 2021
K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering Fu Sun Feng-Lin Li Ruize Wang Qianglong Chen Xingyi Cheng Ji Zhang VLM KELM 22 4 0 22 Sep 2021
Relation-Guided Pre-Training for Open-Domain Question Answering Ziniu Hu Yizhou Sun Kai-Wei Chang RALM OnRL 18 6 0 21 Sep 2021
Packed Levitated Marker for Entity and Relation Extraction Deming Ye Yankai Lin Peng Li Maosong Sun 131 106 0 13 Sep 2021
Mixture-of-Partitions: Infusing Large Biomedical Knowledge Graphs into BERT Zaiqiao Meng Fangyu Liu T. H. Clark Ehsan Shareghi Nigel Collier MoE 39 37 0 10 Sep 2021
MATE: Multi-view Attention for Table Transformer Efficiency Julian Martin Eisenschlos Maharshi Gor Thomas Müller William W. Cohen LMTD 67 93 0 09 Sep 2021
KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs Yinquan Lu H. Lu Guirong Fu Qun Liu KELM 18 34 0 09 Sep 2021
It is AI's Turn to Ask Humans a Question: Question-Answer Pair Generation for Children's Story Books Bingsheng Yao Dakuo Wang Tongshuang Wu Zheng Zhang Toby Jia-Jun Li Mo Yu Ying Xu AI4Ed 20 43 0 08 Sep 2021
Mixed Attention Transformer for Leveraging Word-Level Knowledge to Neural Cross-Lingual Information Retrieval Zhiqi Huang Hamed Bonab Sheikh Muhammad Sarwar Razieh Rahimi James Allan 24 10 0 07 Sep 2021
Enhancing Natural Language Representation with Large-Scale Out-of-Domain Commonsense Wanyun Cui Xingran Chen 22 6 0 06 Sep 2021
Pre-training Language Model Incorporating Domain-specific Heterogeneous Knowledge into A Unified Representation Hongyin Zhu Hao Peng Zhiheng Lyu Lei Hou Juan-Zi Li Jinghui Xiao 24 21 0 02 Sep 2021
Does Knowledge Help General NLU? An Empirical Study Ruochen Xu Yuwei Fang Chenguang Zhu Michael Zeng ELM 18 9 0 01 Sep 2021
ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation Yu Sun Shuohuan Wang Shikun Feng Siyu Ding Chao Pang ... Ouyang Xuan Dianhai Yu Hao Tian Hua-Hong Wu Haifeng Wang 39 451 0 05 Jul 2021
LV-BERT: Exploiting Layer Variety for BERT Weihao Yu Zihang Jiang Fei Chen Qibin Hou Jiashi Feng MQ 15 0 0 22 Jun 2021
Pre-Trained Models: Past, Present and Future Xu Han Zhengyan Zhang Ning Ding Yuxian Gu Xiao Liu ... Jie Tang Ji-Rong Wen Jinhui Yuan Wayne Xin Zhao Jun Zhu AIFin MQ AI4MH 24 811 0 14 Jun 2021
Discriminative Triad Matching and Reconstruction for Weakly Referring Expression Grounding Mingjie Sun Jimin Xiao Eng Gee Lim Si Liu John Y. Goulermas ObjD 11 160 0 08 Jun 2021
Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Study Xiangyang Mou Chenghao Yang Mo Yu Bingsheng Yao Xiaoxiao Guo Saloni Potdar Hui Su LMTD 8 24 0 07 Jun 2021
Static Embeddings as Efficient Knowledge Bases? Philipp Dufter Nora Kassner Hinrich Schütze 20 19 0 14 Apr 2021
K-PLUG: Knowledge-injected Pre-trained Language Model for Natural Language Understanding and Generation in E-Commerce Song Xu Haoran Li Peng Yuan Yujia Wang Youzheng Wu Xiaodong He Ying Liu Bowen Zhou KELM 19 24 0 14 Apr 2021
Relational World Knowledge Representation in Contextual Language Models: A Review Tara Safavi Danai Koutra KELM 27 51 0 12 Apr 2021
Structure Inducing Pre-Training Matthew B. A. McDermott Brendan Yap Peter Szolovits Marinka Zitnik 30 18 0 18 Mar 2021
Does He Wink or Does He Nod? A Challenging Benchmark for Evaluating Word Understanding of Language Models Lutfi Kerem Senel Hinrich Schütze 18 5 0 06 Feb 2021
Focusing Knowledge-based Graph Argument Mining via Topic Modeling Patricia B. Abels Zahra Ahmadi Sophie Burkhardt Benjamin Schiller Iryna Gurevych Stefan Kramer 18 6 0 03 Feb 2021