Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model

20 December 2019

Papers citing "Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model"

34 / 134 papers shown

Title
Measuring and Improving Consistency in Pretrained Language Models Yanai Elazar Nora Kassner Shauli Ravfogel Abhilasha Ravichander Eduard H. Hovy Hinrich Schütze Yoav Goldberg HILM 258 346 0 01 Feb 2021
Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Models Nora Kassner Philipp Dufter Hinrich Schütze 21 132 0 01 Feb 2021
CoCoLM: COmplex COmmonsense Enhanced Language Model with Discourse Relations Changlong Yu Hongming Zhang Yangqiu Song Wilfred Ng 54 21 0 31 Dec 2020
ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learning Yujia Qin Yankai Lin Ryuichi Takanobu Zhiyuan Liu Peng Li Heng Ji Minlie Huang Maosong Sun Jie Zhou 38 125 0 30 Dec 2020
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training Peng Shi Patrick K. L. Ng Zhiguo Wang Henghui Zhu Alexander Hanbo Li Jun Wang Cicero Nogueira dos Santos Bing Xiang 15 117 0 18 Dec 2020
KgPLM: Knowledge-guided Language Model Pre-training via Generative and Discriminative Learning Bin He Xin Jiang Jinghui Xiao Qun Liu 27 18 0 07 Dec 2020
CPM: A Large-scale Generative Chinese Pre-trained Language Model Zhengyan Zhang Xu Han Hao Zhou Pei Ke Yuxian Gu ... Wentao Han Jie Tang Juan-Zi Li Xiaoyan Zhu Maosong Sun 10 113 0 01 Dec 2020
Pre-training Text-to-Text Transformers for Concept-centric Common Sense Wangchunshu Zhou Dong-Ho Lee Ravi Kiran Selvam Seyeon Lee Bill Yuchen Lin Xiang Ren LRM VLM 6 71 0 24 Oct 2020
Technical Question Answering across Tasks and Domains W. Yu Lingfei Wu Yu Deng Qingkai Zeng R. Mahindru S. Guven Meng-Long Jiang 18 8 0 19 Oct 2020
A Survey of Knowledge-Enhanced Text Generation Wenhao Yu Chenguang Zhu Zaitang Li Zhiting Hu Qingyun Wang Heng Ji Meng-Long Jiang 21 278 0 09 Oct 2020
Infusing Disease Knowledge into BERT for Health Question Answering, Medical Inference and Disease Name Recognition Yun He Ziwei Zhu Yin Zhang Qin Chen James Caverlee AI4MH 22 108 0 08 Oct 2020
LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attention Ikuya Yamada Akari Asai Hiroyuki Shindo Hideaki Takeda Yuji Matsumoto 22 662 0 02 Oct 2020
JAKET: Joint Pre-training of Knowledge Graph and Language Understanding Donghan Yu Chenguang Zhu Yiming Yang Michael Zeng KELM 11 142 0 02 Oct 2020
Understanding tables with intermediate pre-training Julian Martin Eisenschlos Syrine Krichene Thomas Müller LMTD 13 119 0 01 Oct 2020
CokeBERT: Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models Yusheng Su Xu Han Zhengyan Zhang Peng Li Zhiyuan Liu Yankai Lin Jie Zhou Maosong Sun ODL 18 24 0 29 Sep 2020
Learning Knowledge Bases with Parameters for Task-Oriented Dialogue Systems Andrea Madotto Samuel Cahyawijaya Genta Indra Winata Yan Xu Zihan Liu Zhaojiang Lin Pascale Fung 34 59 0 28 Sep 2020
Message Passing for Hyper-Relational Knowledge Graphs Mikhail Galkin Priyansh Trivedi Gaurav Maheshwari Ricardo Usbeck Jens Lehmann 27 113 0 22 Sep 2020
Preserving Integrity in Online Social Networks A. Halevy Cristian Canton Ferrer Hao Ma Umut Ozertem Patrick Pantel Marzieh Saeidi Fabrizio Silvestri Ves Stoyanov 17 57 0 22 Sep 2020
Language Models as Knowledge Bases: On Entity Representations, Storage Capacity, and Paraphrased Queries Benjamin Heinzerling Kentaro Inui KELM 8 128 0 20 Aug 2020
ConvBERT: Improving BERT with Span-based Dynamic Convolution Zihang Jiang Weihao Yu Daquan Zhou Yunpeng Chen Jiashi Feng Shuicheng Yan 30 156 0 06 Aug 2020
Self-supervised Learning: Generative or Contrastive Xiao Liu Fanjin Zhang Zhenyu Hou Zhaoyu Wang Li Mian Jing Zhang Jie Tang SSL 24 1,586 0 15 Jun 2020
Auxiliary Signal-Guided Knowledge Encoder-Decoder for Medical Report Generation Mingjie Li Fuyu Wang Xiaojun Chang Xiaodan Liang MedIm 13 101 0 06 Jun 2020
Commonsense Evidence Generation and Injection in Reading Comprehension Ye Liu Tao Yang Zeyu You Wei Fan Philip S. Yu 25 14 0 11 May 2020
Interpretable Entity Representations through Large-Scale Typing Yasumasa Onoe Greg Durrett 6 20 0 30 Apr 2020
Progressively Pretrained Dense Corpus Index for Open-Domain Question Answering Wenhan Xiong Hong Wang W. Wang RALM 15 17 0 30 Apr 2020
Entities as Experts: Sparse Memory Access with Entity Supervision Thibault Févry Livio Baldini Soares Nicholas FitzGerald Eunsol Choi Tom Kwiatkowski RALM 23 151 0 15 Apr 2020
Pre-trained Models for Natural Language Processing: A Survey Xipeng Qiu Tianxiang Sun Yige Xu Yunfan Shao Ning Dai Xuanjing Huang LM&MA VLM 241 1,450 0 18 Mar 2020
KEML: A Knowledge-Enriched Meta-Learning Framework for Lexical Relation Classification Chengyu Wang Minghui Qiu Jun Huang Xiaofeng He VLM KELM 12 12 0 25 Feb 2020
K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapters Ruize Wang Duyu Tang Nan Duan Zhongyu Wei Xuanjing Huang Jianshu Ji Guihong Cao Daxin Jiang Ming Zhou KELM 6 545 0 05 Feb 2020
Integrating Graph Contextualized Knowledge into Pre-trained Language Models Bin He Di Zhou Jinghui Xiao Xin jiang Qun Liu Nicholas Jing Yuan Tong Bill Xu AI4CE 8 77 0 30 Nov 2019
KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation Xiaozhi Wang Tianyu Gao Zhaocheng Zhu Zhengyan Zhang Zhiyuan Liu Juan-Zi Li Jian Tang 13 645 0 13 Nov 2019
Knowledge Enhanced Contextual Word Representations Matthew E. Peters Mark Neumann IV RobertL.Logan Roy Schwartz Vidur Joshi Sameer Singh Noah A. Smith 224 656 0 09 Sep 2019
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 406 2,584 0 03 Sep 2019
GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Jinpeng Wang Amanpreet Singh Julian Michael Felix Hill Omer Levy Samuel R. Bowman ELM 294 6,950 0 20 Apr 2018