Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model

20 December 2019

Papers citing "Pretrained Encyclopedia: Weakly Supervised Knowledge-Pretrained Language Model"

50 / 134 papers shown

Title
Towards Effective Time-Aware Language Representation: Exploring Enhanced Temporal Understanding in Language Models Jiexin Wang Adam Jatowt Yi Cai AI4CE 35 1 0 04 Jun 2024
GraSAME: Injecting Token-Level Structural Information to Pretrained Language Models via Graph-guided Self-Attention Mechanism Shuzhou Yuan Michael Farber 27 2 0 10 Apr 2024
EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphs Cheng Jiayang Lin Qiu Chunkit Chan Xin Liu Yangqiu Song Zheng-Wei Zhang 36 9 0 30 Mar 2024
TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models Junbing Yan Chengyu Wang Taolin Zhang Xiao-Mei He Junyuan Huang Longtao Huang Hui Xue Wei Zhang VLM KELM 22 0 0 17 Mar 2024
Take Care of Your Prompt Bias! Investigating and Mitigating Prompt Bias in Factual Knowledge Extraction Ziyang Xu Keqin Peng Liang Ding Dacheng Tao Xiliang Lu 32 10 0 15 Mar 2024
A Knowledge-Injected Curriculum Pretraining Framework for Question Answering Xin Lin Tianhuang Su Zhenya Huang Shangzi Xue Haifeng Liu Enhong Chen 23 1 0 11 Mar 2024
Large Language Models Can Better Understand Knowledge Graphs Than We Thought Xinbang Dai Yuncheng Hua Tongtong Wu Yang Sheng Qiu Ji Guilin Qi 75 0 0 18 Feb 2024
Temporal Blind Spots in Large Language Models Jonas Wallat Adam Jatowt Avishek Anand 36 3 0 22 Jan 2024
Synergizing Machine Learning & Symbolic Methods: A Survey on Hybrid Approaches to Natural Language Processing Rrubaa Panchendrarajan A. Zubiaga 23 7 0 22 Jan 2024
ConcEPT: Concept-Enhanced Pre-Training for Language Models Xintao Wang Zhouhong Gu Jiaqing Liang Dakuan Lu Yanghua Xiao Wei Wang 29 1 0 11 Jan 2024
Large Knowledge Model: Perspectives and Challenges Huajun Chen KELM 45 8 0 05 Dec 2023
Increasing Coverage and Precision of Textual Information in Multilingual Knowledge Graphs Simone Conia Min Li Daniel Lee U. F. Minhas Ihab F. Ilyas Yunyao Li 65 8 0 27 Nov 2023
KTRL+F: Knowledge-Augmented In-Document Search Hanseok Oh Haebin Shin Miyoung Ko Hyunji Lee Minjoon Seo 14 3 0 14 Nov 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models Paul Youssef Osman Alperen Koracs Meijie Li Jorg Schlotterer Christin Seifert KELM 24 16 0 25 Oct 2023
Impact of Co-occurrence on Factual Knowledge of Large Language Models Cheongwoong Kang Jaesik Choi KELM 21 17 0 12 Oct 2023
TransPrompt v2: A Transferable Prompting Framework for Cross-task Text Classification J. Wang Chengyu Wang Cen Chen Ming Gao Jun Huang Aoying Zhou VLM 17 0 0 29 Aug 2023
InfoSync: Information Synchronization across Multilingual Semi-structured Tables Siddharth Khincha Chelsi Jain Vivek Gupta Tushar Kataria Shuo Zhang SyDa 20 2 0 06 Jul 2023
Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step Liunian Harold Li Jack Hessel Youngjae Yu Xiang Ren Kai-Wei Chang Yejin Choi LRM AI4CE ReLM 22 128 0 24 Jun 2023
Exploring New Frontiers in Agricultural NLP: Investigating the Potential of Large Language Models for Food Applications Saed Rezayi Zheng Liu Zihao Wu Chandra Dhakal Bao Ge ... Gengchen Mai Ninghao Liu Chen Zhen Tianming Liu Sheng R. Li 24 31 0 20 Jun 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 18 84 0 20 Jun 2023
Unifying Large Language Models and Knowledge Graphs: A Roadmap Shirui Pan Linhao Luo Yufei Wang Chen Chen Jiapu Wang Xindong Wu KELM 30 713 0 14 Jun 2023
Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models Memories Shizhe Diao Tianyang Xu Ruijia Xu Jiawei Wang Tong Zhang MoE AI4CE 11 36 0 08 Jun 2023
Commonsense Knowledge Transfer for Pre-trained Language Models Wangchunshu Zhou Ronan Le Bras Yejin Choi KELM LRM 11 4 0 04 Jun 2023
Plug-and-Play Knowledge Injection for Pre-trained Language Models Zhengyan Zhang Zhiyuan Zeng Yankai Lin Huadong Wang Deming Ye ... Xu Han Zhiyuan Liu Peng Li Maosong Sun Jie Zhou KELM 36 10 0 28 May 2023
Weakly-Supervised Speech Pre-training: A Case Study on Target Speech Recognition Wangyou Zhang Y. Qian 38 10 0 25 May 2023
Free Lunch for Efficient Textual Commonsense Integration in Language Models Wanyun Cui Xingran Chen 27 3 0 24 May 2023
Pre-training Language Models for Comparative Reasoning Mengxia Yu Zhihan Zhang Wenhao Yu Meng-Long Jiang LRM 19 9 0 23 May 2023
PTGB: Pre-Train Graph Neural Networks for Brain Network Analysis Yi Yang Hejie Cui Carl Yang 27 18 0 20 May 2023
Adapter-TST: A Parameter Efficient Method for Multiple-Attribute Text Style Transfer Zhiqiang Hu Roy Ka-Wei Lee Nancy F. Chen 19 2 0 10 May 2023
KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness Yichuan Li Jialong Han Kyumin Lee Chengyuan Ma S. Sarkar Derek Liu VLM KELM 25 0 0 02 May 2023
UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models Deming Ye Yankai Lin Zhengyan Zhang Maosong Sun KELM 11 0 0 02 May 2023
ArK: Augmented Reality with Knowledge Interactive Emergent Ability Qiuyuan Huang J. Park Abhinav Gupta Paul N. Bennett Ran Gong ... Baolin Peng O. Mohammed C. Pal Yejin Choi Jianfeng Gao 73 6 0 01 May 2023
NeuralKG-ind: A Python Library for Inductive Knowledge Graph Representation Learning Wen Zhang Zhen Yao Mingyang Chen Zhiwei Huang Hua-zeng Chen AI4CE 31 2 0 28 Apr 2023
AGI for Agriculture Guoyu Lu Sheng R. Li Gengchen Mai Jin Sun Dajiang Zhu ... R. Xu Daniel Petti Changying Li Tianming Liu Changying Li AI4CE 40 17 0 12 Apr 2023
The Life Cycle of Knowledge in Big Language Models: A Survey Boxi Cao Hongyu Lin Xianpei Han Le Sun KELM 26 27 0 14 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 15 41 0 10 Mar 2023
KILM: Knowledge Injection into Encoder-Decoder Language Models Yan Xu Mahdi Namazifar Devamanyu Hazarika Aishwarya Padmakumar Yang Liu Dilek Z. Hakkani-Tür KELM 22 26 0 17 Feb 2023
Entity-Agnostic Representation Learning for Parameter-Efficient Knowledge Graph Embedding Mingyang Chen Wen Zhang Zhen Yao Yushan Zhu Yang Gao Jeff Z. Pan Hua-zeng Chen 28 10 0 03 Feb 2023
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 24 3 0 27 Dec 2022
Automaton-Based Representations of Task Knowledge from Generative Language Models Yunhao Yang Jean-Raphael Gaglione Cyrus Neary Ufuk Topcu 27 11 0 04 Dec 2022
Leveraging Data Recasting to Enhance Tabular Reasoning Aashna Jena Vivek Gupta Manish Shrivastava Julian Martin Eisenschlos LMTD 14 6 0 23 Nov 2022
A Universal Discriminator for Zero-Shot Generalization Haike Xu Zongyu Lin Jing Zhou Yanan Zheng Zhilin Yang AI4CE 13 14 0 15 Nov 2022
A Survey of Knowledge Enhanced Pre-trained Language Models Linmei Hu Zeyi Liu Ziwang Zhao Lei Hou Liqiang Nie Juanzi Li KELM VLM 17 121 0 11 Nov 2022
Detecting Euphemisms with Literal Descriptions and Visual Imagery .Ilker Kesen Aykut Erdem Erkut Erdem Iacer Calixto 16 4 0 08 Nov 2022
Realistic Data Augmentation Framework for Enhancing Tabular Reasoning D. K. Santhosh Kumar Vivek Gupta Soumya Sharma Shuo Zhang LMTD 11 3 0 23 Oct 2022
Language Model Pre-Training with Sparse Latent Typing Liliang Ren Zixuan Zhang H. Wang Clare R. Voss Chengxiang Zhai Heng Ji 40 3 0 23 Oct 2022
Enhancing Tabular Reasoning with Pattern Exploiting Training Abhilash Shankarampeta Vivek Gupta Shuo Zhang LMTD RALM ReLM 58 6 0 21 Oct 2022
Pre-training Language Models with Deterministic Factual Knowledge Shaobo Li Xiaoguang Li Lifeng Shang Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 36 11 0 20 Oct 2022
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning Hongqiu Wu Ruixue Ding Haizhen Zhao Boli Chen Pengjun Xie Fei Huang Min Zhang MoMe 22 8 0 19 Oct 2022
Deep Bidirectional Language-Knowledge Graph Pretraining Michihiro Yasunaga Antoine Bosselut Hongyu Ren Xikun Zhang Christopher D. Manning Percy Liang J. Leskovec 15 193 0 17 Oct 2022