Can Generative Pre-trained Language Models Serve as Knowledge Bases for Closed-book QA?

3 June 2021

Yue Zhang

Papers citing "Can Generative Pre-trained Language Models Serve as Knowledge Bases for Closed-book QA?"

50 / 56 papers shown

Title
Harnessing the Unseen: The Hidden Influence of Intrinsic Knowledge in Long-Context Language Models Yu Fu Haz Sameen Shahgir Hui Liu Xianfeng Tang Qi He Yue Dong KELM 52 0 0 11 Apr 2025
WisdomBot: Tuning Large Language Models with Artificial Intelligence Knowledge Jingyuan Chen Tao Wu Wei Ji Fei Wu 46 0 0 22 Jan 2025
Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition Jiyeon Kim Hyunji Lee Hyowon Cho Joel Jang Hyeonbin Hwang Seungpil Won Youbin Ahn Dohaeng Lee Minjoon Seo KELM 125 3 0 02 Oct 2024
Relation Also Knows: Rethinking the Recall and Editing of Factual Associations in Auto-Regressive Transformer Language Models Xiyu Liu Zhengxiao Liu Naibin Gu Zheng-Shen Lin Wanli Ma Ji Xiang Weiping Wang KELM 46 0 0 27 Aug 2024
MEFT: Memory-Efficient Fine-Tuning through Sparse Adapter Jitai Hao Weiwei Sun Xin Xin Qi Meng Zhumin Chen Pengjie Ren Zhaochun Ren MoE 42 2 0 07 Jun 2024
Logical Negation Augmenting and Debiasing for Prompt-based Methods Yitian Li Jidong Tian Hao He Yaohui Jin 38 0 0 08 May 2024
Beyond Memorization: The Challenge of Random Memory Access in Language Models Tongyao Zhu Qian Liu Liang Pang Zhengbao Jiang Min-Yen Kan Min-Bin Lin KELM 37 6 0 12 Mar 2024
Instruction-tuned Language Models are Better Knowledge Learners Zhengbao Jiang Zhiqing Sun Weijia Shi Pedro Rodriguez Chunting Zhou Graham Neubig Xi Lin Wen-tau Yih Srinivasan Iyer KELM 38 34 0 20 Feb 2024
Knowledge Verification to Nip Hallucination in the Bud Fanqi Wan Xinting Huang Leyang Cui Xiaojun Quan Wei Bi Shuming Shi HILM 24 4 0 19 Jan 2024
A Comprehensive Study of Knowledge Editing for Large Language Models Ningyu Zhang Yunzhi Yao Bo Tian Peng Wang Shumin Deng ... Lei Liang Qing Cui Xiao-Jun Zhu Jun Zhou Huajun Chen KELM 47 76 0 02 Jan 2024
The Earth is Flat? Unveiling Factual Errors in Large Language Models Wenxuan Wang Juluan Shi Zhaopeng Tu Youliang Yuan Jen-tse Huang Wenxiang Jiao Michael R. Lyu KELM HILM SyDa 49 1 0 01 Jan 2024
Evaluating Dependencies in Fact Editing for Language Models: Specificity and Implication Awareness Zichao Li Ines Arous Siva Reddy Jackie CK Cheung KELM 24 13 0 04 Dec 2023
A Self-enhancement Approach for Domain-specific Chatbot Training via Knowledge Mining and Digest Ruohong Zhang Luyu Gao Chen Zheng Zhen Fan Guokun Lai Zheng Zhang Fangzhou Ai Yiming Yang Hongxia Yang 51 2 0 17 Nov 2023
How Well Do Large Language Models Truly Ground? Hyunji Lee Se June Joo Chaeeun Kim Joel Jang Doyoung Kim Kyoung-Woon On Minjoon Seo HILM 33 6 0 15 Nov 2023
Post Turing: Mapping the landscape of LLM Evaluation Alexey Tikhonov Ivan P. Yamshchikov ELM 51 4 0 03 Nov 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models Paul Youssef Osman Alperen Koracs Meijie Li Jorg Schlotterer Christin Seifert KELM 24 16 0 25 Oct 2023
Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity Cunxiang Wang Xiaoze Liu Yuanhao Yue Xiangru Tang Tianhang Zhang ... Linyi Yang Jindong Wang Xing Xie Zheng-Wei Zhang Yue Zhang HILM KELM 51 184 0 11 Oct 2023
Towards Mitigating Hallucination in Large Language Models via Self-Reflection Ziwei Ji Tiezheng Yu Yan Xu Nayeon Lee Etsuko Ishii Pascale Fung HILM 11 57 0 10 Oct 2023
Anonymity at Risk? Assessing Re-Identification Capabilities of Large Language Models Alex Nyffenegger Matthias Sturmer Joel Niklaus 34 6 0 22 Aug 2023
When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities Jin Chen Zheng Liu Xunpeng Huang Chenwang Wu Qi Liu ... Yuxuan Lei Xiaolong Chen Xingmei Wang Defu Lian Enhong Chen ALM 32 110 0 31 Jul 2023
KnowPrefix-Tuning: A Two-Stage Prefix-Tuning Framework for Knowledge-Grounded Dialogue Generation Jiaqi Bai Zhao Yan Jian Yang Xinnian Liang Hongcheng Guo Zhoujun Li 18 9 0 27 Jun 2023
Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modeling Lin F. Yang Hongyang Chen Zhao Li Xiao Ding Xindong Wu KELM 29 87 0 20 Jun 2023
PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning Optimization Yidong Wang Zhuohao Yu Zhengran Zeng Linyi Yang Cunxiang Wang ... Jindong Wang Xingxu Xie Wei Ye Shi-Bo Zhang Yue Zhang ALM ELM 51 227 0 08 Jun 2023
Integrating Action Knowledge and LLMs for Task Planning and Situation Handling in Open Worlds Yan Ding Xiaohan Zhang S. Amiri Nieqing Cao Hao Yang Andy Kaminski Chad Esselink Shiqi Zhang LM&Ro 37 49 0 27 May 2023
Exploiting Abstract Meaning Representation for Open-Domain Question Answering Cunxiang Wang Zhikun Xu Qipeng Guo Xiangkun Hu Xuefeng Bai Zheng-Wei Zhang Yue Zhang 23 3 0 26 May 2023
RFiD: Towards Rational Fusion-in-Decoder for Open-Domain Question Answering Cunxiang Wang Hao Yu Yue Zhang 21 9 0 26 May 2023
Measuring the Knowledge Acquisition-Utilization Gap in Pretrained Language Models Amirhossein Kazemnejad Mehdi Rezagholizadeh Prasanna Parthasarathi Sarath Chandar ELM 27 2 0 24 May 2023
Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts Jian Xie Kai Zhang Jiangjie Chen Renze Lou Yu-Chuan Su RALM 214 156 0 22 May 2023
Evaluating Open-QA Evaluation Cunxiang Wang Sirui Cheng Qipeng Guo Yuanhao Yue Bowen Ding Zhikun Xu Yidong Wang Xiangkun Hu Zheng Zhang Yue Zhang ELM 34 29 0 21 May 2023
Learning to Generalize for Cross-domain QA Yingjie Niu Linyi Yang Ruihai Dong Yue Zhang 21 6 0 14 May 2023
Distinguish Before Answer: Generating Contrastive Explanation as Knowledge for Commonsense Question Answering Qianglong Chen Guohai Xu Mingshi Yan Ji Zhang Fei Huang Luo Si Yin Zhang 21 9 0 14 May 2023
TegFormer: Topic-to-Essay Generation with Good Topic Coverage and High Text Coherence Wang Qi R. Liu Y. Zuo Yong Chen Dell Zhang 21 0 0 27 Dec 2022
A Survey on Knowledge-Enhanced Pre-trained Language Models Chaoqi Zhen Yanlei Shang Xiangyu Liu Yifei Li Yong Chen Dell Zhang VLM KELM 32 3 0 27 Dec 2022
Language Model Pre-training on True Negatives Zhuosheng Zhang Hai Zhao Masao Utiyama Eiichiro Sumita 34 2 0 01 Dec 2022
Eliciting Knowledge from Large Pre-Trained Models for Unsupervised Knowledge-Grounded Conversation Yanyang Li Jianqiao Zhao M. Lyu Liwei Wang 21 15 0 03 Nov 2022
Pre-training Language Models with Deterministic Factual Knowledge Shaobo Li Xiaoguang Li Lifeng Shang Chengjie Sun Bingquan Liu Zhenzhou Ji Xin Jiang Qun Liu KELM 47 11 0 20 Oct 2022
Closed-book Question Generation via Contrastive Learning Xiangjue Dong Jiaying Lu Jianling Wang James Caverlee 37 8 0 13 Oct 2022
Artificial Intelligence and Natural Language Processing and Understanding in Space: A Methodological Framework and Four ESA Case Studies José Manuél Gómez-Pérez Andrés García-Silva R. Leone M. Albani Moritz Fontaine C. Poncet L. Summerer A. Donati Ilaria Roma Stefano Scaglioni 16 1 0 07 Oct 2022
A Unified Encoder-Decoder Framework with Entity Memory Zhihan Zhang W. Yu Chenguang Zhu Meng Jiang 39 11 0 07 Oct 2022
Recitation-Augmented Language Models Zhiqing Sun Xuezhi Wang Yi Tay Yiming Yang Denny Zhou RALM 196 60 0 04 Oct 2022
Robot Task Planning and Situation Handling in Open Worlds Yan Ding Xiaohan Zhang S. Amiri Nieqing Cao Hao Yang Chad Esselink Shiqi Zhang LM&Ro 28 19 0 04 Oct 2022
OPERA: Harmonizing Task-Oriented Dialogs and Information Seeking Experience Miaoran Li Baolin Peng Jianfeng Gao Zhu Zhang 69 9 0 24 Jun 2022
Towards Answering Open-ended Ethical Quandary Questions Yejin Bang Nayeon Lee Tiezheng Yu Leila Khalatbari Yan Xu ... Romain Barraud Elham J. Barezi Andrea Madotto Hayden Kee Pascale Fung ELM 32 6 0 12 May 2022
ProQA: Structural Prompt-based Pre-training for Unified Question Answering Wanjun Zhong Yifan Gao Ning Ding Yujia Qin Zhiyuan Liu Ming Zhou Jiahai Wang Jian Yin Nan Duan 17 34 0 09 May 2022
WikiOmnia: generative QA corpus on the whole Russian Wikipedia D. Pisarevskaya Tatiana Shavrina 18 2 0 17 Apr 2022
Knowledgeable Salient Span Mask for Enhancing Language Models as Knowledge Base Cunxiang Wang Fuli Luo Yanyang Li Runxin Xu Fei Huang Yue Zhang KELM 33 2 0 17 Apr 2022
Towards Fine-grained Causal Reasoning and QA Linyi Yang Zhen Wang Yuxiang Wu Jie Yang Yue Zhang 41 15 0 15 Apr 2022
Iteratively Prompt Pre-trained Language Models for Chain of Thought Boshi Wang Xiang Deng Huan Sun KELM ReLM LRM 22 95 0 16 Mar 2022
A Simple but Effective Pluggable Entity Lookup Table for Pre-trained Language Models Deming Ye Yankai Lin Peng Li Maosong Sun Zhiyuan Liu KELM 14 11 0 27 Feb 2022
A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models Da Yin Li Dong Hao Cheng Xiaodong Liu Kai-Wei Chang Furu Wei Jianfeng Gao KELM 27 34 0 17 Feb 2022