How Context Affects Language Models' Factual Predictions

10 May 2020

Patrick Lewis

Papers citing "How Context Affects Language Models' Factual Predictions"

50 / 161 papers shown

Title
Repeat After Me: Transformers are Better than State Space Models at Copying Samy Jelassi David Brandfonbrener Sham Kakade Eran Malach 205 114 0 01 Feb 2024
Comparing Traditional and LLM-based Search for Image Geolocation Albatool Wazzan Stephen MacNeil Richard Souvenir 82 19 0 18 Jan 2024
See the Unseen: Better Context-Consistent Knowledge-Editing by Noises Youcheng Huang Wenqiang Lei Zheng Zhang Jiancheng Lv Shuicheng Yan KELM 87 6 0 15 Jan 2024
Strings from the Library of Babel: Random Sampling as a Strong Baseline for Prompt Optimisation Yao Lu Jiayi Wang Raphael Tang Sebastian Riedel Pontus Stenetorp 79 3 0 16 Nov 2023
Defining a New NLP Playground Sha Li Chi Han Pengfei Yu Carl Edwards Pengfei Yu ... Yi R. Fung Charles Yu Joel R. Tetreault Eduard H. Hovy Heng Ji 171 5 0 31 Oct 2023
Evaluating the Knowledge Base Completion Potential of GPT Blerta Veseli Simon Razniewski Jan-Christoph Kalo Gerhard Weikum KELM ELM 113 9 0 23 Oct 2023
Do Large Language Models Know about Facts? Xuming Hu Junzhe Chen Xiaochuan Li Yingxin Lai Lijie Wen Philip S. Yu Zhijiang Guo HILM KELM 112 58 0 08 Oct 2023
Making Retrieval-Augmented Language Models Robust to Irrelevant Context Ori Yoran Tomer Wolfson Ori Ram Jonathan Berant RALM LRM 148 243 0 02 Oct 2023
Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaboration Qiushi Sun Zhangyue Yin Xiang Li Zhiyong Wu Xipeng Qiu Lingpeng Kong LRM LLMAG 145 59 0 30 Sep 2023
Pop Quiz! Do Pre-trained Code Models Possess Knowledge of Correct API Names? Terry Yue Zhuo Xiaoning Du Zhenchang Xing Jiamou Sun Haowei Quan Li Li Liming Zhu 77 2 0 14 Sep 2023
Do PLMs Know and Understand Ontological Knowledge? Weiqi Wu Chengyue Jiang Yong Jiang Pengjun Xie Kewei Tu 113 31 0 12 Sep 2023
Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neurons Yuheng Chen Pengfei Cao Yubo Chen Kang Liu Jun Zhao KELM 148 51 0 25 Aug 2023
Large Language Models and Knowledge Graphs: Opportunities and Challenges Jeff Z. Pan Simon Razniewski Jan-Christoph Kalo Sneha Singhania Jiaoyan Chen ... Gerard de Melo A. Bonifati Edlira Vakaj M. Dragoni D. Graux KELM 121 88 0 11 Aug 2023
LLMs4OL: Large Language Models for Ontology Learning Hamed Babaei Giglou Jennifer D'Souza Sören Auer 81 96 0 31 Jul 2023
When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities Jin Chen Zheng Liu Xunpeng Huang Chenwang Wu Qi Liu ... Yuxuan Lei Xiaolong Chen Xingmei Wang Defu Lian Enhong Chen ALM 134 174 0 31 Jul 2023
Lost in the Middle: How Language Models Use Long Contexts Nelson F. Liu Kevin Lin John Hewitt Ashwin Paranjape Michele Bevilacqua Fabio Petroni Percy Liang RALM 247 1,959 0 06 Jul 2023
Knowledge Base Completion for Long-Tail Entities Lihu Chen Simon Razniewski Gerhard Weikum KELM 96 7 0 30 Jun 2023
Boosting Language Models Reasoning with Chain-of-Knowledge Prompting Jiadong Wang Qiushi Sun Xiang Li Ming Gao ReLM LRM 123 80 0 10 Jun 2023
Large Language Models, scientific knowledge and factuality: A systematic analysis in antibiotic discovery Magdalena Wysocka Oskar Wysocki Maxime Delmas V. Mutel André Freitas LM&MA 99 5 0 28 May 2023
Detecting Edit Failures In Large Language Models: An Improved Specificity Benchmark J. Hoelscher-Obermaier Julia Persson Esben Kran Ioannis Konstas Fazl Barez KELM 150 64 0 27 May 2023
PESCO: Prompt-enhanced Self Contrastive Learning for Zero-shot Text Classification Yau-Shian Wang Ta-Chung Chi Ruohong Zhang Yiming Yang VLM 74 14 0 24 May 2023
Language Models with Rationality Nora Kassner Oyvind Tafjord Ashish Sabharwal Kyle Richardson Hinrich Schütze Peter Clark ReLM KELM LRM 152 19 0 23 May 2023
Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts Jian Xie Kai Zhang Jiangjie Chen Renze Lou Yu-Chuan Su RALM 453 204 0 22 May 2023
Quantifying Association Capabilities of Large Language Models and Its Implications on Privacy Leakage Hanyin Shao Jie Huang Shen Zheng Kevin Chen-Chuan Chang PILM 83 32 0 22 May 2023
Text2Cohort: Facilitating Intuitive Access to Biomedical Data with Natural Language Cohort Discovery Pranav Kulkarni Adway U. Kanhere Paul H. Yi Vishwa S. Parekh 64 0 0 12 May 2023
RECKONING: Reasoning through Dynamic Knowledge Encoding Zeming Chen Gail Weiss E. Mitchell Asli Celikyilmaz Antoine Bosselut KELM LRM 153 14 0 10 May 2023
Say What You Mean! Large Language Models Speak Too Positively about Negative Commonsense Knowledge Jiangjie Chen Wei Shi Ziquan Fu Sijie Cheng Lei Li Yanghua Xiao 119 54 0 10 May 2023
An Evaluation on Large Language Model Outputs: Discourse and Memorization Adrian de Wynter Xun Wang Alex Sokolov Qilong Gu Si-Qing Chen ELM 157 38 0 17 Apr 2023
Geotechnical Parrot Tales (GPT): Harnessing Large Language Models in geotechnical engineering Krishna Kumar LLMAG AI4CE 56 18 0 04 Apr 2023
Unsupervised Improvement of Factual Knowledge in Language Models Nafis Sadeq Byungkyu Kang Prarit Lamba Julian McAuley KELM 98 8 0 04 Apr 2023
Large Language Models and Simple, Stupid Bugs Kevin Jesse Toufique Ahmed Prem Devanbu Emily Morgan ELM 142 67 0 20 Mar 2023
Evaluating Language Models for Knowledge Base Completion Blerta Veseli Sneha Singhania Simon Razniewski Gerhard Weikum ALM 111 23 0 20 Mar 2023
An Overview on Language Models: Recent Developments and Outlook Chengwei Wei Yun Cheng Wang Bin Wang C.-C. Jay Kuo 125 48 0 10 Mar 2023
Dynamic Benchmarking of Masked Language Models on Temporal Concept Drift with Multiple Views Katerina Margatina Shuai Wang Yogarshi Vyas Neha Ann John Yassine Benajiba Miguel Ballesteros 87 22 0 23 Feb 2023
Learning to Initialize: Can Meta Learning Improve Cross-task Generalization in Prompt Tuning? Chengwei Qin Cunliang Kong Ruochen Zhao Shafiq Joty VLM LRM 152 16 0 16 Feb 2023
You Truly Understand What I Need: Intellectual and Friendly Dialogue Agents grounding Knowledge and Persona J. Lim Myunghoon Kang Yuna Hur Seung-Ju Jung Jinsung Kim ... Dongyub Lee Hyesung Ji Donghoon Shin Seung Wook Kim Heu-Jeoung Lim HILM 100 8 0 06 Jan 2023
The KITMUS Test: Evaluating Knowledge Integration from Multiple Sources in Natural Language Understanding Systems Akshatha Arodi Martin Pömsl Kaheer Suleman Adam Trischler Alexandra Olteanu Jackie C.K. Cheung ELM 84 5 0 15 Dec 2022
Context Variance Evaluation of Pretrained Language Models for Prompt-based Biomedical Knowledge Probing Zonghai Yao Yi Cao Zhichao Yang Hong-ye Yu 127 17 0 18 Nov 2022
Large Language Models Struggle to Learn Long-Tail Knowledge Nikhil Kandpal H. Deng Adam Roberts Eric Wallace Colin Raffel RALM KELM 242 455 0 15 Nov 2022
Large Language Models with Controllable Working Memory Daliang Li A. S. Rawat Manzil Zaheer Xin Wang Michal Lukasik Andreas Veit Felix X. Yu Surinder Kumar KELM 178 179 0 09 Nov 2022
Exemplar Guided Deep Neural Network for Spatial Transcriptomics Analysis of Gene Expression Prediction Yan Yang Md Zakir Hossain Eric A. Stone Shafin Rahman AI4TS 74 24 0 30 Oct 2022
IELM: An Open Information Extraction Benchmark for Pre-Trained Language Models Chenguang Wang Xiao Liu Dawn Song VLM 52 2 0 25 Oct 2022
Different Tunes Played with Equal Skill: Exploring a Unified Optimization Subspace for Delta Tuning Jing Yi Weize Chen Yujia Qin Yankai Lin Ning Ding Xu Han Zhiyuan Liu Maosong Sun Jie Zhou 129 2 0 24 Oct 2022
Revision Transformers: Instructing Language Models to Change their Values Felix Friedrich Wolfgang Stammer P. Schramowski Kristian Kersting KELM 106 9 0 19 Oct 2022
Extracting Cultural Commonsense Knowledge at Scale Shrestha Ghosh Simon Razniewski A. Varde Gerhard Weikum 159 70 0 14 Oct 2022
Mass-Editing Memory in a Transformer Kevin Meng Arnab Sen Sharma A. Andonian Yonatan Belinkov David Bau KELM VLM 241 663 0 13 Oct 2022
Mind's Eye: Grounded Language Model Reasoning through Simulation Ruibo Liu Jason W. Wei S. Gu Te-Yen Wu Soroush Vosoughi Claire Cui Denny Zhou Andrew M. Dai ReLM LRM 268 85 0 11 Oct 2022
Best Prompts for Text-to-Image Models and How to Find Them Nikita Pavlichenko Dmitry Ustalov DiffM 153 69 0 23 Sep 2022
Extracting Biomedical Factual Knowledge Using Pretrained Language Model and Electronic Health Record Context Zonghai Yao Yi Cao Zhichao Yang Vijeta Deshpande Hong-ye Yu 234 20 0 26 Aug 2022
A Survey on Open Information Extraction from Rule-based Model to Large Language Model Pai Liu Wenya Gao Wenjie Dong Lin Ai Wen Dong Songfang Huang Zongsheng Li Ehsan Hoque Julia Hirschberg Yue Zhang 203 6 0 18 Aug 2022