When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories

20 December 2022

Daniel Khashabi

Papers citing "When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories"

50 / 395 papers shown

Title
DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detection Herun Wan Shangbin Feng Zhaoxuan Tan Heng Wang Yulia Tsvetkov Minnan Luo 68 29 0 16 Feb 2024
Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-Evaluation Xiaoying Zhang Baolin Peng Ye Tian Jingyan Zhou Lifeng Jin Linfeng Song Haitao Mi Helen Meng HILM 28 43 0 14 Feb 2024
Prompt Perturbation in Retrieval-Augmented Generation based Large Language Models Zhibo Hu Chen Wang Yanfeng Shu Helen Paik Paik Liming Zhu SILM RALM 37 7 0 11 Feb 2024
Introspective Planning: Aligning Robots' Uncertainty with Inherent Task Ambiguity Kaiqu Liang Zixu Zhang J. F. Fisac LLMAG 33 5 0 09 Feb 2024
An Enhanced Prompt-Based LLM Reasoning Scheme via Knowledge Graph-Integrated Collaboration Yihao Li Ru Zhang Jianyi Liu LRM 55 16 0 07 Feb 2024
On Catastrophic Inheritance of Large Foundation Models Hao Chen Bhiksha Raj Xing Xie Jindong Wang AI4CE 48 12 0 02 Feb 2024
Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaboration Shangbin Feng Weijia Shi Yike Wang Wenxuan Ding Vidhisha Balachandran Yulia Tsvetkov 23 77 0 01 Feb 2024
LLaMP: Large Language Model Made Powerful for High-fidelity Materials Knowledge Retrieval and Distillation Chiang Yuan Elvis Hsieh Chia-Hong Chou Janosh Riebesell 25 10 0 30 Jan 2024
Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens Jiacheng Liu Sewon Min Luke Zettlemoyer Yejin Choi Hannaneh Hajishirzi 38 50 0 30 Jan 2024
Corrective Retrieval Augmented Generation Shi-Qi Yan Jia-Chen Gu Yun Zhu Zhen-Hua Ling RALM 100 71 0 29 Jan 2024
A RAG-based Question Answering System Proposal for Understanding Islam: MufassirQAS LLM Ahmet Yusuf Alan Enis Karaarslan Ömer Aydin 6 1 0 27 Jan 2024
PROXYQA: An Alternative Framework for Evaluating Long-Form Text Generation with Large Language Models Haochen Tan Zhijiang Guo Zhan Shi Lu Xu Zhili Liu ... Xiaoguang Li Yasheng Wang Lifeng Shang Qun Liu Linqi Song 30 12 0 26 Jan 2024
UniMS-RAG: A Unified Multi-source Retrieval-Augmented Generation for Personalized Dialogue Systems Hongru Wang Wenyu Huang Yang Deng Rui Wang Zezhong Wang Yufei Wang Fei Mi Jeff Z. Pan Kam-Fai Wong RALM 39 26 0 24 Jan 2024
Blinded by Generated Contexts: How Language Models Merge Generated and Retrieved Contexts When Knowledge Conflicts? Hexiang Tan Fei Sun Wanli Yang Yuanzhuo Wang Qi Cao Xueqi Cheng 25 11 0 22 Jan 2024
Hallucination is Inevitable: An Innate Limitation of Large Language Models Ziwei Xu Sanjay Jain Mohan S. Kankanhalli HILM LRM 60 205 0 22 Jan 2024
JustiLM: Few-shot Justification Generation for Explainable Fact-Checking of Real-world Claims Fengzhu Zeng Wei Gao 34 15 0 16 Jan 2024
Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models Asma Ghandeharioun Avi Caciularu Adam Pearce Lucas Dixon Mor Geva 25 87 0 11 Jan 2024
Risk Taxonomy, Mitigation, and Assessment Benchmarks of Large Language Model Systems Tianyu Cui Yanling Wang Chuanpu Fu Yong Xiao Sijia Li ... Junwu Xiong Xinyu Kong Zujie Wen Ke Xu Qi Li 55 56 0 11 Jan 2024
Narrowing the Knowledge Evaluation Gap: Open-Domain Question Answering with Multi-Granularity Answers G. Yona Roee Aharoni Mor Geva ELM 36 11 0 09 Jan 2024
Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models Matthew Dahl Varun Magesh Mirac Suzgun Daniel E. Ho HILM AILaw 25 72 0 02 Jan 2024
A Comprehensive Study of Knowledge Editing for Large Language Models Ningyu Zhang Yunzhi Yao Bo Tian Peng Wang Shumin Deng ... Lei Liang Zhiqiang Zhang Xiao-Jun Zhu Jun Zhou Huajun Chen KELM 26 76 0 02 Jan 2024
RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models Cheng Niu Yuanhao Wu Juno Zhu Siliang Xu Kashun Shum Randy Zhong Juntong Song Tong Zhang HILM 14 86 0 31 Dec 2023
kNN-ICL: Compositional Task-Oriented Parsing Generalization with Nearest Neighbor In-Context Learning Wenting Zhao Ye Liu Yao Wan Yibo Wang Qingyang Wu Zhongfen Deng Jiangshu Du Shuaiqi Liu Yunlong Xu Philip S. Yu 36 7 0 17 Dec 2023
Alignment for Honesty Yuqing Yang Ethan Chern Xipeng Qiu Graham Neubig Pengfei Liu 28 28 0 12 Dec 2023
Eliciting Latent Knowledge from Quirky Language Models Alex Troy Mallen Madeline Brumley Julia Kharchenko Nora Belrose HILM RALM KELM 16 25 0 02 Dec 2023
Controlling Large Language Model-based Agents for Large-Scale Decision-Making: An Actor-Critic Approach Bin Zhang Hangyu Mao Jingqing Ruan Ying Wen Yang Li ... Dapeng Li Ziyue Li Rui Zhao Lijuan Li Guoliang Fan LM&Ro LLMAG 19 34 0 23 Nov 2023
Minimizing Factual Inconsistency and Hallucination in Large Language Models Muneeswaran Irulandi Shreya Saxena Siva Prasad M. V. Sai Prakash Advaith Shankar V. Varun Vishal Vaddina Saisubramaniam Gopalakrishnan HILM 27 5 0 23 Nov 2023
Unifying Corroborative and Contributive Attributions in Large Language Models Theodora Worledge Judy Hanwen Shen Nicole Meister Caleb Winston Carlos Guestrin TDI 14 10 0 20 Nov 2023
On Retrieval Augmentation and the Limitations of Language Model Training Ting-Rui Chiang Xinyan Velocity Yu Joshua Robinson Ollie Liu Isabelle G. Lee Dani Yogatama RALM 20 0 0 16 Nov 2023
Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Models W. Yu Hongming Zhang Xiaoman Pan Kaixin Ma Hongwei Wang Dong Yu KELM RALM LRM 65 101 0 15 Nov 2023
PEARL: Personalizing Large Language Model Writing Assistants with Generation-Calibrated Retrievers Sheshera Mysore Zhuoran Lu Mengting Wan Longqi Yang Steve Menezes Tina Baghaee Emmanuel Barajas Gonzalez Jennifer Neville Tara Safavi RALM 17 35 0 15 Nov 2023
When does In-context Learning Fall Short and Why? A Study on Specification-Heavy Tasks Hao Peng Xiaozhi Wang Jianhui Chen Weikai Li Y. Qi ... Zhili Wu Kaisheng Zeng Bin Xu Lei Hou Juanzi Li 24 27 0 15 Nov 2023
Thread of Thought Unraveling Chaotic Contexts Yucheng Zhou Xiubo Geng Tao Shen Chongyang Tao Guodong Long Jian-Guang Lou Jianbing Shen LRM 26 39 0 15 Nov 2023
Fine-tuning Language Models for Factuality Katherine Tian Eric Mitchell Huaxiu Yao Christopher D. Manning Chelsea Finn KELM HILM SyDa 17 164 0 14 Nov 2023
Learning to Filter Context for Retrieval-Augmented Generation Zhiruo Wang Jun Araki Zhengbao Jiang Md. Rizwan Parvez Graham Neubig RALM 22 50 0 14 Nov 2023
Can Knowledge Graphs Reduce Hallucinations in LLMs? : A Survey Garima Agrawal Tharindu Kumarage Zeyad Alghami Huanmin Liu 27 81 0 14 Nov 2023
A Step Closer to Comprehensive Answers: Constrained Multi-Stage Question Decomposition with Large Language Models He Cao Zhenwei An Jiazhan Feng Kun Xu Liwei Chen Dongyan Zhao HILM 23 1 0 13 Nov 2023
In Search of the Long-Tail: Systematic Generation of Long-Tail Inferential Knowledge via Logical Rule Guided Search Huihan Li Yuting Ning Zeyi Liao Siyuan Wang Xiang Lorraine Li Ximing Lu Wenting Zhao Faeze Brahman Yejin Choi Xiang Ren LRM 11 1 0 13 Nov 2023
Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications Zhangyin Feng Weitao Ma Weijiang Yu Lei Huang Haotian Wang Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu KELM 21 37 0 10 Nov 2023
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng ... Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin Ting Liu LRM HILM 31 714 0 09 Nov 2023
Characterizing Large Language Models as Rationalizers of Knowledge-intensive Tasks Aditi Mishra Sajjadur Rahman H. Kim Kushan Mitra Estevam R. Hruschka 13 6 0 09 Nov 2023
Evaluating the Effectiveness of Retrieval-Augmented Large Language Models in Scientific Document Reasoning Sai Munikoti Anurag Acharya S. Wagle Sameera Horawalavithana LRM 11 5 0 07 Nov 2023
The Effect of Scaling, Retrieval Augmentation and Form on the Factual Consistency of Language Models Lovisa Hagström Denitsa Saynova Tobias Norlund Moa Johansson Richard Johansson KELM HILM 18 8 0 02 Nov 2023
Predicting Question-Answering Performance of Large Language Models through Semantic Consistency Ella Rabinovich Samuel Ackerman Orna Raz E. Farchi Ateret Anaby-Tavor 211 17 0 02 Nov 2023
DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text Wenting Zhao Ye Liu Tong Niu Yao Wan Philip S. Yu Shafiq R. Joty Yingbo Zhou Semih Yavuz LRM 14 6 0 31 Oct 2023
Give Me the Facts! A Survey on Factual Knowledge Probing in Pre-trained Language Models Paul Youssef Osman Alperen Koracs Meijie Li Jorg Schlotterer Christin Seifert KELM 19 16 0 25 Oct 2023
ALCUNA: Large Language Models Meet New Knowledge Xunjian Yin Baizhou Huang Xiaojun Wan 11 24 0 23 Oct 2023
Evaluating the Knowledge Base Completion Potential of GPT Blerta Veseli Simon Razniewski Jan-Christoph Kalo G. Weikum KELM ELM 24 7 0 23 Oct 2023
Merging Generated and Retrieved Knowledge for Open-Domain QA Yunxiang Zhang Muhammad Khalifa Lajanugen Logeswaran Moontae Lee Honglak Lee Lu Wang RALM 23 37 0 22 Oct 2023
Tuna: Instruction Tuning using Feedback from Large Language Models Haoran Li Yiran Liu Xingxing Zhang Wei Lu Furu Wei ALM 30 3 0 20 Oct 2023