When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories

20 December 2022

Daniel Khashabi

Papers citing "When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories"

50 / 395 papers shown

Title
Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models Shuliang Liu Xinze Li Zhenghao Liu Yukun Yan Cheng Yang Zheni Zeng Zhiyuan Liu Maosong Sun Ge Yu RALM 91 1 0 26 Feb 2025
Bián: A Bilingual Benchmark and Model for Hallucination Detection in Retrieval-Augmented Generation Zhouyu Jiang Mengshu Sun Zhiqiang Zhang Lei Liang RALM 3DV 174 0 0 26 Feb 2025
FaithUn: Toward Faithful Forgetting in Language Models by Investigating the Interconnectedness of Knowledge Nakyeong Yang Minsung Kim Seunghyun Yoon Joongbo Shin Kyomin Jung KELM MU 65 0 0 26 Feb 2025
Uncertainty Quantification in Retrieval Augmented Question Answering Laura Perez-Beltrachini Mirella Lapata RALM 43 0 0 25 Feb 2025
RankCoT: Refining Knowledge for Retrieval-Augmented Generation through Ranking Chain-of-Thoughts Mingyan Wu Zhenghao Liu Yukun Yan Xinze Li S. Yu Zheni Zeng Yu Gu Ge Yu RALM AI4TS LRM 52 1 0 25 Feb 2025
LevelRAG: Enhancing Retrieval-Augmented Generation with Multi-hop Logic Planning over Rewriting Augmented Searchers Zhuocheng Zhang Yang Feng Min Zhang 48 1 0 25 Feb 2025
The Lottery LLM Hypothesis, Rethinking What Abilities Should LLM Compression Preserve? Zhenheng Tang Xiang Liu Qian Wang Peijie Dong Bingsheng He Xiaowen Chu Bo Li LRM 53 1 0 24 Feb 2025
Mitigating Bias in RAG: Controlling the Embedder Taeyoun Kim Jacob Mitchell Springer Aditi Raghunathan Maarten Sap 50 1 0 24 Feb 2025
BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models Yupeng Chang Yi-Ju Chang Yuan Wu AI4CE ALM 82 0 0 24 Feb 2025
Adaptive Retrieval Without Self-Knowledge? Bringing Uncertainty Back Home Viktor Moskvoretskii M. Lysyuk Mikhail Salnikov Nikolay Ivanov Sergey Pletenev Daria Galimzianova Nikita Krayko Vasily Konovalov Irina Nikishina Alexander Panchenko RALM 74 4 0 24 Feb 2025
KVLink: Accelerating Large Language Models via Efficient KV Cache Reuse Jingbo Yang Bairu Hou Wei Wei Yujia Bao Shiyu Chang VLM 41 2 0 21 Feb 2025
Reliability Across Parametric and External Knowledge: Understanding Knowledge Handling in LLMs Youna Kim Minjoon Choi Sungmin Cho Hyuhng Joon Kim Sang-goo Lee Taeuk Kim KELM 56 0 0 20 Feb 2025
Oreo: A Plug-in Context Reconstructor to Enhance Retrieval-Augmented Generation Sha Li Naren Ramakrishnan RALM KELM 149 1 0 18 Feb 2025
Revisiting Robust RAG: Do We Still Need Complex Robust Training in the Era of Powerful LLMs? Hanxing Ding Shuchang Tao Liang Pang Zihao Wei Liwei Chen Kun Xu Huawei Shen Xueqi Cheng 31 0 0 17 Feb 2025
Fast or Better? Balancing Accuracy and Cost in Retrieval-Augmented Generation with Flexible User Control Jinyan Su Jennifer Healey Preslav Nakov Claire Cardie 3DV 54 1 0 17 Feb 2025
RAS: Retrieval-And-Structuring for Knowledge-Intensive LLM Generation Pengcheng Jiang Lang Cao Ruike Zhu Minhao Jiang Yunyi Zhang J. Sun J. Han RALM 77 0 0 16 Feb 2025
Valuable Hallucinations: Realizable Non-realistic Propositions Qiucheng Chen Bo Wang LRM 54 0 0 16 Feb 2025
Musical Heritage Historical Entity Linking Arianna Graciotti Nicolas Lazzari Valentina Presutti Rocco Tripodi 60 0 0 13 Feb 2025
C-3PO: Compact Plug-and-Play Proxy Optimization to Achieve Human-like Retrieval-Augmented Generation Guoxin Chen Minpeng Liao Peiying Yu Dingmin Wang Zile Qiao Chao Yang Xin Zhao Kai Fan 58 1 0 10 Feb 2025
Self-Training Large Language Models for Tool-Use Without Demonstrations Ne Luo Aryo Pradipta Gema Xuanli He Emile van Krieken Pietro Lesci Pasquale Minervini LLMAG 64 1 0 09 Feb 2025
IAO Prompting: Making Knowledge Flow Explicit in LLMs through Structured Reasoning Templates Aissatou Diallo Antonis Bikakis Luke Dickens Anthony Hunter Rob Miller LRM 34 0 0 05 Feb 2025
SelfCheckAgent: Zero-Resource Hallucination Detection in Generative Large Language Models Diyana Muhammed Gollam Rabby Sören Auer LLMAG HILM 76 0 0 03 Feb 2025
Vision-centric Token Compression in Large Language Model Ling Xing Alex Jinpeng Wang Rui Yan J. Tang VLM 60 0 0 02 Feb 2025
LLMs as Repositories of Factual Knowledge: Limitations and Solutions Seyed Mahed Mousavi Simone Alghisi Giuseppe Riccardi KELM 47 0 0 22 Jan 2025
Parallel Key-Value Cache Fusion for Position Invariant RAG Philhoon Oh Jinwoo Shin James Thorne 3DV 98 0 0 13 Jan 2025
Large Language Models, Knowledge Graphs and Search Engines: A Crossroads for Answering Users' Questions Aidan Hogan Xin Luna Dong Denny Vrandečić Gerhard Weikum 50 1 0 12 Jan 2025
Synergistic Multi-Agent Framework with Trajectory Learning for Knowledge-Intensive Tasks Shengbin Yue Siyuan Wang Wei Chen Xuanjing Huang Zhongyu Wei LLMAG 61 9 0 03 Jan 2025
A review of faithfulness metrics for hallucination assessment in Large Language Models Ben Malin Tatiana Kalganova Nikoloas Boulgouris HILM 59 2 0 03 Jan 2025
ComparisonQA: Evaluating Factuality Robustness of LLMs Through Knowledge Frequency Control and Uncertainty Qing Zong Z. Wang Tianshi Zheng Xiyu Ren Y. Song 57 1 0 31 Dec 2024
MINTQA: A Multi-Hop Question Answering Benchmark for Evaluating LLMs on New and Tail Knowledge Jie He Nan Hu Wanqiu Long Jiaoyan Chen Jeff Z. Pan ELM LRM 94 6 0 22 Dec 2024
Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models Zhisong Zhang Yan Wang Xinting Huang Tianqing Fang H. Zhang Chenlong Deng Shuaiyi Li Dong Yu 75 2 0 21 Dec 2024
RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment Zhuoran Jin Hongbang Yuan Tianyi Men Pengfei Cao Yubo Chen Kang-Jun Liu Jun Zhao ALM 82 7 0 18 Dec 2024
EvoWiki: Evaluating LLMs on Evolving Knowledge Wei Tang Yixin Cao Yang Deng Jiahao Ying Bo Wang ... Yuyue Zhao Qi Zhang Xuanjing Huang Yugang Jiang Yong Liao KELM 63 1 0 18 Dec 2024
RetroLLM: Empowering Large Language Models to Retrieve Fine-grained Evidence within Generation X. Li Jiajie Jin Yujia Zhou Yongkang Wu Zhonghua Li Qi Ye Zhicheng Dou RALM LRM 103 5 0 16 Dec 2024
Let your LLM generate a few tokens and you will reduce the need for retrieval Hervé Déjean 78 0 0 16 Dec 2024
SMARTCAL: An Approach to Self-Aware Tool-Use Evaluation and Calibration Yuanhao Shen Xiaodan Zhu L. Chen 79 3 0 11 Dec 2024
Auto-RAG: Autonomous Retrieval-Augmented Generation for Large Language Models Tian Yu Shaolei Zhang Yang Feng RALM 3DV AIFin LRM 74 8 0 29 Nov 2024
Context Awareness Gate For Retrieval Augmented Generation Mohammad Hassan Heydari Arshia Hemmat Erfan Naman Afsaneh Fatemi RALM 86 2 0 25 Nov 2024
Towards Knowledge Checking in Retrieval-augmented Generation: A Representation Perspective Shenglai Zeng Jiankun Zhang Bingheng Li Yuping Lin Tianqi Zheng ... Hui Liu Hui Liu Yue Xing Monica Xiao Cheng Jiliang Tang RALM 66 3 0 21 Nov 2024
Information Anxiety in Large Language Models Prasoon Bajpai Sarah Masud Tanmoy Chakraborty 37 0 0 16 Nov 2024
LLM Hallucination Reasoning with Zero-shot Knowledge Test Seongmin Lee Hsiang Hsu Chun-Fu Chen LRM 39 2 0 14 Nov 2024
Continual Memorization of Factoids in Language Models Howard Chen Jiayi Geng Adithya Bhaskar Dan Friedman Danqi Chen KELM 39 1 0 11 Nov 2024
Fine-Grained Guidance for Retrievers: Leveraging LLMs' Feedback in Retrieval-Augmented Generation Yuhang Liu Xueyu Hu Shengyu Zhang Jingyuan Chen Fan Wu Fei Wu RALM 27 0 0 06 Nov 2024
Human-inspired Perspectives: A Survey on AI Long-term Memory Zihong He Weizhe Lin Hao Zheng Fan Zhang Matt Jones Laurence Aitchison X. Xu Miao Liu Per Ola Kristensson Junxiao Shen 77 2 0 01 Nov 2024
Dynamic Uncertainty Ranking: Enhancing Retrieval-Augmented In-Context Learning for Long-Tail Knowledge in LLMs Shuyang Yu Runxue Bao Parminder Bhatia Taha A. Kass-Hout Jiayu Zhou Cao Xiao 32 1 0 31 Oct 2024
Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations Leonardo Ranaldi Marco Valentino André Freitas RALM LRM 23 4 0 30 Oct 2024
NewTerm: Benchmarking Real-Time New Terms for Large Language Models with Annual Updates Hexuan Deng Wenxiang Jiao Xuebo Liu Min Zhang Zhaopeng Tu 36 2 0 28 Oct 2024
Graph-based Uncertainty Metrics for Long-form Language Model Outputs Mingjian Jiang Yangjun Ruan Prasanna Sattigeri Salim Roukos Tatsunori Hashimoto 18 0 0 28 Oct 2024
Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning Yujian Liu Shiyu Chang Tommi Jaakkola Yang Zhang 23 0 0 25 Oct 2024
ChunkRAG: Novel LLM-Chunk Filtering Method for RAG Systems Ishneet Sukhvinder Singh Ritvik Aggarwal Ibrahim Allahverdiyev Muhammad Taha Aslihan Akalin Kevin Zhu Sean O'Brien 23 8 0 25 Oct 2024