When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories

20 December 2022

Daniel Khashabi

Papers citing "When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories"

50 / 397 papers shown

Title
Teaching Large Language Models to Express Knowledge Boundary from Their Own Signals Lida Chen Zujie Liang Xintao Wang Jiaqing Liang Yanghua Xiao Feng Wei Jinglei Chen Zhenghong Hao Bing Han Wei Wang 50 10 0 16 Jun 2024
DR-RAG: Applying Dynamic Document Relevance to Retrieval-Augmented Generation for Question-Answering Zijian Hei Weiling Liu Wenjie Ou Juyi Qiao Junming Jiao Guowen Song Ting Tian Yi Lin RALM 38 5 0 11 Jun 2024
Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning Joongwon Kim Bhargavi Paranjape Tushar Khot Hannaneh Hajishirzi LM&Ro ELM LLMAG LRM 34 8 0 10 Jun 2024
A Reality check of the benefits of LLM in business Ming Cheung 25 3 0 09 Jun 2024
CRAG -- Comprehensive RAG Benchmark Xiao Yang Kai Sun Hao Xin Yushi Sun Nikita Bhalla ... Nirav Shah Rakesh Wanga Anuj Kumar Wen-tau Yih Xin Luna Dong 18 22 0 07 Jun 2024
Chaos with Keywords: Exposing Large Language Models Sycophantic Hallucination to Misleading Keywords and Evaluating Defense Strategies Aswin Rrv Nemika Tyagi Md Nayem Uddin Neeraj Varshney Chitta Baral 37 0 0 06 Jun 2024
Retaining Key Information under High Compression Ratios: Query-Guided Compressor for LLMs Zhiwei Cao Qian Cao Yu Lu Ningxin Peng Luyang Huang Shanbo Cheng Jinsong Su 40 11 0 04 Jun 2024
Graph Neural Network Enhanced Retrieval for Question Answering of LLMs Zijian Li Qingyan Guo Jiawei Shao Lei Song Jiang Bian Jun Zhang Rui Wang RALM 32 11 0 03 Jun 2024
Unraveling and Mitigating Retriever Inconsistencies in Retrieval-Augmented Large Language Models Mingda Li Xinyu Li Yifan Chen Wenfeng Xuan Weinan Zhang RALM 29 2 0 31 May 2024
ANAH: Analytical Annotation of Hallucinations in Large Language Models Ziwei Ji Yuzhe Gu Wenwei Zhang Chengqi Lyu Dahua Lin Kai-xiang Chen HILM 41 2 0 30 May 2024
Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts Chunjing Gan Dan Yang Binbin Hu Hanxiao Zhang Siyuan Li ... Lin Ju Zhiqiang Zhang Jinjie Gu Lei Liang Jun Zhou 53 9 0 30 May 2024
Dataflow-Guided Retrieval Augmentation for Repository-Level Code Completion Wei Cheng Yuhan Wu Wei Hu 30 10 0 30 May 2024
One Token Can Help! Learning Scalable and Pluggable Virtual Tokens for Retrieval-Augmented Large Language Models Yutao Zhu Zhaoheng Huang Zhicheng Dou Ji-Rong Wen RALM 53 5 0 30 May 2024
CtrlA: Adaptive Retrieval-Augmented Generation via Probe-Guided Control Huanshuo Liu Hao Zhang Zhijiang Guo Kuicai Dong Xiangyang Li Yi Quan Lee Cong Zhang Yong-jin Liu 3DV 31 6 0 29 May 2024
ATM: Adversarial Tuning Multi-agent System Makes a Robust Retrieval-Augmented Generator Junda Zhu Lingyong Yan Haibo Shi Dawei Yin Lei Sha RALM 28 5 0 28 May 2024
Tool Learning with Large Language Models: A Survey Changle Qu Sunhao Dai Xiaochi Wei Hengyi Cai Shuaiqiang Wang Dawei Yin Jun Xu Jirong Wen LLMAG 31 78 0 28 May 2024
Can Large Language Models Faithfully Express Their Intrinsic Uncertainty in Words? G. Yona Roee Aharoni Mor Geva HILM 40 17 0 27 May 2024
GRAG: Graph Retrieval-Augmented Generation Yuntong Hu Zhihan Lei Zhengwu Zhang Bo Pan Chen Ling Liang Zhao 35 19 0 26 May 2024
Accelerating Inference of Retrieval-Augmented Generation via Sparse Context Selection Yun Zhu Jia-Chen Gu Caitlin Sikora Ho Ko Yinxiao Liu ... Lei Shu Liangchen Luo Lei Meng Bang Liu Jindong Chen RALM 22 14 0 25 May 2024
Towards Completeness-Oriented Tool Retrieval for Large Language Models Changle Qu Sunhao Dai Xiaochi Wei Hengyi Cai Shuaiqiang Wang Dawei Yin Jun Xu Jirong Wen KELM 27 7 0 25 May 2024
Perception of Knowledge Boundary for Large Language Models through Semi-open-ended Question Answering Zhihua Wen Zhiliang Tian Z. Jian Zhen Huang Pei Ke Yifu Gao Minlie Huang Dongsheng Li 31 9 0 23 May 2024
SynthesizRR: Generating Diverse Datasets with Retrieval Augmentation Abhishek Divekar Greg Durrett 26 5 0 16 May 2024
Prompting Large Language Models with Knowledge Graphs for Question Answering Involving Long-tail Facts Wenyu Huang Guancheng Zhou Mirella Lapata P. Vougiouklis Sébastien Montella Jeff Z. Pan KELM 19 4 0 10 May 2024
Smurfs: Leveraging Multiple Proficiency Agents with Context-Efficiency for Tool Planning Junzhi Chen Juhao Liang Benyou Wang LLMAG 26 3 0 09 May 2024
Redefining Information Retrieval of Structured Database via Large Language Models Mingzhu Wang Yuzhe Zhang Qihang Zhao Juanyi Yang Hong Zhang RALM KELM 14 0 0 09 May 2024
ERAGent: Enhancing Retrieval-Augmented Language Models with Improved Accuracy, Efficiency, and Personalization Yunxiao Shi Xing Zi Zijing Shi Haimin Zhang Qiang Wu Min Xu RALM 33 16 0 06 May 2024
Compressing Long Context for Enhancing RAG with AMR-based Concept Distillation Kaize Shi Xueyao Sun Qing Li Guandong Xu 32 12 0 06 May 2024
Enhancing Contextual Understanding in Large Language Models through Contrastive Decoding Zheng Zhao Emilio Monti Jens Lehmann H. Assem 42 22 0 04 May 2024
R4: Reinforced Retriever-Reorder-Responder for Retrieval-Augmented Large Language Models Taolin Zhang Dongyang Li Qizhou Chen Chengyu Wang Longtao Huang Hui Xue Xiaofeng He Junyuan Huang RALM KELM 42 0 0 04 May 2024
FLAME: Factuality-Aware Alignment for Large Language Models Sheng-Chieh Lin Luyu Gao Barlas Oğuz Wenhan Xiong Jimmy Lin Wen-tau Yih Xilun Chen HILM 34 14 0 02 May 2024
On the Evaluation of Machine-Generated Reports James Mayfield Eugene Yang Dawn J Lawrie Sean MacAvaney Paul McNamee ... Orion Weller Efsun Kayi Kate Sanders Marc Mason Noah Hibbler ALM 74 12 0 02 May 2024
When to Retrieve: Teaching LLMs to Utilize Information Retrieval Effectively Tiziano Labruna Jon Ander Campos Gorka Azkune 18 9 0 30 Apr 2024
RAG and RAU: A Survey on Retrieval-Augmented Language Model in Natural Language Processing Yucheng Hu Yuxing Lu RALM 58 17 0 30 Apr 2024
Towards a Holistic Evaluation of LLMs on Factual Knowledge Recall Jiaqing Yuan Lin Pan Chung-Wei Hang Jiang Guo Jiarong Jiang Bonan Min Patrick K. L. Ng Zhiguo Wang HILM ELM 32 3 0 24 Apr 2024
Studying Large Language Model Behaviors Under Realistic Knowledge Conflicts Evgenii Kortukov Alexander Rubinstein Elisa Nguyen Seong Joon Oh RALM 426 5 2 24 Apr 2024
KGValidator: A Framework for Automatic Validation of Knowledge Graph Construction Jack Boylan Shashank Mangla Dominic Thorn D. Ghalandari Parsa Ghaffari Chris Hokamp SLR 35 0 0 24 Apr 2024
A Comprehensive Survey on Evaluating Large Language Model Applications in the Medical Industry Yining Huang Keke Tang Meilian Chen Boyuan Wang ELM LM&MA 19 14 0 24 Apr 2024
IryoNLP at MEDIQA-CORR 2024: Tackling the Medical Error Detection & Correction Task On the Shoulders of Medical Agents Jean-Philippe Corbeil 27 2 0 23 Apr 2024
TAXI: Evaluating Categorical Knowledge Editing for Language Models Derek Powell Walter Gerych Thomas Hartvigsen KELM 27 7 0 23 Apr 2024
Integrating Disambiguation and User Preferences into Large Language Models for Robot Motion Planning Mohammed Abugurain Shinkyu Park 27 1 0 22 Apr 2024
Typos that Broke the RAG's Back: Genetic Attack on RAG Pipeline by Simulating Documents in the Wild via Low-level Perturbations Sukmin Cho Soyeong Jeong Jeongyeon Seo Taeho Hwang Jong C. Park SILM AAML 43 26 0 22 Apr 2024
Position Engineering: Boosting Large Language Models through Positional Information Manipulation Zhiyuan He Huiqiang Jiang Zilong Wang Yuqing Yang Luna Qiu Lili Qiu LLMAG 22 5 0 17 Apr 2024
MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memory Ali Modarressi Abdullatif Köksal Ayyoob Imani Mohsen Fayyaz Hinrich Schütze KELM 99 9 0 17 Apr 2024
MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents Liyan Tang Philippe Laban Greg Durrett HILM SyDa 37 74 0 16 Apr 2024
LLoCO: Learning Long Contexts Offline Sijun Tan Xiuyu Li Shishir G. Patil Ziyang Wu Tianjun Zhang Kurt Keutzer Joseph E. Gonzalez Raluca A. Popa RALM OffRL LLMAG 38 6 0 11 Apr 2024
DyKnow:Dynamically Verifying Time-Sensitive Factual Knowledge in LLMs Seyed Mahed Mousavi Simone Alghisi Giuseppe Riccardi KELM 30 5 0 10 Apr 2024
Groundedness in Retrieval-augmented Long-form Generation: An Empirical Study Alessandro Stolfo RALM HILM 26 6 0 10 Apr 2024
Not All Contexts Are Equal: Teaching LLMs Credibility-aware Generation Ruotong Pan Boxi Cao Hongyu Lin Xianpei Han Jia Zheng Sirui Wang Xunliang Cai Le Sun 24 9 0 10 Apr 2024
The Hallucinations Leaderboard -- An Open Effort to Measure Hallucinations in Large Language Models Giwon Hong Aryo Pradipta Gema Rohit Saxena Xiaotang Du Ping Nie ... Laura Perez-Beltrachini Max Ryabinin Xuanli He Clémentine Fourrier Pasquale Minervini LRM HILM 33 9 0 08 Apr 2024
Know When To Stop: A Study of Semantic Drift in Text Generation Ava Spataru Eric Hambro Elena Voita Nicola Cancedda 26 3 0 08 Apr 2024