When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories

20 December 2022

Daniel Khashabi

Papers citing "When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memories"

50 / 397 papers shown

Title
Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning Yujian Liu Shiyu Chang Tommi Jaakkola Yang Zhang 23 0 0 25 Oct 2024
ChunkRAG: Novel LLM-Chunk Filtering Method for RAG Systems Ishneet Sukhvinder Singh Ritvik Aggarwal Ibrahim Allahverdiyev Muhammad Taha Aslihan Akalin Kevin Zhu Sean O'Brien 23 8 0 25 Oct 2024
DeCoRe: Decoding by Contrasting Retrieval Heads to Mitigate Hallucinations Aryo Pradipta Gema Chen Jin Ahmed Abdulaal Tom Diethe Philip Teare Beatrice Alex Pasquale Minervini Amrutha Saseendran 26 5 0 24 Oct 2024
IPL: Leveraging Multimodal Large Language Models for Intelligent Product Listing Kang Chen Qingheng Zhang Chengbao Lian Yixin Ji Xuwei Liu Shuguang Han Guoqiang Wu Fei Huang Jufeng Chen 24 1 0 22 Oct 2024
Trustworthy Alignment of Retrieval-Augmented Large Language Models via Reinforcement Learning Zongmeng Zhang Yufeng Shi Jinhua Zhu Wengang Zhou Xiang Qi Peng Zhang H. Li RALM HILM 18 0 0 22 Oct 2024
Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on Hallucination Jerry Huang Prasanna Parthasarathi Mehdi Rezagholizadeh Boxing Chen Sarath Chandar 48 0 0 22 Oct 2024
RAC: Efficient LLM Factuality Correction with Retrieval Augmentation Changmao Li Jeffrey Flanigan KELM LRM 24 0 0 21 Oct 2024
Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering Yu Zhao Alessio Devoto Giwon Hong Xiaotang Du Aryo Pradipta Gema Hongru Wang Xuanli He Kam-Fai Wong Pasquale Minervini KELM LLMSV 32 16 0 21 Oct 2024
Analysing the Residual Stream of Language Models Under Knowledge Conflicts Yu Zhao Xiaotang Du Giwon Hong Aryo Pradipta Gema Alessio Devoto Hongru Wang Xuanli He Kam-Fai Wong Pasquale Minervini KELM 37 1 0 21 Oct 2024
Unveiling and Consulting Core Experts in Retrieval-Augmented MoE-based LLMs Xin Zhou Ping Nie Yiwen Guo Haojie Wei Zhanqiu Zhang Pasquale Minervini Ruotian Ma Tao Gui Qi Zhang Xuanjing Huang MoE 42 0 0 20 Oct 2024
HyQE: Ranking Contexts with Hypothetical Query Embeddings Weichao Zhou Jiaxin Zhang Hilaf Hasson Anu Singh Wenchao Li RALM 14 1 0 20 Oct 2024
BRIEF: Bridging Retrieval and Inference for Multi-hop Reasoning via Compression Yuankai Li Jia-Chen Gu Di Wu Kai-Wei Chang Nanyun Peng RALM MQ 18 0 0 20 Oct 2024
Fact Recall, Heuristics or Pure Guesswork? Precise Interpretations of Language Models for Fact Completion Denitsa Saynova Lovisa Hagström Moa Johansson Richard Johansson Marco Kuhlmann HILM 34 0 0 18 Oct 2024
Probing-RAG: Self-Probing to Guide Language Models in Selective Document Retrieval Ingeol Baek Hwan Chang Byeongjeong Kim Jimin Lee Hwanhee Lee RALM 57 4 0 17 Oct 2024
On the Risk of Evidence Pollution for Malicious Social Text Detection in the Era of LLMs Herun Wan Minnan Luo Zhixiong Su Guang Dai Xiang Zhao DeLMO 27 0 0 16 Oct 2024
Conformity in Large Language Models Xiaochen Zhu Caiqi Zhang Tom Stafford Nigel Collier Andreas Vlachos 35 0 0 16 Oct 2024
DynamicER: Resolving Emerging Mentions to Dynamic Entities for RAG Jinyoung Kim Dayoon Ko Gunhee Kim 18 1 0 15 Oct 2024
RuleRAG: Rule-Guided Retrieval-Augmented Generation with Language Models for Question Answering Zhongwu Chen Chengjin Xu Dingmin Wang Zhen Huang Yong Dou Xuhui Jiang Jian Guo RALM 105 1 0 15 Oct 2024
Parenting: Optimizing Knowledge Selection of Retrieval-Augmented Language Models with Parameter Decoupling and Tailored Tuning Yongxin Xu Ruizhe Zhang Xinke Jiang Yujie Feng Yuzhen Xiao Xinyu Ma Runchuan Zhu Xu Chu Junfeng Zhao Yasha Wang KELM 20 4 0 14 Oct 2024
A Multi-LLM Orchestration Engine for Personalized, Context-Rich Assistance Sumedh Rasal 15 0 0 13 Oct 2024
Understanding the Interplay between Parametric and Contextual Knowledge for Large Language Models Sitao Cheng Liangming Pan Xunjian Yin Xinyi Wang William Yang Wang KELM 37 4 0 10 Oct 2024
TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text Songshuo Lu Hua Wang Yutian Rong Zhi Chen Yaohua Tang VLM 31 12 0 10 Oct 2024
Astute RAG: Overcoming Imperfect Retrieval Augmentation and Knowledge Conflicts for Large Language Models Fei Wang Xingchen Wan Ruoxi Sun Jiefeng Chen Sercan Ö. Arık RALM 32 7 0 09 Oct 2024
Context-Augmented Code Generation Using Programming Knowledge Graphs Iman Saberi Fatemeh H. Fard 21 1 0 09 Oct 2024
Retrieving, Rethinking and Revising: The Chain-of-Verification Can Improve Retrieval Augmented Generation Bolei He Nuo Chen Xinran He Lingyong Yan Zhenkai Wei Jinchang Luo Zhen-Hua Ling RALM LRM 23 1 0 08 Oct 2024
ReFIR: Grounding Large Restoration Models with Retrieval Augmentation Hang Guo Tao Dai Zhihao Ouyang Taolin Zhang Yaohua Zha Bin Chen Shu-Tao Xia DiffM 30 5 0 08 Oct 2024
Deciphering the Interplay of Parametric and Non-parametric Memory in Retrieval-augmented Language Models M. Farahani Richard Johansson RALM 26 2 0 07 Oct 2024
Adaptive Question Answering: Enhancing Language Model Proficiency for Addressing Knowledge Conflicts with Source Citations Sagi Shaier Ari Kobren Philip Ogren HILM 29 5 0 05 Oct 2024
How to Train Long-Context Language Models (Effectively) Tianyu Gao Alexander Wettig Howard Yen Danqi Chen RALM 72 37 0 03 Oct 2024
HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly Howard Yen Tianyu Gao Minmin Hou Ke Ding Daniel Fleischer Peter Izsak Moshe Wasserblat Danqi Chen ALM ELM 56 25 0 03 Oct 2024
Open-RAG: Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language Models Shayekh Bin Islam Md Asib Rahman K S M Tozammel Hossain Enamul Hoque Shafiq R. Joty Md. Rizwan Parvez RALM AIFin LRM VLM 35 13 0 02 Oct 2024
A Survey on Complex Tasks for Goal-Directed Interactive Agents Mareike Hartmann Alexander Koller LM&Ro LLMAG 32 0 0 27 Sep 2024
Controlling Risk of Retrieval-augmented Generation: A Counterfactual Prompting Framework Lu Chen Ruqing Zhang Jiafeng Guo Yixing Fan Xueqi Cheng 24 3 0 24 Sep 2024
Learning When to Retrieve, What to Rewrite, and How to Respond in Conversational QA Nirmal Roy Leonardo F. R. Ribeiro Rexhina Blloshmi Kevin Small RALM 22 2 0 23 Sep 2024
AQA: Adaptive Question Answering in a Society of LLMs via Contextual Multi-Armed Bandit Mohanna Hoveyda A. D. Vries Maarten de Rijke Harrie Oosterhuis Faegheh Hasibi 13 2 0 20 Sep 2024
A Multiple-Fill-in-the-Blank Exam Approach for Enhancing Zero-Resource Hallucination Detection in Large Language Models Satoshi Munakata Taku Fukui Takao Mohri 21 0 0 20 Sep 2024
The Factuality of Large Language Models in the Legal Domain Rajaa El Hamdani Thomas Bonald Fragkiskos D. Malliaros Nils Holzenberger Fabian M. Suchanek AILaw HILM 29 0 0 18 Sep 2024
Investigating Context-Faithfulness in Large Language Models: The Roles of Memory Strength and Evidence Style Yuepei Li Kang Zhou Qiao Qiao Bach Nguyen Qing Wang Qi Li HILM RALM 19 2 0 17 Sep 2024
SFR-RAG: Towards Contextually Faithful LLMs Xuan-Phi Nguyen Shrey Pandit Senthil Purushwalkam Austin Xu Hailin Chen Yifei Ming Zixuan Ke Silvio Savarese Caiming Xong Shafiq Joty RALM 86 7 0 16 Sep 2024
AdaCAD: Adaptively Decoding to Balance Conflicts between Contextual and Parametric Knowledge Han Wang Archiki Prasad Elias Stengel-Eskin Mohit Bansal 75 5 0 11 Sep 2024
Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts Eleftheria Briakou Jiaming Luo Colin Cherry Markus Freitag 69 11 0 10 Sep 2024
Diversify-verify-adapt: Efficient and Robust Retrieval-Augmented Ambiguous Question Answering Yeonjun In Sungchul Kim Ryan A. Rossi Md Mehrab Tanjim Tong Yu Ritwik Sinha Chanyoung Park 30 0 0 04 Sep 2024
Claim Verification in the Age of Large Language Models: A Survey A. Dmonte Roland Oruche Marcos Zampieri Prasad Calyam Isabelle Augenstein 44 8 0 26 Aug 2024
RAGLAB: A Modular and Research-Oriented Unified Framework for Retrieval-Augmented Generation Xuanwang Zhang Yunze Song Yidong Wang Shuyun Tang Xinfeng Li ... Wenyuan Xu Yue Zhang Xinyu Dai Shikun Zhang Qingsong Wen 36 4 0 21 Aug 2024
Analysis of Plan-based Retrieval for Grounded Text Generation Ameya Godbole Nicholas Monath Seungyeon Kim A. S. Rawat Andrew McCallum Manzil Zaheer RALM 33 2 0 20 Aug 2024
Multilingual Needle in a Haystack: Investigating Long-Context Behavior of Multilingual Large Language Models Amey Hengle Prasoon Bajpai Soham Dan Tanmoy Chakraborty LRM 29 2 0 19 Aug 2024
Are Large Language Models More Honest in Their Probabilistic or Verbalized Confidence? Shiyu Ni Keping Bi Lulu Yu Jiafeng Guo HILM 22 4 0 19 Aug 2024
Context-Driven Index Trimming: A Data Quality Perspective to Enhancing Precision of RALMs Kexin Ma Ruochun Jin Xi Wang Huan Chen Jing Ren Yuhua Tang 31 0 0 10 Aug 2024
Enhancing Robustness of Retrieval-Augmented Language Models with In-Context Learning Seong-Il Park Seung-Woo Choi Na-Hyun Kim Jay-Yoon Lee RALM AIFin LRM 30 3 0 08 Aug 2024
Unveiling Factual Recall Behaviors of Large Language Models through Knowledge Neurons Yifei Wang Yuheng Chen Wanting Wen Yu Sheng Linjing Li D. Zeng KELM 36 5 0 06 Aug 2024