Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs

10 December 2023

Papers citing "Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs"

50 / 82 papers shown

Title
Real-time Spatial Retrieval Augmented Generation for Urban Environments David Nazareno Campo Javier Conde Alvaro Alonso Gabriel Huecas Joaquín Salvachúa Pedro Reviriego 22 0 0 04 May 2025
Synthesize-on-Graph: Knowledgeable Synthetic Data Generation for Continue Pre-training of Large Language Models Xuhui Jiang Shengjie Ma Chengjin Xu Cehao Yang Liyu Zhang Jian Guo SyDa 28 0 0 02 May 2025
Memorization and Knowledge Injection in Gated LLMs Xu Pan Ely Hahami Zechen Zhang H. Sompolinsky KELM CLL RALM 104 0 0 30 Apr 2025
Keep the General, Inject the Specific: Structured Dialogue Fine-Tuning for Knowledge Injection without Catastrophic Forgetting Y. Hong Xiaofei Yin Xinzhong Wang Yi Tu Ya Guo Sufeng Duan Weiqiang Wang Lingyong Fang Depeng Wang Huijia Zhu CLL 89 0 0 27 Apr 2025
Investigating LLMs in Clinical Triage: Promising Capabilities, Persistent Intersectional Biases Joseph Lee Tianqi Shang Jae Young Baik D. Duong-Tran Shu Yang Lingyao Li Li Shen 64 0 0 22 Apr 2025
DR.FIX: Automatically Fixing Data Races at Industry Scale Farnaz Behrang Zhizhou Zhang Georgian-Vlad Saioc Peng Liu Milind Chabbi 17 0 0 22 Apr 2025
Large language models could be rote learners Yuyang Xu Renjun Hu Haochao Ying J. Wu Xing Shi Wei Lin ELM 90 0 0 11 Apr 2025
MRD-RAG: Enhancing Medical Diagnosis with Multi-Round Retrieval-Augmented Generation Yixiang Chen Penglei Sun Xiang Li Xiaowen Chu 33 0 0 10 Apr 2025
Knowledge-Instruct: Effective Continual Pre-training from Limited Data using Instructions O. Ovadia Meni Brief Rachel Lemberg Eitam Sheetrit CLL KELM 42 0 0 08 Apr 2025
Adapting Large Language Models for Multi-Domain Retrieval-Augmented-Generation Alexandre Misrahi Nadezhda Chirkova Maxime Louis Vassilina Nikoulina RALM 80 0 0 03 Apr 2025
Synthesizing Public Opinions with LLMs: Role Creation, Impacts, and the Future to eDemorcacy Rabimba Karanjai Boris Shor Amanda Austin Ryan Kennedy Yang Lu Lei Xu W. Shi SyDa 59 1 0 31 Mar 2025
How do language models learn facts? Dynamics, curricula and hallucinations Nicolas Zucchet J. Bornschein Stephanie C. Y. Chan Andrew Kyle Lampinen Razvan Pascanu Soham De KELM HILM LRM 75 2 1 27 Mar 2025
Gradient-guided Attention Map Editing: Towards Efficient Contextual Hallucination Mitigation Yu Wang Jiaxin Zhang Xiang Gao Wendi Cui Peng Li Kamalika Das 39 0 0 11 Mar 2025
Research on Superalignment Should Advance Now with Parallel Optimization of Competence and Conformity HyunJin Kim Xiaoyuan Yi Jing Yao Muhua Huang Jinyeong Bak James Evans Xing Xie 36 0 0 08 Mar 2025
Effective LLM Knowledge Learning via Model Generalization Mingkang Zhu Xi Chen Z. Wang Bei Yu Hengshuang Zhao Jiaya Jia 60 0 0 05 Mar 2025
Bisecting K-Means in RAG for Enhancing Question-Answering Tasks Performance in Telecommunications Pedro Sousa Cláudio Klautau Mello Frank B. Morte Luis F. Solis Navarro 60 0 0 27 Feb 2025
Stepwise Perplexity-Guided Refinement for Efficient Chain-of-Thought Reasoning in Large Language Models Yingqian Cui Pengfei He Jingying Zeng Hui Liu X. Tang ... Zhen Li Suhang Wang Yue Xing Jiliang Tang Qi He LRM 37 6 0 18 Feb 2025
How Do LLMs Acquire New Knowledge? A Knowledge Circuits Perspective on Continual Pre-Training Yixin Ou Yunzhi Yao N. Zhang Hui Jin Jiacheng Sun Shumin Deng Z. Li H. Chen KELM CLL 49 0 0 16 Feb 2025
SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains Ran Xu Hui Liu Sreyashi Nag Zhenwei Dai Yaochen Xie ... Chen Luo Yang Li Joyce C. Ho Carl Yang Qi He RALM 68 8 0 28 Jan 2025
ASTRID -- An Automated and Scalable TRIaD for the Evaluation of RAG-based Clinical Question Answering Systems Mohita Chowdhury Yajie Vera He Aisling Higham Ernest Lim 58 1 0 14 Jan 2025
Transfer Learning for Finetuning Large Language Models Tobias Strangmann Lennart Purucker Jörg K.H. Franke Ivo Rapant Fabio Ferreira Frank Hutter 39 0 0 02 Nov 2024
SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Models Jianyi Zhang Da-Cheng Juan Cyrus Rashtchian Chun-Sung Ferng Heinrich Jiang Y. Chen 31 4 0 01 Nov 2024
Latent Paraphrasing: Perturbation on Layers Improves Knowledge Injection in Language Models Minki Kang Sung Ju Hwang Gibbeum Lee Jaewoong Cho KELM 32 0 0 01 Nov 2024
HijackRAG: Hijacking Attacks against Retrieval-Augmented Large Language Models Yucheng Zhang Qinfeng Li Tianyu Du Xuhong Zhang Xinkui Zhao Zhengwen Feng Jianwei Yin AAML SILM 34 5 0 30 Oct 2024
Learning and Unlearning of Fabricated Knowledge in Language Models Chen Sun Nolan Miller A. Zhmoginov Max Vladymyrov Mark Sandler KELM MU 27 1 0 29 Oct 2024
Graph-based Uncertainty Metrics for Long-form Language Model Outputs Mingjian Jiang Yangjun Ruan Prasanna Sattigeri Salim Roukos Tatsunori Hashimoto 18 0 0 28 Oct 2024
Synthetic Knowledge Ingestion: Towards Knowledge Refinement and Injection for Enhancing Large Language Models Jiaxin Zhang Wendi Cui Yiran Huang Kamalika Das Sricharan Kumar KELM SyDa 25 2 0 12 Oct 2024
SciPrompt: Knowledge-augmented Prompting for Fine-grained Categorization of Scientific Topics Zhiwen You Kanyao Han Haotian Zhu Bertram Ludäscher Jana Diesner 28 1 0 02 Oct 2024
SwiftDossier: Tailored Automatic Dossier for Drug Discovery with LLMs and Agents Gabriele Fossi Youssef Boulaimen Leila Outemzabet Nathalie Jeanray Stephane Gerart Sebastien Vachenc Joanna Giemza Salvatore Raieli 29 2 0 24 Sep 2024
Synthetic continued pretraining Zitong Yang Neil Band Shuangping Li Emmanuel Candès Tatsunori Hashimoto CLL SyDa 36 11 0 11 Sep 2024
Diagnosing and Remedying Knowledge Deficiencies in LLMs via Label-free Curricular Meaningful Learning Kai Xiong Xiao Ding Li Du Jiahao Ying Ting Liu Bing Qin Yixin Cao 34 1 0 21 Aug 2024
Structure-aware Domain Knowledge Injection for Large Language Models Kai-Chun Liu Ze Chen Zhihang Fu Rongxin Jiang Fan Zhou Yao-Shen Chen Yue-bo Wu Yue Wu Jieping Ye 47 1 0 23 Jul 2024
Knowledge Mechanisms in Large Language Models: A Survey and Perspective Meng Wang Yunzhi Yao Ziwen Xu Shuofei Qiao Shumin Deng ... Yong-jia Jiang Pengjun Xie Fei Huang Huajun Chen Ningyu Zhang 47 27 0 22 Jul 2024
GPT vs RETRO: Exploring the Intersection of Retrieval and Parameter-Efficient Fine-Tuning Aleksander Ficek Jiaqi Zeng Oleksii Kuchaiev 27 0 0 05 Jul 2024
MeMemo: On-device Retrieval Augmentation for Private and Personalized Text Generation Zijie J. Wang Duen Horng Chau 32 4 0 02 Jul 2024
Evaluating Quality of Answers for Retrieval-Augmented Generation: A Strong LLM Is All You Need Yang Wang Alberto Garcia Hernandez Roman Kyslyi Nicholas S. Kersting 34 3 0 26 Jun 2024
Retrieval-Augmented Generation for Generative Artificial Intelligence in Medicine Rui Yang Yilin Ning Emilia Keppo Mingxuan Liu Chuan Hong Danielle S Bitterman J. Ong Daniel Ting Nan Liu 3DV MedIm RALM 32 1 0 18 Jun 2024
Design and evaluation of AI copilots -- case studies of retail copilot templates Michal Furmakiewicz Chang Liu Angus Taylor Ilya Venger 34 2 0 17 Jun 2024
GPT-Powered Elicitation Interview Script Generator for Requirements Engineering Training Binnur Görer Fatma Başak Aydemir 36 4 0 17 Jun 2024
Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching Xiaoying Zhang Baolin Peng Ye Tian Jingyan Zhou Yipeng Zhang Haitao Mi H. Meng CLL KELM 71 5 0 10 Jun 2024
A Survey on Large Language Models for Code Generation Juyong Jiang Fan Wang Jiasi Shen Sungju Kim Sunghun Kim 40 158 0 01 Jun 2024
Evaluating the External and Parametric Knowledge Fusion of Large Language Models Hao Zhang Yuyang Zhang Xiaoguang Li Wenxuan Shi Haonan Xu ... Yasheng Wang Lifeng Shang Qun Liu Yong-jin Liu Ruiming Tang KELM 33 4 0 29 May 2024
CtrlA: Adaptive Retrieval-Augmented Generation via Probe-Guided Control Huanshuo Liu Hao Zhang Zhijiang Guo Kuicai Dong Xiangyang Li Yi Quan Lee Cong Zhang Yong-jin Liu 3DV 31 6 0 29 May 2024
Semantic are Beacons: A Semantic Perspective for Unveiling Parameter-Efficient Fine-Tuning in Knowledge Learning Renzhi Wang Piji Li 35 4 0 28 May 2024
WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models Peng Wang Zexi Li Ningyu Zhang Ziwen Xu Yunzhi Yao Yong-jia Jiang Pengjun Xie Fei Huang Huajun Chen KELM CLL 45 20 0 23 May 2024
KG-RAG: Bridging the Gap Between Knowledge and Creativity Diego Sanmartin RALM 39 35 0 20 May 2024
Benchmarking Retrieval-Augmented Large Language Models in Biomedical NLP: Application, Robustness, and Self-Awareness Mingchen Li Zaifu Zhan Han Yang Yongkang Xiao Jiatan Huang Rui Zhang 33 6 0 13 May 2024
Advanced Natural-based interaction for the ITAlian language: LLaMAntino-3-ANITA Marco Polignano Pierpaolo Basile Giovanni Semeraro 21 18 0 11 May 2024
Mitigating Hallucinations in Large Language Models via Self-Refinement-Enhanced Knowledge Retrieval Mengjia Niu Hao Li Jie Shi Hamed Haddadi Fan Mo HILM 40 10 0 10 May 2024
DALK: Dynamic Co-Augmentation of LLMs and KG to answer Alzheimer's Disease Questions with Scientific Literature Dawei Li Shu Yang Zhen Tan Jae Young Baik Sunkwon Yun ... D. Duong-Tran Ying Ding Huan Liu Li Shen Tianlong Chen 51 32 0 08 May 2024