Generalization through Memorization: Nearest Neighbor Language Models

1 November 2019

Urvashi Khandelwal

Omer Levy

Dan Jurafsky

Luke Zettlemoyer

M. Lewis

RALM

ArXiv PDF HTML

Papers citing "Generalization through Memorization: Nearest Neighbor Language Models"

50 / 576 papers shown

Title
BiomedRAG: A Retrieval Augmented Large Language Model for Biomedicine Mingchen Li H. Kilicoglu Hualei Xu Rui Zhang LM&MA RALM 26 13 0 01 May 2024
RAG and RAU: A Survey on Retrieval-Augmented Language Model in Natural Language Processing Yucheng Hu Yuxing Lu RALM 58 17 0 30 Apr 2024
HELPER-X: A Unified Instructable Embodied Agent to Tackle Four Interactive Vision-Language Domains with Memory-Augmented Language Models Gabriel H. Sarch Sahil Somani Raghav Kapoor Michael J. Tarr Katerina Fragkiadaki LM&Ro LLMAG 29 3 0 29 Apr 2024
Quality Estimation with $k$ -nearest Neighbors and Automatic Evaluation for Model-specific Quality Estimation Tu Anh Dinh Tobias Palzer Jan Niehues 33 0 0 27 Apr 2024
LLMs Know What They Need: Leveraging a Missing Information Guided Framework to Empower Retrieval-Augmented Generation Keheng Wang Feiyu Duan Peiguang Li Sirui Wang Xunliang Cai RALM 30 2 0 22 Apr 2024
FedMeS: Personalized Federated Continual Learning Leveraging Local Memory Jingru Xie Chenqi Zhu Songze Li FedML CLL 32 0 0 19 Apr 2024
From Language Models to Practical Self-Improving Computer Agents Alex Sheng LM&MA LLMAG 27 0 0 18 Apr 2024
A Survey on Retrieval-Augmented Text Generation for Large Language Models Yizheng Huang Jimmy X. Huang 3DV RALM 58 44 0 17 Apr 2024
kNN-CLIP: Retrieval Enables Training-Free Segmentation on Continually Expanding Large Vocabularies Zhongrui Gui Shuyang Sun Runjia Li Jianhao Yuan Zhaochong An Karsten Roth Ameya Prabhu Philip H. S. Torr VLM CLL 24 6 0 15 Apr 2024
Privacy Preserving Prompt Engineering: A Survey Kennedy Edemacu Xintao Wu 39 18 0 09 Apr 2024
Verifiable by Design: Aligning Language Models to Quote from Pre-Training Data Jingyu Zhang Marc Marone Tianjian Li Benjamin Van Durme Daniel Khashabi 85 9 0 05 Apr 2024
Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contexts Zhuo Chen Xinyu Wang Yong-jia Jiang Pengjun Xie Fei Huang Kewei Tu RALM 22 2 0 02 Apr 2024
Learning to Plan for Language Modeling from Unlabeled Data Nathan Cornille Marie-Francine Moens Florian Mai 30 7 0 31 Mar 2024
Mind Your Neighbours: Leveraging Analogous Instances for Rhetorical Role Labeling for Legal Documents Santosh T.Y.S.S Hassan Sarwat Ahmed Abdou Matthias Grabmair AILaw 21 2 0 31 Mar 2024
CPR: Retrieval Augmented Generation for Copyright Protection Aditya Golatkar Alessandro Achille L. Zancato Yu-Xiang Wang Ashwin Swaminathan Stefano Soatto DiffM 27 16 0 27 Mar 2024
RAP: Retrieval-Augmented Planner for Adaptive Procedure Planning in Instructional Videos Ali Zare Yulei Niu Hammad A. Ayyubi Shih-Fu Chang 42 1 0 27 Mar 2024
Quantifying and Mitigating Unimodal Biases in Multimodal Large Language Models: A Causal Perspective Meiqi Chen Yixin Cao Yan Zhang Chaochao Lu 26 12 0 27 Mar 2024
Efficient Test-Time Adaptation of Vision-Language Models Adilbek Karmanov Dayan Guan Shijian Lu Abdulmotaleb El Saddik Eric P. Xing TTA VLM 14 37 0 27 Mar 2024
DANCER: Entity Description Augmented Named Entity Corrector for Automatic Speech Recognition Yi-Cheng Wang Hsin-Wei Wang Bi-Cheng Yan Chi-Han Lin Berlin Chen 29 1 0 26 Mar 2024
Differentially Private Next-Token Prediction of Large Language Models James Flemings Meisam Razaviyayn Murali Annavaram 28 6 0 22 Mar 2024
FIT-RAG: Black-Box RAG with Factual Information and Token Reduction Yuren Mao Xuemei Dong Wenyi Xu Yunjun Gao Bin Wei Ying Zhang 28 9 0 21 Mar 2024
Larimar: Large Language Models with Episodic Memory Control Payel Das Subhajit Chaudhury Elliot Nelson Igor Melnyk Sarath Swaminathan ... Vijil Chenthamarakshan Jiří Jirí Navrátil Soham Dan Pin-Yu Chen CLL KELM 35 18 0 18 Mar 2024
JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning Anique Tahir Lu Cheng Huan Liu 22 1 0 17 Mar 2024
RAFT: Adapting Language Model to Domain Specific RAG Tianjun Zhang Shishir G. Patil Naman Jain Sheng Shen Matei A. Zaharia Ion Stoica Joseph E. Gonzalez RALM 32 177 0 15 Mar 2024
DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language Models Weihang Su Yichen Tang Qingyao Ai Zhijing Wu Yiqun Liu 3DV RALM AI4TS SyDa 51 18 0 15 Mar 2024
Semiparametric Token-Sequence Co-Supervision Hyunji Lee Doyoung Kim Jihoon Jun Se June Joo Joel Jang Kyoung-Woon On Minjoon Seo 25 0 0 14 Mar 2024
Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models Weihang Su Changyue Wang Qingyao Ai Hu Yiran Zhijing Wu Yujia Zhou Yiqun Liu HILM 37 28 0 11 Mar 2024
PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design Wenqi Jiang Shuai Zhang Boran Han Jie Wang Bernie Wang Tim Kraska 3DV 90 24 0 08 Mar 2024
RATSF: Empowering Customer Service Volume Management through Retrieval-Augmented Time-Series Forecasting Tianfeng Wang Gaojie Cui AI4TS 42 0 0 07 Mar 2024
From One to Many: Expanding the Scope of Toxicity Mitigation in Language Models Luiza Amador Pozzobon Patrick Lewis Sara Hooker B. Ermiş 36 7 0 06 Mar 2024
MeaCap: Memory-Augmented Zero-shot Image Captioning Zequn Zeng Yan Xie Hao Zhang Chiyu Chen Zhengjue Wang Boli Chen VLM 20 14 0 06 Mar 2024
Reliable, Adaptable, and Attributable Language Models with Retrieval Akari Asai Zexuan Zhong Danqi Chen Pang Wei Koh Luke Zettlemoyer Hanna Hajishirzi Wen-tau Yih KELM RALM 41 53 0 05 Mar 2024
Retrieval-Augmented Generation for AI-Generated Content: A Survey Penghao Zhao Hailin Zhang Qinhan Yu Zhengren Wang Yunteng Geng Fangcheng Fu Ling Yang Wentao Zhang Jie Jiang Bin Cui 3DV 110 220 0 29 Feb 2024
Memory-Augmented Generative Adversarial Transformers Stephan Raaijmakers Roos Bakker Anita Cremers R. D. Kleijn Tom Kouwenhoven Tessa Verhoef 33 0 0 29 Feb 2024
Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systems Zhenting Qi Hanlin Zhang Eric Xing Sham Kakade Hima Lakkaraju SILM 40 18 0 27 Feb 2024
Retrieval is Accurate Generation Bowen Cao Deng Cai Leyang Cui Xuxin Cheng Wei Bi Yuexian Zou Shuming Shi 35 6 0 27 Feb 2024
The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG) Shenglai Zeng Jiankun Zhang Pengfei He Yue Xing Yiding Liu ... Jie Ren Shuaiqiang Wang Dawei Yin Yi Chang Jiliang Tang SILM 33 67 0 23 Feb 2024
Transformer-based Causal Language Models Perform Clustering Xinbo Wu L. Varshney 16 6 0 19 Feb 2024
Unveiling the Magic: Investigating Attention Distillation in Retrieval-augmented Generation Zizhong Li Haopeng Zhang Jiawei Zhang RALM 43 1 0 19 Feb 2024
Metacognitive Retrieval-Augmented Large Language Models Yujia Zhou Zheng Liu Jiajie Jin Jian-yun Nie Zhicheng Dou RALM KELM AIFin LRM 27 14 0 18 Feb 2024
EVEDIT: Event-based Knowledge Editing with Deductive Editing Boundaries Jiateng Liu Pengfei Yu Yuji Zhang Sha Li Zixuan Zhang Heng Ji KELM 24 16 0 17 Feb 2024
In Search of Needles in a 11M Haystack: Recurrent Memory Finds What LLMs Miss Yuri Kuratov Aydar Bulatov Petr Anokhin Dmitry Sorokin Artyom Sorokin Mikhail Burtsev RALM 117 33 0 16 Feb 2024
Grounding Language Model with Chunking-Free In-Context Retrieval Hongjin Qian Zheng Liu Kelong Mao Yujia Zhou Zhicheng Dou 39 14 0 15 Feb 2024
Nearest Neighbour Score Estimators for Diffusion Generative Models Matthew Niedoba Dylan Green Saeid Naderiparizi Vasileios Lioutas J. Lavington ... Ke Zhang Setareh Dabiri Adam Scibior Berend Zwartsenberg Frank D. Wood DiffM 16 0 0 12 Feb 2024
ProtIR: Iterative Refinement between Retrievers and Predictors for Protein Function Annotation Zuobai Zhang Jiarui Lu Vijil Chenthamarakshan Aurélie C. Lozano Payel Das Jian Tang 21 1 0 10 Feb 2024
Let Your Graph Do the Talking: Encoding Structured Data for LLMs Bryan Perozzi Bahare Fatemi Dustin Zelle Anton Tsitsulin Mehran Kazemi Rami Al-Rfou Jonathan J. Halcrow GNN 30 55 0 08 Feb 2024
MEMORYLLM: Towards Self-Updatable Large Language Models Yu-Xiang Wang Yifan Gao Xiusi Chen Haoming Jiang Shiyang Li ... Zheng Li Xian Li Bing Yin Jingbo Shang Julian McAuley KELM 27 16 0 07 Feb 2024
InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory Chaojun Xiao Pengle Zhang Xu Han Guangxuan Xiao Yankai Lin Zhengyan Zhang Zhiyuan Liu Maosong Sun LLMAG 39 33 0 07 Feb 2024
Training Language Models to Generate Text with Citations via Fine-grained Rewards Chengyu Huang Zeqiu Wu Yushi Hu Wenya Wang HILM LRM 75 25 0 06 Feb 2024
Retrieve to Explain: Evidence-driven Predictions with Language Models Ravi Patel Angus Brayne Rogier E Hintzen Daniel Jaroslawicz Georgiana Neculae Dane S. Corneil 11 2 0 06 Feb 2024