Generalization through Memorization: Nearest Neighbor Language Models

1 November 2019

Urvashi Khandelwal

Omer Levy

Dan Jurafsky

Luke Zettlemoyer

M. Lewis

RALM

ArXiv PDF HTML

Papers citing "Generalization through Memorization: Nearest Neighbor Language Models"

50 / 576 papers shown

Title
Beyond Graphs: Can Large Language Models Comprehend Hypergraphs? Yifan Feng Chengwu Yang Xingliang Hou S. Du Shihui Ying Zongze Wu Yue Gao 27 3 0 14 Oct 2024
Generation with Dynamic Vocabulary Yanting Liu Tao Ji Changzhi Sun Yuanbin Wu Xiaoling Wang 45 0 0 11 Oct 2024
TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text Songshuo Lu Hua Wang Yutian Rong Zhi Chen Yaohua Tang VLM 31 12 0 10 Oct 2024
Retrieval-Augmented Decision Transformer: External Memory for In-context RL Thomas Schmied Fabian Paischer Vihang Patil M. Hofmarcher Razvan Pascanu Sepp Hochreiter OffRL 34 6 0 09 Oct 2024
Accelerating Inference of Networks in the Frequency Domain Chenqiu Zhao Guanfang Dong Anup Basu 35 0 0 06 Oct 2024
Misinformation with Legal Consequences (MisLC): A New Task Towards Harnessing Societal Harm of Misinformation Chu Fei Luo Radin Shayanfar R. Bhambhoria Samuel Dahan Xiaodan Zhu AILaw 26 0 0 04 Oct 2024
Permissive Information-Flow Analysis for Large Language Models Shoaib Ahmed Siddiqui Radhika Gaonkar Boris Köpf David M. Krueger Andrew J. Paverd Ahmed Salem Shruti Tople Lukas Wutschitz Menglin Xia Santiago Zanella Béguelin 26 1 0 04 Oct 2024
Reward-RAG: Enhancing RAG with Reward Driven Supervision Thang Nguyen Peter Chin Yu-Wing Tai RALM 34 4 0 03 Oct 2024
Contextual Document Embeddings John X. Morris Alexander M. Rush 19 7 0 03 Oct 2024
Undesirable Memorization in Large Language Models: A Survey Ali Satvaty Suzan Verberne Fatih Turkmen ELM PILM 69 7 0 03 Oct 2024
Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models Luohe Shi Yao Yao Zuchao Li Lefei Zhang Hai Zhao 24 0 0 30 Sep 2024
Incorporating Precedents for Legal Judgement Prediction on European Court of Human Rights Cases T. Y. S. S. Santosh Mohamed Hesham Elganayni Stanisław Sójka Matthias Grabmair AILaw 19 1 0 27 Sep 2024
Results of the Big ANN: NeurIPS'23 competition H. Simhadri Martin Aumüller Amir Ingber Matthijs Douze G. Williams ... Yizhuo Chen W. J. Zheng Zihao Wan Jie Yin Ben Huang 24 5 0 25 Sep 2024
Towards LifeSpan Cognitive Systems Yu Wang Chi Han Tongtong Wu Xiaoxin He Wangchunshu Zhou ... Zexue He Wei Wang Gholamreza Haffari Heng Ji Julian McAuley KELM CLL 112 1 0 20 Sep 2024
VERA: Validation and Enhancement for Retrieval Augmented systems Nitin Aravind Birur Tanay Baswa Divyanshu Kumar Jatan Loya Sahil Agarwal P. Harshangi VLM RALM 19 1 0 18 Sep 2024
Towards Fair RAG: On the Impact of Fair Ranking in Retrieval-Augmented Generation To Eun Kim Fernando Diaz 51 2 0 17 Sep 2024
Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refuse Maojia Song Shang Hong Sim Rishabh Bhardwaj Hai Leong Chieu Navonil Majumder Soujanya Poria 29 6 0 17 Sep 2024
Online Learning via Memory: Retrieval-Augmented Detector Adaptation Yanan Jian Fuxun Yu Qi Zhang William Levine Brandon Dubbs Nikolaos Karianakis ObjD CLL 16 0 0 16 Sep 2024
Trustworthiness in Retrieval-Augmented Generation Systems: A Survey Yujia Zhou Yan Liu Xiaoxi Li Jiajie Jin Hongjin Qian Zheng Liu Chaozhuo Li Zhicheng Dou Tsung-Yi Ho Philip S. Yu 3DV RALM 50 27 0 16 Sep 2024
On the Vulnerability of Applying Retrieval-Augmented Generation within Knowledge-Intensive Application Domains Xun Xian Ganghua Wang Xuan Bi Jayanth Srinivasa Ashish Kundu Charles Fleming Mingyi Hong Jie Ding SILM 21 2 0 12 Sep 2024
Applied Federated Model Personalisation in the Industrial Domain: A Comparative Study Ilias Siniosoglou Vasileios Argyriou G. Fragulis Panagiotis E. Fouliras Georgios Th. Papadopoulos A. Lytos Panagiotis G. Sarigiannidis 25 1 0 10 Sep 2024
RAG based Question-Answering for Contextual Response Prediction System Sriram Veturi Saurabh Vaichal Reshma Lal Jagadheesh Nafis Irtiza Tripto Nian Yan RALM 41 5 0 05 Sep 2024
You Only Use Reactive Attention Slice For Long Context Retrieval Yun Joon Soh Hanxian Huang Yuandong Tian Jishen Zhao RALM 33 0 0 03 Sep 2024
Compositional 3D-aware Video Generation with LLM Director Hanxin Zhu Tianyu He Anni Tang Junliang Guo Zhibo Chen Jiang Bian DiffM VGen 31 7 0 31 Aug 2024
MemLong: Memory-Augmented Retrieval for Long Text Modeling Weijie Liu Zecheng Tang Juntao Li Kehai Chen Min Zhang RALM 17 2 0 30 Aug 2024
Enhancing and Accelerating Large Language Models via Instruction-Aware Contextual Compression Haowen Hou Fei Ma Binwen Bai Xinxin Zhu Fei Yu 28 0 0 28 Aug 2024
A Statistical Framework for Data-dependent Retrieval-Augmented Models Soumya Basu A. S. Rawat Manzil Zaheer RALM 41 0 0 27 Aug 2024
Writing in the Margins: Better Inference Pattern for Long Context Retrieval M. Russak Umar Jamil Christopher Bryant Kiran Kamble Axel Magnuson Mateusz Russak Waseem Alshikh 19 2 0 27 Aug 2024
Ancient Wisdom, Modern Tools: Exploring Retrieval-Augmented LLMs for Ancient Indian Philosophy Priyanka Mandikal RALM VLM 45 0 0 21 Aug 2024
Great Memory, Shallow Reasoning: Limits of $k$ NN-LMs Shangyi Geng Wenting Zhao Alexander M. Rush RALM ReLM LRM 29 1 0 21 Aug 2024
Epistemic Injustice in Generative AI Jackie Kay Atoosa Kasirzadeh Shakir Mohamed AILaw 34 6 0 21 Aug 2024
CommunityKG-RAG: Leveraging Community Structures in Knowledge Graphs for Advanced Retrieval-Augmented Generation in Fact-Checking Rong-Ching Chang Jiawei Zhang 46 2 0 16 Aug 2024
Towards flexible perception with visual memory Robert Geirhos P. Jaini Austin Stone Sourabh Medapati Xi Yi G. Toderici Abhijit Ogale Jonathon Shlens 35 1 0 15 Aug 2024
A Hybrid RAG System with Comprehensive Enhancement on Complex Reasoning Ye Yuan Chengwu Liu Jingyang Yuan Gongbo Sun Siqi Li Ming Zhang LRM 34 5 0 09 Aug 2024
Retrieval-augmented code completion for local projects using large language models Marko Hostnik Marko Robnik-Sikonja RALM 27 0 0 09 Aug 2024
Local Topology Measures of Contextual Language Model Latent Spaces With Applications to Dialogue Term Extraction Benjamin Matthias Ruppik Michael Heck Carel van Niekerk Renato Vukovic Hsien-chin Lin Shutong Feng Marcus Zibrowius Milica Gašić 29 2 0 07 Aug 2024
A Debiased Nearest Neighbors Framework for Multi-Label Text Classification Zifeng Cheng Zhiwei Jiang Yafeng Yin Zhaoling Chen Cong Wang Shiping Ge Qiguo Huang Qing Gu 29 0 0 06 Aug 2024
Understanding Memorisation in LLMs: Dynamics, Influencing Factors, and Implications Till Speicher Mohammad Aflah Khan Qinyuan Wu Vedant Nanda Soumi Das Bishwamittra Ghosh Krishna P. Gummadi Evimaria Terzi 41 3 0 27 Jul 2024
Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approach Zhuowan Li Cheng-rong Li Mingyang Zhang Qiaozhu Mei Michael Bendersky 3DV RALM 60 34 0 23 Jul 2024
An Empirical Study of Retrieval Augmented Generation with Chain-of-Thought Yuetong Zhao Hongyu Cao Xianyu Zhao Zhijian Ou RALM LRM 16 3 0 22 Jul 2024
Exploiting Pre-trained Models for Drug Target Affinity Prediction with Nearest Neighbors Qizhi Pei Lijun Wu Zhenyu He Jinhua Zhu Yingce Xia Shufang Xie Rui Yan 21 0 0 21 Jul 2024
ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities Peng-Tao Xu Wei Ping Xianchao Wu Zihan Liu M. Shoeybi Mohammad Shoeybi Bryan Catanzaro RALM 44 14 0 19 Jul 2024
Nearest Neighbor Future Captioning: Generating Descriptions for Possible Collisions in Object Placement Tasks Takumi Komatsu Motonari Kambara Shumpei Hatanaka Haruka Matsuo Tsubasa Hirakawa Takayoshi Yamashita H. Fujiyoshi Komei Sugiura 27 0 0 18 Jul 2024
Retrieve, Summarize, Plan: Advancing Multi-hop Question Answering with an Iterative Approach Zhouyu Jiang Mengshu Sun Lei Liang Zhiqiang Zhang RALM 65 10 0 18 Jul 2024
Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark Tsung-Han Wu Giscard Biamby Jerome Quenum Ritwik Gupta Joseph E. Gonzalez Trevor Darrell David M. Chan VLM 35 7 0 18 Jul 2024
Retrieval-Enhanced Machine Learning: Synthesis and Opportunities To Eun Kim Alireza Salemi Andrew Drozdov Fernando Diaz Hamed Zamani 48 7 0 17 Jul 2024
Goldfish: Vision-Language Understanding of Arbitrarily Long Videos Kirolos Ataallah Xiaoqian Shen Eslam Abdelrahman Essam Sleiman Mingchen Zhuge Jian Ding Deyao Zhu Jürgen Schmidhuber Mohamed Elhoseiny VLM 17 17 0 17 Jul 2024
Mitigating Entity-Level Hallucination in Large Language Models Weihang Su Yichen Tang Qingyao Ai Changyue Wang Zhijing Wu Yiqun Liu HILM 27 6 0 12 Jul 2024
CompAct: Compressing Retrieved Documents Actively for Question Answering Chanwoong Yoon Taewhoo Lee Hyeon Hwang Minbyul Jeong Jaewoo Kang KELM RALM MQ 27 10 0 12 Jul 2024
Detect, Investigate, Judge and Determine: A Knowledge-guided Framework for Few-shot Fake News Detection Ye Liu Jiajun Zhu Kai Zhang Haoyu Tang Yanghai Zhang Xukai Liu Qi Liu Enhong Chen 53 0 0 12 Jul 2024