XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference

XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference

23 April 2024

Jo˜ao Monteiro

Étienne Marcotte

Pierre-Andre Noel

Valentina Zantedeschi

David Vázquez

Nicolas Chapados

Christopher Pal

Perouz Taslakian

Papers citing "XC-Cache: Cross-Attending to Cached Context for Efficient LLM Inference"

6 / 6 papers shown

Title
Explain-Query-Test: Self-Evaluating LLMs Via Explanation and Comprehension Discrepancy Saeid Asgari Taghanaki Joao Monteiro ELM LRM 34 1 0 20 Jan 2025
Debug Smarter, Not Harder: AI Agents for Error Resolution in Computational Notebooks Konstantin Grotov Artem Borzilov Maksim Krivobok T. Bryksin Yaroslav Zharov 58 1 0 18 Oct 2024
TurboRAG: Accelerating Retrieval-Augmented Generation with Precomputed KV Caches for Chunked Text Songshuo Lu Hua Wang Yutian Rong Zhi Chen Yaohua Tang VLM 31 11 0 10 Oct 2024
RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content Joao Monteiro Pierre-Andre Noel Étienne Marcotte Sai Rajeswar Valentina Zantedeschi David Vazquez Nicolas Chapados Christopher Pal Perouz Taslakian 39 4 0 17 Jun 2024
On the Relation between Sensitivity and Accuracy in In-context Learning Yanda Chen Chen Zhao Zhou Yu Kathleen McKeown He He 180 77 0 16 Sep 2022
Language Models as Knowledge Bases? Fabio Petroni Tim Rocktaschel Patrick Lewis A. Bakhtin Yuxiang Wu Alexander H. Miller Sebastian Riedel KELM AI4MH 404 2,576 0 03 Sep 2019