ResearchTrend.AI
  • Communities
  • Connect sessions
  • AI calendar
  • Organizations
  • Join Slack
  • Contact Sales
Papers
Communities
Social Events
Terms and Conditions
Pricing
Contact Sales
Parameter LabParameter LabTwitterGitHubLinkedInBlueskyYoutube

© 2026 ResearchTrend.AI, All rights reserved.

  1. Home
  2. Papers
  3. 2407.01370
  4. Cited By
Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems

Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems

1 July 2024
Philippe Laban
Alexander R. Fabbri
Caiming Xiong
Chien-Sheng Wu
    RALM
ArXiv (abs)PDFHTMLHuggingFace (90 upvotes)

Papers citing "Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systems"

9 / 59 papers shown
Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual Data
Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual DataInternational Conference on Learning Representations (ICLR), 2024
Seiji Maekawa
Hayate Iso
Nikita Bhutani
RALM
410
8
0
15 Oct 2024
MathHay: An Automated Benchmark for Long-Context Mathematical Reasoning
  in LLMs
MathHay: An Automated Benchmark for Long-Context Mathematical Reasoning in LLMs
Lei Wang
Shan Dong
Yuhui Xu
Hanze Dong
Yalu Wang
Amrita Saha
Ee-Peng Lim
Caiming Xiong
Doyen Sahoo
LRM
135
5
0
07 Oct 2024
HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly
HELMET: How to Evaluate Long-Context Language Models Effectively and Thoroughly
Howard Yen
Tianyu Gao
Minmin Hou
Ke Ding
Daniel Fleischer
Peter Izsak
Moshe Wasserblat
Danqi Chen
ALMELM
368
70
0
03 Oct 2024
DeFine: Decision-Making with Analogical Reasoning over Factor Profiles
DeFine: Decision-Making with Analogical Reasoning over Factor ProfilesAnnual Meeting of the Association for Computational Linguistics (ACL), 2024
Yebowen Hu
Xiaoyang Wang
Wenlin Yao
Yiming Lu
Daoan Zhang
H. Foroosh
Dong Yu
Fei Liu
336
4
0
02 Oct 2024
Retrieval Or Holistic Understanding? Dolce: Differentiate Our Long
  Context Evaluation Tasks
Retrieval Or Holistic Understanding? Dolce: Differentiate Our Long Context Evaluation Tasks
Zi Yang
177
2
0
10 Sep 2024
The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned
  Language Models
The Death of Schema Linking? Text-to-SQL in the Age of Well-Reasoned Language Models
Karime Maamari
Fadhil Abubaker
Daniel Jaroslawicz
Amine Mhedhbi
LRM
332
63
0
14 Aug 2024
Introducing a new hyper-parameter for RAG: Context Window Utilization
Introducing a new hyper-parameter for RAG: Context Window Utilization
Kush Juvekar
A. Purwar
202
12
0
29 Jul 2024
Perceptions of Linguistic Uncertainty by Language Models and Humans
Perceptions of Linguistic Uncertainty by Language Models and Humans
Catarina G Belém
Markelle Kelly
M. Steyvers
Sameer Singh
Padhraic Smyth
268
10
0
22 Jul 2024
One Thousand and One Pairs: A "novel" challenge for long-context
  language models
One Thousand and One Pairs: A "novel" challenge for long-context language models
Marzena Karpinska
Katherine Thai
Kyle Lo
Tanya Goyal
Mohit Iyyer
LRM
388
75
0
24 Jun 2024
Previous
12