RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen
Reference Content

RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content

17 June 2024

Joao Monteiro

Pierre-Andre Noel

Étienne Marcotte

Valentina Zantedeschi

Nicolas Chapados

Christopher Pal

Perouz Taslakian

Papers citing "RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content"

9 / 9 papers shown

Title
Ward: Provable RAG Dataset Inference via LLM Watermarks Nikola Jovanović Robin Staab Maximilian Baader Martin Vechev 47 1 0 04 Oct 2024
The 2024 Foundation Model Transparency Index Rishi Bommasani Kevin Klyman Sayash Kapoor Shayne Longpre Betty Xiong Nestor Maslej Percy Liang ELM 33 5 0 17 Jul 2024
Benchmarking Benchmark Leakage in Large Language Models Ruijie Xu Zengzhi Wang Run-Ze Fan Pengfei Liu 53 42 0 29 Apr 2024
Language Models for Text Classification: Is In-Context Learning Enough? A. Edwards Jose Camacho-Collados LRM 28 17 0 26 Mar 2024
Can we trust the evaluation on ChatGPT? Rachith Aiyappa Jisun An Haewoon Kwak Yong-Yeol Ahn ELM ALM LLMAG AI4MH LRM 106 76 0 22 Mar 2023
Training language models to follow instructions with human feedback Long Ouyang Jeff Wu Xu Jiang Diogo Almeida Carroll L. Wainwright ... Amanda Askell Peter Welinder Paul Christiano Jan Leike Ryan J. Lowe OSLM ALM 301 11,730 0 04 Mar 2022
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Yue Wang Weishi Wang Shafiq R. Joty S. Hoi 204 1,451 0 02 Sep 2021
Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity Yao Lu Max Bartolo Alastair Moore Sebastian Riedel Pontus Stenetorp AILaw LRM 274 1,114 0 18 Apr 2021
What Makes Good In-Context Examples for GPT- $3$ ? Jiachang Liu Dinghan Shen Yizhe Zhang Bill Dolan Lawrence Carin Weizhu Chen AAML RALM 275 1,296 0 17 Jan 2021